[==========] Running 22 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 22 tests from RemoteKsckTest
[ RUN ] RemoteKsckTest.TestClusterOk
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260207 20:52:17.293505 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:46735,127.2.223.61:37015,127.2.223.60:38247
I20260207 20:52:17.295259 2940 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260207 20:52:17.296262 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:17.311862 2946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:17.312151 2949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:17.311853 2947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:17.313163 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:18.403296 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:18.403558 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:18.403743 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497538403722 us; error 0 us; skew 500 ppm
I20260207 20:52:18.404565 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:18.409596 2940 webserver.cc:492] Webserver started at http://127.2.223.62:33311/ using document root <none> and password file <none>
I20260207 20:52:18.410444 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:18.410672 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:18.411127 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:18.421454 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "f42d15046f5e44008f175b338b8b4e2b"
format_stamp: "Formatted at 2026-02-07 20:52:18 on dist-test-slave-kqw4"
I20260207 20:52:18.428999 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260207 20:52:18.434023 2955 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:18.435153 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260207 20:52:18.435480 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "f42d15046f5e44008f175b338b8b4e2b"
format_stamp: "Formatted at 2026-02-07 20:52:18 on dist-test-slave-kqw4"
I20260207 20:52:18.435808 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:18.491020 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:18.492559 2940 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260207 20:52:18.493005 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:18.560119 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:46735
I20260207 20:52:18.560225 3006 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:46735 every 8 connection(s)
I20260207 20:52:18.565758 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:18.565999 3007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260207 20:52:18.571794 3009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:18.573119 3010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:18.576483 3012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:18.577335 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:18.577965 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:18.578154 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:18.578302 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497538578288 us; error 0 us; skew 500 ppm
I20260207 20:52:18.578879 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:18.582132 2940 webserver.cc:492] Webserver started at http://127.2.223.61:41289/ using document root <none> and password file <none>
I20260207 20:52:18.582652 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:18.582826 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:18.583072 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:18.584064 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "2b11031259e54d6eafead551e6ed7871"
format_stamp: "Formatted at 2026-02-07 20:52:18 on dist-test-slave-kqw4"
I20260207 20:52:18.586025 3007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:18.589013 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:52:18.593669 3019 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:18.594492 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260207 20:52:18.594779 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "2b11031259e54d6eafead551e6ed7871"
format_stamp: "Formatted at 2026-02-07 20:52:18 on dist-test-slave-kqw4"
I20260207 20:52:18.595053 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:18.615495 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:18.616513 3007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:18.616892 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260207 20:52:18.618795 2957 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.223.61:37015: connect: Connection refused (error 111)
W20260207 20:52:18.623867 3007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:37015: Network error: Client connection negotiation failed: client connection to 127.2.223.61:37015: connect: Connection refused (error 111)
I20260207 20:52:18.661466 3007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } attempt: 1
W20260207 20:52:18.666369 3007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:37015: Network error: Client connection negotiation failed: client connection to 127.2.223.61:37015: connect: Connection refused (error 111)
I20260207 20:52:18.683892 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:37015
I20260207 20:52:18.684057 3071 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:37015 every 8 connection(s)
I20260207 20:52:18.688458 3072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:18.689085 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:18.694777 3072 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:18.695010 3074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:18.697197 3075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:18.699810 3007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } attempt: 2
I20260207 20:52:18.703769 2940 server_base.cc:1060] running on GCE node
W20260207 20:52:18.704457 3078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:18.705415 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:18.705751 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:18.706000 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497538705980 us; error 0 us; skew 500 ppm
I20260207 20:52:18.706825 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:18.710373 3072 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:18.710189 2940 webserver.cc:492] Webserver started at http://127.2.223.60:40539/ using document root <none> and password file <none>
I20260207 20:52:18.711803 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:18.712082 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:18.712466 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:18.714179 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "91c86ee02adc426abebcd489ca5ce9c3"
format_stamp: "Formatted at 2026-02-07 20:52:18 on dist-test-slave-kqw4"
I20260207 20:52:18.715950 3007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:18.720280 3007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38247: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38247: connect: Connection refused (error 111)
I20260207 20:52:18.721164 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.000s sys 0.006s
I20260207 20:52:18.723713 3072 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:18.725462 3085 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:18.726395 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260207 20:52:18.726805 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "91c86ee02adc426abebcd489ca5ce9c3"
format_stamp: "Formatted at 2026-02-07 20:52:18 on dist-test-slave-kqw4"
I20260207 20:52:18.727133 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:52:18.728513 3072 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38247: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38247: connect: Connection refused (error 111)
I20260207 20:52:18.742636 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:18.743883 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:18.759915 3072 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } attempt: 1
W20260207 20:52:18.764882 3072 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38247: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38247: connect: Connection refused (error 111)
I20260207 20:52:18.779744 3007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } attempt: 1
W20260207 20:52:18.784663 3007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38247: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38247: connect: Connection refused (error 111)
I20260207 20:52:18.803362 3072 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } attempt: 2
W20260207 20:52:18.807456 3072 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38247: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38247: connect: Connection refused (error 111)
I20260207 20:52:18.809438 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:38247
I20260207 20:52:18.809548 3137 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:38247 every 8 connection(s)
I20260207 20:52:18.813488 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:52:18.813647 3138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:18.818961 3138 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:18.829874 3138 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:18.838388 3138 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:18.853237 3007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } attempt: 2
I20260207 20:52:18.854799 3138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3: Bootstrap starting.
I20260207 20:52:18.860538 3138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:18.862790 3138 log.cc:826] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3: Log is configured to *not* fsync() on all Append() calls
I20260207 20:52:18.868024 3138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3: No bootstrap required, opened a new log
I20260207 20:52:18.868264 3007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b: Bootstrap starting.
I20260207 20:52:18.873131 3007 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:18.878140 3007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b: No bootstrap required, opened a new log
I20260207 20:52:18.887148 3138 raft_consensus.cc:359] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } }
I20260207 20:52:18.887156 3007 raft_consensus.cc:359] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } }
I20260207 20:52:18.887964 3138 raft_consensus.cc:385] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:18.888000 3007 raft_consensus.cc:385] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:18.888304 3138 raft_consensus.cc:740] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91c86ee02adc426abebcd489ca5ce9c3, State: Initialized, Role: FOLLOWER
I20260207 20:52:18.888352 3007 raft_consensus.cc:740] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f42d15046f5e44008f175b338b8b4e2b, State: Initialized, Role: FOLLOWER
I20260207 20:52:18.889165 3007 consensus_queue.cc:260] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } }
I20260207 20:52:18.889163 3138 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } }
I20260207 20:52:18.892508 3144 sys_catalog.cc:455] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } } }
I20260207 20:52:18.892645 3145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } } }
I20260207 20:52:18.893436 3144 sys_catalog.cc:458] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:18.893682 3145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:18.894497 3007 sys_catalog.cc:565] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:18.894506 3138 sys_catalog.cc:565] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:18.905668 3072 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } attempt: 3
I20260207 20:52:18.926282 3072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871: Bootstrap starting.
I20260207 20:52:18.932864 3072 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871: Neither blocks nor log segments found. Creating new log.
W20260207 20:52:18.934473 3166 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:18.934909 3166 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:52:18.935426 3167 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260207 20:52:18.935655 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:52:18.940964 3072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871: No bootstrap required, opened a new log
I20260207 20:52:18.942991 3072 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } }
I20260207 20:52:18.943531 3072 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:18.943745 3072 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b11031259e54d6eafead551e6ed7871, State: Initialized, Role: FOLLOWER
I20260207 20:52:18.944312 3072 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } }
I20260207 20:52:18.947404 3170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } } }
I20260207 20:52:18.948163 3170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:18.948454 3072 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:18.968740 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:52:18.970724 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:18.972290 3181 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:18.972587 3181 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:52:18.976847 3144 raft_consensus.cc:493] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:18.978826 3144 raft_consensus.cc:515] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } }
W20260207 20:52:18.980361 3182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:18.982825 3047 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f42d15046f5e44008f175b338b8b4e2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b11031259e54d6eafead551e6ed7871" is_pre_election: true
I20260207 20:52:18.983484 3144 leader_election.cc:290] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b11031259e54d6eafead551e6ed7871 (127.2.223.61:37015), 91c86ee02adc426abebcd489ca5ce9c3 (127.2.223.60:38247)
I20260207 20:52:18.983678 3047 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f42d15046f5e44008f175b338b8b4e2b in term 0.
I20260207 20:52:18.982954 3113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f42d15046f5e44008f175b338b8b4e2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91c86ee02adc426abebcd489ca5ce9c3" is_pre_election: true
I20260207 20:52:18.984764 3113 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f42d15046f5e44008f175b338b8b4e2b in term 0.
I20260207 20:52:18.984853 2957 leader_election.cc:304] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b11031259e54d6eafead551e6ed7871, f42d15046f5e44008f175b338b8b4e2b; no voters:
I20260207 20:52:18.985694 3144 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:18.986075 3144 raft_consensus.cc:493] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:18.986395 3144 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [term 0 FOLLOWER]: Advancing to term 1
W20260207 20:52:18.989228 3183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:18.993911 3144 raft_consensus.cc:515] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } }
I20260207 20:52:18.997510 3047 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f42d15046f5e44008f175b338b8b4e2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b11031259e54d6eafead551e6ed7871"
W20260207 20:52:18.997860 3092 tablet.cc:2378] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260207 20:52:18.998111 3047 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:19.005439 3047 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f42d15046f5e44008f175b338b8b4e2b in term 1.
I20260207 20:52:19.007891 3113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f42d15046f5e44008f175b338b8b4e2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91c86ee02adc426abebcd489ca5ce9c3"
I20260207 20:52:19.009076 3113 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:19.016417 3113 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f42d15046f5e44008f175b338b8b4e2b in term 1.
I20260207 20:52:19.008504 3144 leader_election.cc:290] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [CANDIDATE]: Term 1 election: Requested vote from peers 2b11031259e54d6eafead551e6ed7871 (127.2.223.61:37015), 91c86ee02adc426abebcd489ca5ce9c3 (127.2.223.60:38247)
I20260207 20:52:19.017867 2957 leader_election.cc:304] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b11031259e54d6eafead551e6ed7871, f42d15046f5e44008f175b338b8b4e2b; no voters:
I20260207 20:52:19.026978 3144 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:19.027570 3144 raft_consensus.cc:697] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [term 1 LEADER]: Becoming Leader. State: Replica: f42d15046f5e44008f175b338b8b4e2b, State: Running, Role: LEADER
I20260207 20:52:19.030154 3144 consensus_queue.cc:237] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } }
W20260207 20:52:19.031675 3185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:19.035321 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:19.036420 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:19.036737 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:19.036561 3187 sys_catalog.cc:455] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f42d15046f5e44008f175b338b8b4e2b. Latest consensus state: current_term: 1 leader_uuid: "f42d15046f5e44008f175b338b8b4e2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } } }
I20260207 20:52:19.036957 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497539036939 us; error 0 us; skew 500 ppm
I20260207 20:52:19.037243 3187 sys_catalog.cc:458] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:19.037774 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:19.039130 3189 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:52:19.047253 3189 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:52:19.047283 2940 webserver.cc:492] Webserver started at http://127.2.223.1:35137/ using document root <none> and password file <none>
I20260207 20:52:19.047981 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:19.048213 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:19.048480 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:19.049705 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "dcd57692ab874a26817aea3f6bc0d35e"
format_stamp: "Formatted at 2026-02-07 20:52:19 on dist-test-slave-kqw4"
I20260207 20:52:19.054558 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260207 20:52:19.059093 3194 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:19.060068 2940 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260207 20:52:19.060434 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "dcd57692ab874a26817aea3f6bc0d35e"
format_stamp: "Formatted at 2026-02-07 20:52:19 on dist-test-slave-kqw4"
I20260207 20:52:19.060789 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:19.066383 3113 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 1 FOLLOWER]: Refusing update from remote peer f42d15046f5e44008f175b338b8b4e2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:19.068724 3047 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [term 1 FOLLOWER]: Refusing update from remote peer f42d15046f5e44008f175b338b8b4e2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:19.068560 3187 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:19.070680 3187 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:19.096202 3145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f42d15046f5e44008f175b338b8b4e2b. Latest consensus state: current_term: 1 leader_uuid: "f42d15046f5e44008f175b338b8b4e2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } } }
I20260207 20:52:19.096972 3145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:19.099123 3170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f42d15046f5e44008f175b338b8b4e2b. Latest consensus state: current_term: 1 leader_uuid: "f42d15046f5e44008f175b338b8b4e2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } } }
I20260207 20:52:19.099692 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:19.099853 3170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:19.101073 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:19.104108 3193 mvcc.cc:204] Tried to move back new op lower bound from 7251957919994318848 to 7251957919878574080. Current Snapshot: MvccSnapshot[applied={T|T < 7251957919994318848}]
I20260207 20:52:19.117094 3170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f42d15046f5e44008f175b338b8b4e2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } } }
I20260207 20:52:19.118220 3170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:19.116144 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:19.119119 3144 sys_catalog.cc:455] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f42d15046f5e44008f175b338b8b4e2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } } }
I20260207 20:52:19.123752 3144 sys_catalog.cc:458] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:19.129771 3144 sys_catalog.cc:455] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f42d15046f5e44008f175b338b8b4e2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } } }
I20260207 20:52:19.130085 3145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f42d15046f5e44008f175b338b8b4e2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } } }
I20260207 20:52:19.130784 3144 sys_catalog.cc:458] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:19.131160 3145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:19.137094 3189 catalog_manager.cc:1357] Generated new cluster ID: d5523bddce314f2f97c8db7b5055186c
I20260207 20:52:19.137447 3189 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:52:19.137850 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:19.138139 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:19.138442 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:19.138681 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260207 20:52:19.173038 3189 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:52:19.175303 3189 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:52:19.212478 3189 catalog_manager.cc:6027] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b: Generated new TSK 0
I20260207 20:52:19.213644 3189 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:52:19.266875 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:41405
I20260207 20:52:19.267944 3265 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:41405 every 8 connection(s)
I20260207 20:52:19.299650 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:19.311113 3266 heartbeater.cc:344] Connected to a master server at 127.2.223.60:38247
I20260207 20:52:19.313956 3266 heartbeater.cc:461] Registering TS with master...
W20260207 20:52:19.314080 3274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:19.316682 3273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:19.320600 3266 heartbeater.cc:507] Master 127.2.223.60:38247 requested a full tablet report, sending...
I20260207 20:52:19.329137 3267 heartbeater.cc:344] Connected to a master server at 127.2.223.61:37015
I20260207 20:52:19.329770 3267 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:19.331375 3267 heartbeater.cc:507] Master 127.2.223.61:37015 requested a full tablet report, sending...
I20260207 20:52:19.333531 3103 ts_manager.cc:194] Registered new tserver with Master: dcd57692ab874a26817aea3f6bc0d35e (127.2.223.1:41405)
I20260207 20:52:19.334899 3037 ts_manager.cc:194] Registered new tserver with Master: dcd57692ab874a26817aea3f6bc0d35e (127.2.223.1:41405)
I20260207 20:52:19.335731 3268 heartbeater.cc:344] Connected to a master server at 127.2.223.62:46735
I20260207 20:52:19.336207 3268 heartbeater.cc:461] Registering TS with master...
W20260207 20:52:19.336884 3276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:19.337411 3268 heartbeater.cc:507] Master 127.2.223.62:46735 requested a full tablet report, sending...
I20260207 20:52:19.339812 2972 ts_manager.cc:194] Registered new tserver with Master: dcd57692ab874a26817aea3f6bc0d35e (127.2.223.1:41405)
I20260207 20:52:19.339840 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:19.341058 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:19.341344 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:19.341554 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497539341533 us; error 0 us; skew 500 ppm
I20260207 20:52:19.342303 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:19.342275 2972 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52118
I20260207 20:52:19.345602 2940 webserver.cc:492] Webserver started at http://127.2.223.2:34189/ using document root <none> and password file <none>
I20260207 20:52:19.346287 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:19.346525 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:19.346863 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:19.348282 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "2cc56411012c499cb2c1b6e76f2d6152"
format_stamp: "Formatted at 2026-02-07 20:52:19 on dist-test-slave-kqw4"
I20260207 20:52:19.353811 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260207 20:52:19.355854 3268 heartbeater.cc:499] Master 127.2.223.62:46735 was elected leader, sending a full tablet report...
I20260207 20:52:19.358217 3281 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:19.359190 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260207 20:52:19.359470 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "2cc56411012c499cb2c1b6e76f2d6152"
format_stamp: "Formatted at 2026-02-07 20:52:19 on dist-test-slave-kqw4"
I20260207 20:52:19.359730 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:19.381649 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:19.383090 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:19.386265 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:19.389199 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:19.389401 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:19.389657 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:19.389840 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:19.544520 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:37289
I20260207 20:52:19.544613 3343 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:37289 every 8 connection(s)
I20260207 20:52:19.583859 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:19.590941 3345 heartbeater.cc:344] Connected to a master server at 127.2.223.61:37015
I20260207 20:52:19.591428 3345 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:19.592198 3344 heartbeater.cc:344] Connected to a master server at 127.2.223.60:38247
I20260207 20:52:19.609287 3344 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:19.610364 3344 heartbeater.cc:507] Master 127.2.223.60:38247 requested a full tablet report, sending...
I20260207 20:52:19.615617 3103 ts_manager.cc:194] Registered new tserver with Master: 2cc56411012c499cb2c1b6e76f2d6152 (127.2.223.2:37289)
I20260207 20:52:19.592466 3345 heartbeater.cc:507] Master 127.2.223.61:37015 requested a full tablet report, sending...
I20260207 20:52:19.619907 3037 ts_manager.cc:194] Registered new tserver with Master: 2cc56411012c499cb2c1b6e76f2d6152 (127.2.223.2:37289)
W20260207 20:52:19.623088 3351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:19.623803 3346 heartbeater.cc:344] Connected to a master server at 127.2.223.62:46735
I20260207 20:52:19.624198 3346 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:19.625072 3346 heartbeater.cc:507] Master 127.2.223.62:46735 requested a full tablet report, sending...
I20260207 20:52:19.627292 2972 ts_manager.cc:194] Registered new tserver with Master: 2cc56411012c499cb2c1b6e76f2d6152 (127.2.223.2:37289)
I20260207 20:52:19.629184 2972 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52122
I20260207 20:52:19.643527 3346 heartbeater.cc:499] Master 127.2.223.62:46735 was elected leader, sending a full tablet report...
W20260207 20:52:19.649773 3352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:19.649914 3354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:19.651669 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:19.652848 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:19.653101 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:19.653303 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497539653281 us; error 0 us; skew 500 ppm
I20260207 20:52:19.654089 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:19.661520 2940 webserver.cc:492] Webserver started at http://127.2.223.3:33827/ using document root <none> and password file <none>
I20260207 20:52:19.662232 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:19.662544 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:19.662842 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:19.664152 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "1615daa9275640038c2514f5ac789b4b"
format_stamp: "Formatted at 2026-02-07 20:52:19 on dist-test-slave-kqw4"
I20260207 20:52:19.672888 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.004s sys 0.004s
I20260207 20:52:19.677781 3359 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:19.678803 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260207 20:52:19.679083 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "1615daa9275640038c2514f5ac789b4b"
format_stamp: "Formatted at 2026-02-07 20:52:19 on dist-test-slave-kqw4"
I20260207 20:52:19.679328 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:19.701354 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:19.704370 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:19.712278 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:19.714484 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:19.714721 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:19.714969 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:19.715106 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:19.949781 3166 catalog_manager.cc:1269] Loaded cluster ID: d5523bddce314f2f97c8db7b5055186c
I20260207 20:52:19.950240 3166 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3: loading cluster ID for follower catalog manager: success
I20260207 20:52:19.964462 3166 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3: acquiring CA information for follower catalog manager: success
I20260207 20:52:19.970367 3166 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:52:19.982031 3181 catalog_manager.cc:1269] Loaded cluster ID: d5523bddce314f2f97c8db7b5055186c
I20260207 20:52:19.982393 3181 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871: loading cluster ID for follower catalog manager: success
I20260207 20:52:20.000419 3181 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871: acquiring CA information for follower catalog manager: success
I20260207 20:52:20.010777 3181 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:52:20.015583 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:32811
I20260207 20:52:20.015707 3421 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:32811 every 8 connection(s)
I20260207 20:52:20.098718 3422 heartbeater.cc:344] Connected to a master server at 127.2.223.60:38247
I20260207 20:52:20.099136 3422 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:20.099961 3422 heartbeater.cc:507] Master 127.2.223.60:38247 requested a full tablet report, sending...
I20260207 20:52:20.103757 3102 ts_manager.cc:194] Registered new tserver with Master: 1615daa9275640038c2514f5ac789b4b (127.2.223.3:32811)
I20260207 20:52:20.104084 3423 heartbeater.cc:344] Connected to a master server at 127.2.223.61:37015
I20260207 20:52:20.104498 3423 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:20.105337 3423 heartbeater.cc:507] Master 127.2.223.61:37015 requested a full tablet report, sending...
I20260207 20:52:20.114384 3424 heartbeater.cc:344] Connected to a master server at 127.2.223.62:46735
I20260207 20:52:20.114826 3424 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:20.115761 3424 heartbeater.cc:507] Master 127.2.223.62:46735 requested a full tablet report, sending...
I20260207 20:52:20.116047 3037 ts_manager.cc:194] Registered new tserver with Master: 1615daa9275640038c2514f5ac789b4b (127.2.223.3:32811)
I20260207 20:52:20.118994 2972 ts_manager.cc:194] Registered new tserver with Master: 1615daa9275640038c2514f5ac789b4b (127.2.223.3:32811)
I20260207 20:52:20.119915 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.046872482s
I20260207 20:52:20.120352 2972 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52126
I20260207 20:52:20.132429 3424 heartbeater.cc:499] Master 127.2.223.62:46735 was elected leader, sending a full tablet report...
I20260207 20:52:20.222164 2971 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52134:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:52:20.257987 2971 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:52:20.507061 3309 tablet_service.cc:1505] Processing CreateTablet for tablet 9554976bc84045ae9bd315cd4bdc5f2b (DEFAULT_TABLE table=ksck-test-table [id=d2470d9a2556481db4d47c1241ffe439]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:20.508621 3308 tablet_service.cc:1505] Processing CreateTablet for tablet a6bdfd51fe124eca9c127c87d9275417 (DEFAULT_TABLE table=ksck-test-table [id=d2470d9a2556481db4d47c1241ffe439]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:20.509680 3309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9554976bc84045ae9bd315cd4bdc5f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:20.511534 3307 tablet_service.cc:1505] Processing CreateTablet for tablet 748359014fdb401e85d1b19e08cd4628 (DEFAULT_TABLE table=ksck-test-table [id=d2470d9a2556481db4d47c1241ffe439]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:20.514858 3308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6bdfd51fe124eca9c127c87d9275417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:20.521063 3231 tablet_service.cc:1505] Processing CreateTablet for tablet 9554976bc84045ae9bd315cd4bdc5f2b (DEFAULT_TABLE table=ksck-test-table [id=d2470d9a2556481db4d47c1241ffe439]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:20.524768 3307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748359014fdb401e85d1b19e08cd4628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:20.519066 3387 tablet_service.cc:1505] Processing CreateTablet for tablet 9554976bc84045ae9bd315cd4bdc5f2b (DEFAULT_TABLE table=ksck-test-table [id=d2470d9a2556481db4d47c1241ffe439]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:20.528218 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9554976bc84045ae9bd315cd4bdc5f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:20.534870 3385 tablet_service.cc:1505] Processing CreateTablet for tablet 748359014fdb401e85d1b19e08cd4628 (DEFAULT_TABLE table=ksck-test-table [id=d2470d9a2556481db4d47c1241ffe439]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:20.534917 3386 tablet_service.cc:1505] Processing CreateTablet for tablet a6bdfd51fe124eca9c127c87d9275417 (DEFAULT_TABLE table=ksck-test-table [id=d2470d9a2556481db4d47c1241ffe439]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:20.537684 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748359014fdb401e85d1b19e08cd4628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:20.539719 3230 tablet_service.cc:1505] Processing CreateTablet for tablet a6bdfd51fe124eca9c127c87d9275417 (DEFAULT_TABLE table=ksck-test-table [id=d2470d9a2556481db4d47c1241ffe439]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:20.533638 3229 tablet_service.cc:1505] Processing CreateTablet for tablet 748359014fdb401e85d1b19e08cd4628 (DEFAULT_TABLE table=ksck-test-table [id=d2470d9a2556481db4d47c1241ffe439]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:20.543610 3231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9554976bc84045ae9bd315cd4bdc5f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:20.546250 3230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6bdfd51fe124eca9c127c87d9275417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:20.547626 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6bdfd51fe124eca9c127c87d9275417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:20.549316 3229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748359014fdb401e85d1b19e08cd4628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:20.676047 3454 tablet_bootstrap.cc:492] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e: Bootstrap starting.
I20260207 20:52:20.754812 3453 tablet_bootstrap.cc:492] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b: Bootstrap starting.
I20260207 20:52:20.756791 3454 tablet_bootstrap.cc:654] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:20.771674 3455 tablet_bootstrap.cc:492] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152: Bootstrap starting.
I20260207 20:52:20.783306 3455 tablet_bootstrap.cc:654] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:20.784494 3454 tablet_bootstrap.cc:492] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e: No bootstrap required, opened a new log
I20260207 20:52:20.772950 3453 tablet_bootstrap.cc:654] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:20.794888 3454 ts_tablet_manager.cc:1403] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e: Time spent bootstrapping tablet: real 0.127s user 0.014s sys 0.008s
I20260207 20:52:20.800957 3454 raft_consensus.cc:359] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:20.801698 3454 raft_consensus.cc:385] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:20.802011 3454 raft_consensus.cc:740] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcd57692ab874a26817aea3f6bc0d35e, State: Initialized, Role: FOLLOWER
I20260207 20:52:20.802711 3454 consensus_queue.cc:260] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:20.803805 3455 tablet_bootstrap.cc:492] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152: No bootstrap required, opened a new log
I20260207 20:52:20.805135 3455 ts_tablet_manager.cc:1403] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152: Time spent bootstrapping tablet: real 0.034s user 0.013s sys 0.000s
I20260207 20:52:20.814549 3453 tablet_bootstrap.cc:492] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b: No bootstrap required, opened a new log
I20260207 20:52:20.815410 3455 raft_consensus.cc:359] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:20.816126 3455 raft_consensus.cc:385] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:20.816401 3455 raft_consensus.cc:740] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cc56411012c499cb2c1b6e76f2d6152, State: Initialized, Role: FOLLOWER
I20260207 20:52:20.820214 3455 consensus_queue.cc:260] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:20.825357 3453 ts_tablet_manager.cc:1403] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b: Time spent bootstrapping tablet: real 0.146s user 0.007s sys 0.015s
I20260207 20:52:20.830651 3453 raft_consensus.cc:359] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } }
I20260207 20:52:20.831364 3453 raft_consensus.cc:385] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:20.831669 3453 raft_consensus.cc:740] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1615daa9275640038c2514f5ac789b4b, State: Initialized, Role: FOLLOWER
I20260207 20:52:20.833082 3453 consensus_queue.cc:260] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } }
I20260207 20:52:20.847970 3454 ts_tablet_manager.cc:1434] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e: Time spent starting tablet: real 0.053s user 0.005s sys 0.012s
I20260207 20:52:20.852411 3454 tablet_bootstrap.cc:492] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e: Bootstrap starting.
I20260207 20:52:20.858317 3455 ts_tablet_manager.cc:1434] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152: Time spent starting tablet: real 0.053s user 0.009s sys 0.004s
I20260207 20:52:20.866959 3455 tablet_bootstrap.cc:492] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152: Bootstrap starting.
I20260207 20:52:20.868016 3453 ts_tablet_manager.cc:1434] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b: Time spent starting tablet: real 0.042s user 0.009s sys 0.004s
I20260207 20:52:20.869053 3453 tablet_bootstrap.cc:492] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b: Bootstrap starting.
I20260207 20:52:20.887367 3460 raft_consensus.cc:493] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:20.887883 3460 raft_consensus.cc:515] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:20.891654 3455 tablet_bootstrap.cc:654] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:20.919174 3460 leader_election.cc:290] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcd57692ab874a26817aea3f6bc0d35e (127.2.223.1:41405), 1615daa9275640038c2514f5ac789b4b (127.2.223.3:32811)
I20260207 20:52:20.921558 3453 tablet_bootstrap.cc:654] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:20.922194 3454 tablet_bootstrap.cc:654] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:20.967574 3454 tablet_bootstrap.cc:492] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e: No bootstrap required, opened a new log
I20260207 20:52:20.968088 3454 ts_tablet_manager.cc:1403] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e: Time spent bootstrapping tablet: real 0.116s user 0.006s sys 0.006s
I20260207 20:52:20.969414 3453 tablet_bootstrap.cc:492] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b: No bootstrap required, opened a new log
I20260207 20:52:20.968779 3455 tablet_bootstrap.cc:492] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152: No bootstrap required, opened a new log
I20260207 20:52:20.975530 3455 ts_tablet_manager.cc:1403] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152: Time spent bootstrapping tablet: real 0.109s user 0.021s sys 0.011s
I20260207 20:52:20.970860 3241 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a6bdfd51fe124eca9c127c87d9275417" candidate_uuid: "2cc56411012c499cb2c1b6e76f2d6152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcd57692ab874a26817aea3f6bc0d35e" is_pre_election: true
I20260207 20:52:20.974447 3453 ts_tablet_manager.cc:1403] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b: Time spent bootstrapping tablet: real 0.106s user 0.013s sys 0.002s
I20260207 20:52:20.976269 3459 raft_consensus.cc:493] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:20.977290 3459 raft_consensus.cc:515] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:20.982940 3459 leader_election.cc:290] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cc56411012c499cb2c1b6e76f2d6152 (127.2.223.2:37289), 1615daa9275640038c2514f5ac789b4b (127.2.223.3:32811)
I20260207 20:52:20.978363 3454 raft_consensus.cc:359] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } }
W20260207 20:52:20.983570 3284 leader_election.cc:343] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcd57692ab874a26817aea3f6bc0d35e (127.2.223.1:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:20.987036 3454 raft_consensus.cc:385] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:20.989390 3454 raft_consensus.cc:740] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcd57692ab874a26817aea3f6bc0d35e, State: Initialized, Role: FOLLOWER
I20260207 20:52:20.993996 3455 raft_consensus.cc:359] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } }
I20260207 20:52:20.996059 3455 raft_consensus.cc:385] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:20.996500 3455 raft_consensus.cc:740] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cc56411012c499cb2c1b6e76f2d6152, State: Initialized, Role: FOLLOWER
I20260207 20:52:20.997260 3455 consensus_queue.cc:260] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } }
I20260207 20:52:21.001044 3455 ts_tablet_manager.cc:1434] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152: Time spent starting tablet: real 0.025s user 0.007s sys 0.001s
I20260207 20:52:21.005198 3397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a6bdfd51fe124eca9c127c87d9275417" candidate_uuid: "2cc56411012c499cb2c1b6e76f2d6152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1615daa9275640038c2514f5ac789b4b" is_pre_election: true
I20260207 20:52:21.006919 3453 raft_consensus.cc:359] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
W20260207 20:52:21.007790 3283 leader_election.cc:343] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1615daa9275640038c2514f5ac789b4b (127.2.223.3:32811): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:21.006659 3454 consensus_queue.cc:260] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } }
I20260207 20:52:21.008176 3453 raft_consensus.cc:385] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:21.008265 3283 leader_election.cc:304] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cc56411012c499cb2c1b6e76f2d6152; no voters: 1615daa9275640038c2514f5ac789b4b, dcd57692ab874a26817aea3f6bc0d35e
I20260207 20:52:21.009162 3460 raft_consensus.cc:2749] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:52:21.008690 3453 raft_consensus.cc:740] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1615daa9275640038c2514f5ac789b4b, State: Initialized, Role: FOLLOWER
I20260207 20:52:21.015745 3455 tablet_bootstrap.cc:492] T 748359014fdb401e85d1b19e08cd4628 P 2cc56411012c499cb2c1b6e76f2d6152: Bootstrap starting.
I20260207 20:52:21.017575 3453 consensus_queue.cc:260] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:21.023671 3453 ts_tablet_manager.cc:1434] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b: Time spent starting tablet: real 0.047s user 0.008s sys 0.000s
I20260207 20:52:21.028484 3453 tablet_bootstrap.cc:492] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b: Bootstrap starting.
I20260207 20:52:21.032011 3455 tablet_bootstrap.cc:654] T 748359014fdb401e85d1b19e08cd4628 P 2cc56411012c499cb2c1b6e76f2d6152: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:21.038817 3397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "748359014fdb401e85d1b19e08cd4628" candidate_uuid: "dcd57692ab874a26817aea3f6bc0d35e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1615daa9275640038c2514f5ac789b4b" is_pre_election: true
I20260207 20:52:21.039522 3397 raft_consensus.cc:2468] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcd57692ab874a26817aea3f6bc0d35e in term 0.
I20260207 20:52:21.040704 3196 leader_election.cc:304] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1615daa9275640038c2514f5ac789b4b, dcd57692ab874a26817aea3f6bc0d35e; no voters:
I20260207 20:52:21.041842 3459 raft_consensus.cc:2804] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:21.042752 3459 raft_consensus.cc:493] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:21.043067 3459 raft_consensus.cc:3060] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:21.047498 3319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "748359014fdb401e85d1b19e08cd4628" candidate_uuid: "dcd57692ab874a26817aea3f6bc0d35e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cc56411012c499cb2c1b6e76f2d6152" is_pre_election: true
W20260207 20:52:21.049023 3195 leader_election.cc:343] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cc56411012c499cb2c1b6e76f2d6152 (127.2.223.2:37289): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:21.049250 3453 tablet_bootstrap.cc:654] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:21.059818 3455 tablet_bootstrap.cc:492] T 748359014fdb401e85d1b19e08cd4628 P 2cc56411012c499cb2c1b6e76f2d6152: No bootstrap required, opened a new log
I20260207 20:52:21.060370 3455 ts_tablet_manager.cc:1403] T 748359014fdb401e85d1b19e08cd4628 P 2cc56411012c499cb2c1b6e76f2d6152: Time spent bootstrapping tablet: real 0.045s user 0.015s sys 0.013s
I20260207 20:52:21.054441 3459 raft_consensus.cc:515] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:21.066737 3455 raft_consensus.cc:359] T 748359014fdb401e85d1b19e08cd4628 P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:21.067572 3455 raft_consensus.cc:385] T 748359014fdb401e85d1b19e08cd4628 P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:21.067888 3455 raft_consensus.cc:740] T 748359014fdb401e85d1b19e08cd4628 P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cc56411012c499cb2c1b6e76f2d6152, State: Initialized, Role: FOLLOWER
I20260207 20:52:21.069474 3454 ts_tablet_manager.cc:1434] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e: Time spent starting tablet: real 0.101s user 0.008s sys 0.000s
I20260207 20:52:21.070609 3454 tablet_bootstrap.cc:492] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e: Bootstrap starting.
I20260207 20:52:21.068740 3455 consensus_queue.cc:260] T 748359014fdb401e85d1b19e08cd4628 P 2cc56411012c499cb2c1b6e76f2d6152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:21.076869 3319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "748359014fdb401e85d1b19e08cd4628" candidate_uuid: "dcd57692ab874a26817aea3f6bc0d35e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cc56411012c499cb2c1b6e76f2d6152"
I20260207 20:52:21.077430 3319 raft_consensus.cc:3060] T 748359014fdb401e85d1b19e08cd4628 P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:21.077941 3459 leader_election.cc:290] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [CANDIDATE]: Term 1 election: Requested vote from peers 2cc56411012c499cb2c1b6e76f2d6152 (127.2.223.2:37289), 1615daa9275640038c2514f5ac789b4b (127.2.223.3:32811)
I20260207 20:52:21.080360 3455 ts_tablet_manager.cc:1434] T 748359014fdb401e85d1b19e08cd4628 P 2cc56411012c499cb2c1b6e76f2d6152: Time spent starting tablet: real 0.020s user 0.006s sys 0.001s
I20260207 20:52:21.091243 3397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "748359014fdb401e85d1b19e08cd4628" candidate_uuid: "dcd57692ab874a26817aea3f6bc0d35e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1615daa9275640038c2514f5ac789b4b"
I20260207 20:52:21.091846 3397 raft_consensus.cc:3060] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:21.092041 3319 raft_consensus.cc:2468] T 748359014fdb401e85d1b19e08cd4628 P 2cc56411012c499cb2c1b6e76f2d6152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcd57692ab874a26817aea3f6bc0d35e in term 1.
I20260207 20:52:21.094412 3453 tablet_bootstrap.cc:492] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b: No bootstrap required, opened a new log
I20260207 20:52:21.096107 3453 ts_tablet_manager.cc:1403] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b: Time spent bootstrapping tablet: real 0.068s user 0.014s sys 0.011s
I20260207 20:52:21.099851 3195 leader_election.cc:304] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cc56411012c499cb2c1b6e76f2d6152, dcd57692ab874a26817aea3f6bc0d35e; no voters:
I20260207 20:52:21.103324 3459 raft_consensus.cc:2804] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:21.108696 3397 raft_consensus.cc:2468] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcd57692ab874a26817aea3f6bc0d35e in term 1.
I20260207 20:52:21.108928 3454 tablet_bootstrap.cc:654] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:21.110219 3459 raft_consensus.cc:697] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [term 1 LEADER]: Becoming Leader. State: Replica: dcd57692ab874a26817aea3f6bc0d35e, State: Running, Role: LEADER
I20260207 20:52:21.111027 3459 consensus_queue.cc:237] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:21.118036 3453 raft_consensus.cc:359] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:21.118889 3453 raft_consensus.cc:385] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:21.119215 3453 raft_consensus.cc:740] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1615daa9275640038c2514f5ac789b4b, State: Initialized, Role: FOLLOWER
I20260207 20:52:21.119937 3453 consensus_queue.cc:260] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:21.126963 3453 ts_tablet_manager.cc:1434] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b: Time spent starting tablet: real 0.030s user 0.007s sys 0.001s
I20260207 20:52:21.143110 3461 raft_consensus.cc:493] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:21.143668 3461 raft_consensus.cc:515] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:21.148494 2972 catalog_manager.cc:5654] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e reported cstate change: term changed from 0 to 1, leader changed from <none> to dcd57692ab874a26817aea3f6bc0d35e (127.2.223.1). New cstate: current_term: 1 leader_uuid: "dcd57692ab874a26817aea3f6bc0d35e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:21.157994 3461 leader_election.cc:290] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcd57692ab874a26817aea3f6bc0d35e (127.2.223.1:41405), 2cc56411012c499cb2c1b6e76f2d6152 (127.2.223.2:37289)
I20260207 20:52:21.179364 3454 tablet_bootstrap.cc:492] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e: No bootstrap required, opened a new log
I20260207 20:52:21.179913 3454 ts_tablet_manager.cc:1403] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e: Time spent bootstrapping tablet: real 0.110s user 0.021s sys 0.009s
I20260207 20:52:21.183005 3454 raft_consensus.cc:359] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:21.183722 3454 raft_consensus.cc:385] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:21.184024 3454 raft_consensus.cc:740] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcd57692ab874a26817aea3f6bc0d35e, State: Initialized, Role: FOLLOWER
I20260207 20:52:21.184700 3454 consensus_queue.cc:260] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:21.184978 3241 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a6bdfd51fe124eca9c127c87d9275417" candidate_uuid: "1615daa9275640038c2514f5ac789b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcd57692ab874a26817aea3f6bc0d35e" is_pre_election: true
I20260207 20:52:21.185703 3241 raft_consensus.cc:2468] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1615daa9275640038c2514f5ac789b4b in term 0.
I20260207 20:52:21.186995 3454 ts_tablet_manager.cc:1434] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260207 20:52:21.187377 3362 leader_election.cc:304] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1615daa9275640038c2514f5ac789b4b, dcd57692ab874a26817aea3f6bc0d35e; no voters:
I20260207 20:52:21.188800 3461 raft_consensus.cc:2804] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:21.189160 3461 raft_consensus.cc:493] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:21.189476 3461 raft_consensus.cc:3060] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:21.206003 3461 raft_consensus.cc:515] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:21.214659 3461 leader_election.cc:290] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [CANDIDATE]: Term 1 election: Requested vote from peers dcd57692ab874a26817aea3f6bc0d35e (127.2.223.1:41405), 2cc56411012c499cb2c1b6e76f2d6152 (127.2.223.2:37289)
I20260207 20:52:21.216099 3241 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a6bdfd51fe124eca9c127c87d9275417" candidate_uuid: "1615daa9275640038c2514f5ac789b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcd57692ab874a26817aea3f6bc0d35e"
I20260207 20:52:21.216720 3241 raft_consensus.cc:3060] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:21.261703 3241 raft_consensus.cc:2468] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1615daa9275640038c2514f5ac789b4b in term 1.
I20260207 20:52:21.262842 3362 leader_election.cc:304] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1615daa9275640038c2514f5ac789b4b, dcd57692ab874a26817aea3f6bc0d35e; no voters:
I20260207 20:52:21.263684 3461 raft_consensus.cc:2804] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:21.272783 3459 raft_consensus.cc:493] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:21.273283 3459 raft_consensus.cc:515] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } }
I20260207 20:52:21.279868 3459 leader_election.cc:290] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1615daa9275640038c2514f5ac789b4b (127.2.223.3:32811), 2cc56411012c499cb2c1b6e76f2d6152 (127.2.223.2:37289)
I20260207 20:52:21.288117 3461 raft_consensus.cc:697] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [term 1 LEADER]: Becoming Leader. State: Replica: 1615daa9275640038c2514f5ac789b4b, State: Running, Role: LEADER
W20260207 20:52:21.289829 2956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.223.60:38247, user_credentials={real_user=slave}} blocked reactor thread for 46266.5us
I20260207 20:52:21.290001 3319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9554976bc84045ae9bd315cd4bdc5f2b" candidate_uuid: "dcd57692ab874a26817aea3f6bc0d35e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cc56411012c499cb2c1b6e76f2d6152" is_pre_election: true
I20260207 20:52:21.290694 3397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9554976bc84045ae9bd315cd4bdc5f2b" candidate_uuid: "dcd57692ab874a26817aea3f6bc0d35e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1615daa9275640038c2514f5ac789b4b" is_pre_election: true
I20260207 20:52:21.295118 3397 raft_consensus.cc:2468] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcd57692ab874a26817aea3f6bc0d35e in term 0.
I20260207 20:52:21.295674 3317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a6bdfd51fe124eca9c127c87d9275417" candidate_uuid: "1615daa9275640038c2514f5ac789b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cc56411012c499cb2c1b6e76f2d6152"
I20260207 20:52:21.290706 3319 raft_consensus.cc:2468] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcd57692ab874a26817aea3f6bc0d35e in term 0.
I20260207 20:52:21.297502 3318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a6bdfd51fe124eca9c127c87d9275417" candidate_uuid: "1615daa9275640038c2514f5ac789b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cc56411012c499cb2c1b6e76f2d6152" is_pre_election: true
I20260207 20:52:21.298367 3196 leader_election.cc:304] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1615daa9275640038c2514f5ac789b4b, dcd57692ab874a26817aea3f6bc0d35e; no voters:
I20260207 20:52:21.299546 3459 raft_consensus.cc:2804] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:21.299921 3459 raft_consensus.cc:493] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:21.303059 3459 raft_consensus.cc:3060] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:21.307108 3461 consensus_queue.cc:237] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } }
I20260207 20:52:21.297920 3317 raft_consensus.cc:3060] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:21.319799 3459 raft_consensus.cc:515] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } }
I20260207 20:52:21.331637 3459 leader_election.cc:290] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [CANDIDATE]: Term 1 election: Requested vote from peers 1615daa9275640038c2514f5ac789b4b (127.2.223.3:32811), 2cc56411012c499cb2c1b6e76f2d6152 (127.2.223.2:37289)
I20260207 20:52:21.327697 3317 raft_consensus.cc:2468] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1615daa9275640038c2514f5ac789b4b in term 1.
I20260207 20:52:21.332298 3397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9554976bc84045ae9bd315cd4bdc5f2b" candidate_uuid: "dcd57692ab874a26817aea3f6bc0d35e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1615daa9275640038c2514f5ac789b4b"
I20260207 20:52:21.332713 3318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9554976bc84045ae9bd315cd4bdc5f2b" candidate_uuid: "dcd57692ab874a26817aea3f6bc0d35e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cc56411012c499cb2c1b6e76f2d6152"
I20260207 20:52:21.332863 3397 raft_consensus.cc:3060] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:21.333191 3318 raft_consensus.cc:3060] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:21.344691 3318 raft_consensus.cc:2468] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcd57692ab874a26817aea3f6bc0d35e in term 1.
I20260207 20:52:21.347769 3195 leader_election.cc:304] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cc56411012c499cb2c1b6e76f2d6152, dcd57692ab874a26817aea3f6bc0d35e; no voters:
I20260207 20:52:21.349964 2970 catalog_manager.cc:5654] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1615daa9275640038c2514f5ac789b4b (127.2.223.3). New cstate: current_term: 1 leader_uuid: "1615daa9275640038c2514f5ac789b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } health_report { overall_health: HEALTHY } } }
I20260207 20:52:21.351775 3397 raft_consensus.cc:2468] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcd57692ab874a26817aea3f6bc0d35e in term 1.
I20260207 20:52:21.366948 3459 raft_consensus.cc:2804] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:21.370460 3459 raft_consensus.cc:697] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [term 1 LEADER]: Becoming Leader. State: Replica: dcd57692ab874a26817aea3f6bc0d35e, State: Running, Role: LEADER
I20260207 20:52:21.375267 3459 consensus_queue.cc:237] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } }
I20260207 20:52:21.389487 2970 catalog_manager.cc:5654] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e reported cstate change: term changed from 0 to 1, leader changed from <none> to dcd57692ab874a26817aea3f6bc0d35e (127.2.223.1). New cstate: current_term: 1 leader_uuid: "dcd57692ab874a26817aea3f6bc0d35e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:21.697006 3459 consensus_queue.cc:1048] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:21.745641 3459 consensus_queue.cc:1048] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:21.760310 3461 consensus_queue.cc:1048] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcd57692ab874a26817aea3f6bc0d35e" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:21.778807 3461 consensus_queue.cc:1048] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260207 20:52:21.782971 3459 consensus_queue.cc:1048] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1615daa9275640038c2514f5ac789b4b" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260207 20:52:21.835434 3459 consensus_queue.cc:1048] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cc56411012c499cb2c1b6e76f2d6152" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260207 20:52:21.953629 3360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.223.2:37289, user_credentials={real_user=slave}} blocked reactor thread for 71371.9us
I20260207 20:52:22.708890 3386 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:52:22.763607 3308 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:52:22.810060 3230 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260207 20:52:23.192251 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:52:23.228389 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:23.229172 2940 tablet_replica.cc:333] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e: stopping tablet replica
I20260207 20:52:23.230015 2940 raft_consensus.cc:2243] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:23.230502 2940 raft_consensus.cc:2272] T a6bdfd51fe124eca9c127c87d9275417 P dcd57692ab874a26817aea3f6bc0d35e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:23.232846 2940 tablet_replica.cc:333] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e: stopping tablet replica
I20260207 20:52:23.233476 2940 raft_consensus.cc:2243] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:23.234652 2940 raft_consensus.cc:2272] T 9554976bc84045ae9bd315cd4bdc5f2b P dcd57692ab874a26817aea3f6bc0d35e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:23.236882 2940 tablet_replica.cc:333] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e: stopping tablet replica
I20260207 20:52:23.237514 2940 raft_consensus.cc:2243] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:23.238282 2940 raft_consensus.cc:2272] T 748359014fdb401e85d1b19e08cd4628 P dcd57692ab874a26817aea3f6bc0d35e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:23.452611 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
W20260207 20:52:23.461046 3362 consensus_peers.cc:597] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b -> Peer dcd57692ab874a26817aea3f6bc0d35e (127.2.223.1:41405): Couldn't send request to peer dcd57692ab874a26817aea3f6bc0d35e. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:41405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:52:23.474925 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:52:23.722849 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:23.723467 2940 tablet_replica.cc:333] T 748359014fdb401e85d1b19e08cd4628 P 2cc56411012c499cb2c1b6e76f2d6152: stopping tablet replica
I20260207 20:52:23.724041 2940 raft_consensus.cc:2243] T 748359014fdb401e85d1b19e08cd4628 P 2cc56411012c499cb2c1b6e76f2d6152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:23.724431 2940 raft_consensus.cc:2272] T 748359014fdb401e85d1b19e08cd4628 P 2cc56411012c499cb2c1b6e76f2d6152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:23.725948 2940 tablet_replica.cc:333] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152: stopping tablet replica
I20260207 20:52:23.726441 2940 raft_consensus.cc:2243] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:23.726886 2940 raft_consensus.cc:2272] T 9554976bc84045ae9bd315cd4bdc5f2b P 2cc56411012c499cb2c1b6e76f2d6152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:23.728755 2940 tablet_replica.cc:333] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152: stopping tablet replica
I20260207 20:52:23.729125 2940 raft_consensus.cc:2243] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:23.729441 2940 raft_consensus.cc:2272] T a6bdfd51fe124eca9c127c87d9275417 P 2cc56411012c499cb2c1b6e76f2d6152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:23.750695 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:52:23.760645 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:52:23.786381 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:23.786934 2940 tablet_replica.cc:333] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b: stopping tablet replica
I20260207 20:52:23.787442 2940 raft_consensus.cc:2243] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:23.788098 2940 raft_consensus.cc:2272] T a6bdfd51fe124eca9c127c87d9275417 P 1615daa9275640038c2514f5ac789b4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:23.789729 2940 tablet_replica.cc:333] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b: stopping tablet replica
I20260207 20:52:23.790161 2940 raft_consensus.cc:2243] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:23.790541 2940 raft_consensus.cc:2272] T 748359014fdb401e85d1b19e08cd4628 P 1615daa9275640038c2514f5ac789b4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:23.792076 2940 tablet_replica.cc:333] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b: stopping tablet replica
I20260207 20:52:23.792519 2940 raft_consensus.cc:2243] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:23.792861 2940 raft_consensus.cc:2272] T 9554976bc84045ae9bd315cd4bdc5f2b P 1615daa9275640038c2514f5ac789b4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:23.812407 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:52:23.823261 2940 master.cc:561] Master@127.2.223.62:46735 shutting down...
I20260207 20:52:23.839226 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:23.839967 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:23.840284 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P f42d15046f5e44008f175b338b8b4e2b: stopping tablet replica
I20260207 20:52:23.859210 2940 master.cc:583] Master@127.2.223.62:46735 shutdown complete.
I20260207 20:52:23.870270 2940 master.cc:561] Master@127.2.223.61:37015 shutting down...
I20260207 20:52:23.885105 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:23.885623 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:23.885910 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2b11031259e54d6eafead551e6ed7871: stopping tablet replica
W20260207 20:52:24.569567 3068 debug-util.cc:398] Leaking SignalData structure 0x7b08000ae060 after lost signal to thread 2943
W20260207 20:52:24.571180 3068 debug-util.cc:398] Leaking SignalData structure 0x7b080023eda0 after lost signal to thread 3137
W20260207 20:52:24.901851 2940 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3068)
I20260207 20:52:24.975262 3545 raft_consensus.cc:493] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f42d15046f5e44008f175b338b8b4e2b)
I20260207 20:52:24.975795 3545 raft_consensus.cc:515] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } }
I20260207 20:52:24.977478 3545 leader_election.cc:290] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f42d15046f5e44008f175b338b8b4e2b (127.2.223.62:46735), 2b11031259e54d6eafead551e6ed7871 (127.2.223.61:37015)
W20260207 20:52:24.979727 3087 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.223.62:46735: connect: Connection refused (error 111) [suppressed 7 similar messages]
W20260207 20:52:24.982679 3087 leader_election.cc:336] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f42d15046f5e44008f175b338b8b4e2b (127.2.223.62:46735): Network error: Client connection negotiation failed: client connection to 127.2.223.62:46735: connect: Connection refused (error 111)
W20260207 20:52:24.983170 3088 leader_election.cc:336] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2b11031259e54d6eafead551e6ed7871 (127.2.223.61:37015): Network error: Client connection negotiation failed: client connection to 127.2.223.61:37015: connect: Connection refused (error 111)
I20260207 20:52:24.983512 3088 leader_election.cc:304] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91c86ee02adc426abebcd489ca5ce9c3; no voters: 2b11031259e54d6eafead551e6ed7871, f42d15046f5e44008f175b338b8b4e2b
I20260207 20:52:24.984082 3545 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260207 20:52:25.902329 2940 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 3068)
W20260207 20:52:26.902756 2940 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 3068)
I20260207 20:52:27.192327 3549 raft_consensus.cc:493] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f42d15046f5e44008f175b338b8b4e2b)
I20260207 20:52:27.192795 3549 raft_consensus.cc:515] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f42d15046f5e44008f175b338b8b4e2b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 46735 } } peers { permanent_uuid: "2b11031259e54d6eafead551e6ed7871" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37015 } } peers { permanent_uuid: "91c86ee02adc426abebcd489ca5ce9c3" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38247 } }
I20260207 20:52:27.194370 3549 leader_election.cc:290] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f42d15046f5e44008f175b338b8b4e2b (127.2.223.62:46735), 2b11031259e54d6eafead551e6ed7871 (127.2.223.61:37015)
W20260207 20:52:27.199831 3087 leader_election.cc:336] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f42d15046f5e44008f175b338b8b4e2b (127.2.223.62:46735): Network error: Client connection negotiation failed: client connection to 127.2.223.62:46735: connect: Connection refused (error 111)
W20260207 20:52:27.200412 3088 leader_election.cc:336] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2b11031259e54d6eafead551e6ed7871 (127.2.223.61:37015): Network error: Client connection negotiation failed: client connection to 127.2.223.61:37015: connect: Connection refused (error 111)
I20260207 20:52:27.200780 3088 leader_election.cc:304] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91c86ee02adc426abebcd489ca5ce9c3; no voters: 2b11031259e54d6eafead551e6ed7871, f42d15046f5e44008f175b338b8b4e2b
I20260207 20:52:27.201364 3549 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260207 20:52:27.530514 2940 master.cc:583] Master@127.2.223.61:37015 shutdown complete.
I20260207 20:52:27.545773 2940 master.cc:561] Master@127.2.223.60:38247 shutting down...
I20260207 20:52:27.562655 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:27.563463 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:27.563791 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 91c86ee02adc426abebcd489ca5ce9c3: stopping tablet replica
I20260207 20:52:27.583901 2940 master.cc:583] Master@127.2.223.60:38247 shutdown complete.
[ OK ] RemoteKsckTest.TestClusterOk (10333 ms)
[ RUN ] RemoteKsckTest.TestCheckUnusualFlags
I20260207 20:52:27.623081 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:37577,127.2.223.61:38895,127.2.223.60:39309
I20260207 20:52:27.624415 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:27.629827 3554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:27.629926 3555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:27.631106 3557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:27.631968 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:27.632755 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:27.632947 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:27.633085 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497547633068 us; error 0 us; skew 500 ppm
I20260207 20:52:27.633561 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:27.636030 2940 webserver.cc:492] Webserver started at http://127.2.223.62:44201/ using document root <none> and password file <none>
I20260207 20:52:27.636490 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:27.636669 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:27.636902 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:27.638046 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "17314d2f65e64fc89b32816c81f85d1e"
format_stamp: "Formatted at 2026-02-07 20:52:27 on dist-test-slave-kqw4"
I20260207 20:52:27.642256 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:52:27.645499 3562 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:27.646234 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:52:27.646485 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "17314d2f65e64fc89b32816c81f85d1e"
format_stamp: "Formatted at 2026-02-07 20:52:27 on dist-test-slave-kqw4"
I20260207 20:52:27.646756 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:27.669883 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:27.671322 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:27.707895 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:37577
I20260207 20:52:27.707985 3613 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:37577 every 8 connection(s)
I20260207 20:52:27.711617 3614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:27.711717 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:27.717083 3616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:27.718681 3617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:27.719300 3614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:27.720273 2940 server_base.cc:1060] running on GCE node
W20260207 20:52:27.720634 3619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:27.721817 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:27.722124 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:27.722353 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497547722331 us; error 0 us; skew 500 ppm
I20260207 20:52:27.723125 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:27.725898 2940 webserver.cc:492] Webserver started at http://127.2.223.61:32797/ using document root <none> and password file <none>
I20260207 20:52:27.726349 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:27.726533 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:27.726802 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:27.728025 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "65cbb907122a4cb88ac548d325dfb188"
format_stamp: "Formatted at 2026-02-07 20:52:27 on dist-test-slave-kqw4"
I20260207 20:52:27.732626 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260207 20:52:27.736196 3614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:27.736821 3626 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:27.737730 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260207 20:52:27.738049 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "65cbb907122a4cb88ac548d325dfb188"
format_stamp: "Formatted at 2026-02-07 20:52:27 on dist-test-slave-kqw4"
I20260207 20:52:27.738343 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:52:27.741281 3614 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:38895: Network error: Client connection negotiation failed: client connection to 127.2.223.61:38895: connect: Connection refused (error 111)
I20260207 20:52:27.752328 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:27.753520 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:27.761775 3614 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } attempt: 1
W20260207 20:52:27.766551 3614 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:38895: Network error: Client connection negotiation failed: client connection to 127.2.223.61:38895: connect: Connection refused (error 111)
I20260207 20:52:27.793099 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:38895
I20260207 20:52:27.793205 3678 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:38895 every 8 connection(s)
I20260207 20:52:27.796945 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:27.797161 3679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260207 20:52:27.802551 3681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:27.803953 3679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:27.804189 3682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:27.806267 3684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:27.806347 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:27.807669 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:27.807890 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:27.808061 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497547808042 us; error 0 us; skew 500 ppm
I20260207 20:52:27.808710 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:27.811460 2940 webserver.cc:492] Webserver started at http://127.2.223.60:45967/ using document root <none> and password file <none>
I20260207 20:52:27.811924 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:27.812093 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:27.812328 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:27.813525 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "441c5e5a415442f4a7d508b5548dbf13"
format_stamp: "Formatted at 2026-02-07 20:52:27 on dist-test-slave-kqw4"
I20260207 20:52:27.814965 3614 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } attempt: 2
I20260207 20:52:27.817034 3679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:27.819386 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260207 20:52:27.824106 3692 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:27.825906 2940 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260207 20:52:27.826247 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "441c5e5a415442f4a7d508b5548dbf13"
format_stamp: "Formatted at 2026-02-07 20:52:27 on dist-test-slave-kqw4"
I20260207 20:52:27.826576 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:27.828101 3614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:27.832770 3614 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:39309: Network error: Client connection negotiation failed: client connection to 127.2.223.60:39309: connect: Connection refused (error 111)
I20260207 20:52:27.833794 3679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:27.839016 3679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:39309: Network error: Client connection negotiation failed: client connection to 127.2.223.60:39309: connect: Connection refused (error 111)
I20260207 20:52:27.841791 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:27.843012 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:27.852234 3614 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } attempt: 1
W20260207 20:52:27.857335 3614 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:39309: Network error: Client connection negotiation failed: client connection to 127.2.223.60:39309: connect: Connection refused (error 111)
I20260207 20:52:27.873489 3679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } attempt: 1
W20260207 20:52:27.878446 3679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:39309: Network error: Client connection negotiation failed: client connection to 127.2.223.60:39309: connect: Connection refused (error 111)
I20260207 20:52:27.882880 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:39309
I20260207 20:52:27.882995 3744 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:39309 every 8 connection(s)
I20260207 20:52:27.885740 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:52:27.886555 3745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:27.891983 3745 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:27.902241 3745 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:27.905815 3614 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } attempt: 2
I20260207 20:52:27.911288 3745 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:27.913944 3679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } attempt: 2
I20260207 20:52:27.925213 3614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e: Bootstrap starting.
I20260207 20:52:27.929534 3745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13: Bootstrap starting.
I20260207 20:52:27.932000 3614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:27.932063 3679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188: Bootstrap starting.
I20260207 20:52:27.934298 3745 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:27.938006 3614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e: No bootstrap required, opened a new log
I20260207 20:52:27.938673 3679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:27.938973 3745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13: No bootstrap required, opened a new log
I20260207 20:52:27.941129 3745 raft_consensus.cc:359] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } }
I20260207 20:52:27.941159 3614 raft_consensus.cc:359] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } }
I20260207 20:52:27.941826 3745 raft_consensus.cc:385] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:27.942034 3614 raft_consensus.cc:385] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:27.942152 3745 raft_consensus.cc:740] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 441c5e5a415442f4a7d508b5548dbf13, State: Initialized, Role: FOLLOWER
I20260207 20:52:27.942468 3614 raft_consensus.cc:740] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17314d2f65e64fc89b32816c81f85d1e, State: Initialized, Role: FOLLOWER
I20260207 20:52:27.943181 3614 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } }
I20260207 20:52:27.943137 3745 consensus_queue.cc:260] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } }
I20260207 20:52:27.944419 3679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188: No bootstrap required, opened a new log
I20260207 20:52:27.945405 3754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } } }
I20260207 20:52:27.946220 3754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:27.946972 3614 sys_catalog.cc:565] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:27.947499 3679 raft_consensus.cc:359] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } }
I20260207 20:52:27.948259 3679 raft_consensus.cc:385] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:27.948596 3679 raft_consensus.cc:740] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65cbb907122a4cb88ac548d325dfb188, State: Initialized, Role: FOLLOWER
I20260207 20:52:27.949309 3679 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } }
I20260207 20:52:27.953685 3745 sys_catalog.cc:565] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:27.955741 3758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } } }
I20260207 20:52:27.956646 3758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:27.957173 3679 sys_catalog.cc:565] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:27.957299 3755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } } }
I20260207 20:52:27.958642 3755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:27.969333 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
W20260207 20:52:27.973207 3774 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:27.973583 3774 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:52:27.981251 3784 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:27.981549 3784 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:52:27.981773 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:52:27.983104 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:27.984608 3789 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:27.984840 3789 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:52:27.989447 3790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:27.990077 3791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:27.991571 3793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:27.992384 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:27.993124 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:27.993317 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:27.993445 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497547993434 us; error 0 us; skew 500 ppm
I20260207 20:52:27.993863 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:27.996069 2940 webserver.cc:492] Webserver started at http://127.2.223.1:41545/ using document root <none> and password file <none>
I20260207 20:52:27.996522 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:27.996682 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:27.996888 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:27.997927 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "0d184dc660a34b97b9f020b390bcdb05"
format_stamp: "Formatted at 2026-02-07 20:52:27 on dist-test-slave-kqw4"
I20260207 20:52:28.002490 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260207 20:52:28.005770 3798 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:28.007311 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260207 20:52:28.007683 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "0d184dc660a34b97b9f020b390bcdb05"
format_stamp: "Formatted at 2026-02-07 20:52:27 on dist-test-slave-kqw4"
I20260207 20:52:28.008028 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:28.036923 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:28.038169 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:28.039649 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:28.042006 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:28.042222 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:28.042452 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:28.042632 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260207 20:52:28.082242 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:44769
I20260207 20:52:28.082330 3860 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:44769 every 8 connection(s)
I20260207 20:52:28.098989 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:28.109441 3861 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38895
I20260207 20:52:28.109902 3861 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:28.111384 3861 heartbeater.cc:507] Master 127.2.223.61:38895 requested a full tablet report, sending...
I20260207 20:52:28.112569 3863 heartbeater.cc:344] Connected to a master server at 127.2.223.62:37577
I20260207 20:52:28.113041 3863 heartbeater.cc:461] Registering TS with master...
W20260207 20:52:28.113294 3868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:28.114094 3863 heartbeater.cc:507] Master 127.2.223.62:37577 requested a full tablet report, sending...
I20260207 20:52:28.115144 3644 ts_manager.cc:194] Registered new tserver with Master: 0d184dc660a34b97b9f020b390bcdb05 (127.2.223.1:44769)
I20260207 20:52:28.116566 3862 heartbeater.cc:344] Connected to a master server at 127.2.223.60:39309
I20260207 20:52:28.116930 3862 heartbeater.cc:461] Registering TS with master...
W20260207 20:52:28.117746 3869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:28.117869 3579 ts_manager.cc:194] Registered new tserver with Master: 0d184dc660a34b97b9f020b390bcdb05 (127.2.223.1:44769)
I20260207 20:52:28.117830 3862 heartbeater.cc:507] Master 127.2.223.60:39309 requested a full tablet report, sending...
I20260207 20:52:28.121758 3710 ts_manager.cc:194] Registered new tserver with Master: 0d184dc660a34b97b9f020b390bcdb05 (127.2.223.1:44769)
I20260207 20:52:28.122242 2940 server_base.cc:1060] running on GCE node
W20260207 20:52:28.122637 3871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:28.123495 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:28.123687 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:28.123818 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497548123807 us; error 0 us; skew 500 ppm
I20260207 20:52:28.124256 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:28.126396 2940 webserver.cc:492] Webserver started at http://127.2.223.2:46503/ using document root <none> and password file <none>
I20260207 20:52:28.126868 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:28.127027 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:28.127229 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:28.128253 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "d49446a0e9c84b1280996c6bc4862503"
format_stamp: "Formatted at 2026-02-07 20:52:28 on dist-test-slave-kqw4"
I20260207 20:52:28.133562 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260207 20:52:28.137010 3876 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:28.137699 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260207 20:52:28.137975 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "d49446a0e9c84b1280996c6bc4862503"
format_stamp: "Formatted at 2026-02-07 20:52:28 on dist-test-slave-kqw4"
I20260207 20:52:28.138227 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:28.162557 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:28.163810 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:28.165035 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:28.167254 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:28.167464 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:28.167680 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:28.167830 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:28.217481 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:46121
I20260207 20:52:28.217564 3938 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:46121 every 8 connection(s)
I20260207 20:52:28.225982 3758 raft_consensus.cc:493] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:28.226668 3758 raft_consensus.cc:515] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } }
I20260207 20:52:28.230489 3720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65cbb907122a4cb88ac548d325dfb188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "441c5e5a415442f4a7d508b5548dbf13" is_pre_election: true
I20260207 20:52:28.231649 3720 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65cbb907122a4cb88ac548d325dfb188 in term 0.
I20260207 20:52:28.233088 3631 leader_election.cc:304] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 441c5e5a415442f4a7d508b5548dbf13, 65cbb907122a4cb88ac548d325dfb188; no voters:
I20260207 20:52:28.233577 3758 leader_election.cc:290] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17314d2f65e64fc89b32816c81f85d1e (127.2.223.62:37577), 441c5e5a415442f4a7d508b5548dbf13 (127.2.223.60:39309)
I20260207 20:52:28.236739 3758 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:28.235131 3589 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65cbb907122a4cb88ac548d325dfb188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17314d2f65e64fc89b32816c81f85d1e" is_pre_election: true
I20260207 20:52:28.237735 3589 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65cbb907122a4cb88ac548d325dfb188 in term 0.
I20260207 20:52:28.239462 3758 raft_consensus.cc:493] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:28.240083 3758 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:28.260771 3758 raft_consensus.cc:515] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } }
I20260207 20:52:28.272202 3589 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65cbb907122a4cb88ac548d325dfb188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17314d2f65e64fc89b32816c81f85d1e"
I20260207 20:52:28.272909 3589 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:28.284245 3589 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65cbb907122a4cb88ac548d325dfb188 in term 1.
I20260207 20:52:28.289383 3720 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65cbb907122a4cb88ac548d325dfb188" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "441c5e5a415442f4a7d508b5548dbf13"
I20260207 20:52:28.290104 3720 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:28.290112 3628 leader_election.cc:304] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17314d2f65e64fc89b32816c81f85d1e, 65cbb907122a4cb88ac548d325dfb188; no voters:
I20260207 20:52:28.297434 3946 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:28.301546 3720 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65cbb907122a4cb88ac548d325dfb188 in term 1.
I20260207 20:52:28.308761 3758 leader_election.cc:290] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [CANDIDATE]: Term 1 election: Requested vote from peers 17314d2f65e64fc89b32816c81f85d1e (127.2.223.62:37577), 441c5e5a415442f4a7d508b5548dbf13 (127.2.223.60:39309)
I20260207 20:52:28.314512 3941 heartbeater.cc:344] Connected to a master server at 127.2.223.62:37577
I20260207 20:52:28.315172 3941 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:28.316259 3941 heartbeater.cc:507] Master 127.2.223.62:37577 requested a full tablet report, sending...
I20260207 20:52:28.322849 3579 ts_manager.cc:194] Registered new tserver with Master: d49446a0e9c84b1280996c6bc4862503 (127.2.223.2:46121)
I20260207 20:52:28.324512 3940 heartbeater.cc:344] Connected to a master server at 127.2.223.60:39309
I20260207 20:52:28.324949 3940 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:28.325881 3940 heartbeater.cc:507] Master 127.2.223.60:39309 requested a full tablet report, sending...
I20260207 20:52:28.328128 3946 raft_consensus.cc:697] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [term 1 LEADER]: Becoming Leader. State: Replica: 65cbb907122a4cb88ac548d325dfb188, State: Running, Role: LEADER
I20260207 20:52:28.329638 3946 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } }
I20260207 20:52:28.331084 3709 ts_manager.cc:194] Registered new tserver with Master: d49446a0e9c84b1280996c6bc4862503 (127.2.223.2:46121)
I20260207 20:52:28.331176 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:28.332121 3939 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38895
I20260207 20:52:28.332468 3939 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:28.333302 3939 heartbeater.cc:507] Master 127.2.223.61:38895 requested a full tablet report, sending...
I20260207 20:52:28.341755 3758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65cbb907122a4cb88ac548d325dfb188. Latest consensus state: current_term: 1 leader_uuid: "65cbb907122a4cb88ac548d325dfb188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } } }
I20260207 20:52:28.342566 3758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:28.343402 3643 ts_manager.cc:194] Registered new tserver with Master: d49446a0e9c84b1280996c6bc4862503 (127.2.223.2:46121)
W20260207 20:52:28.344858 3949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:28.345257 3950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:28.346202 3951 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
W20260207 20:52:28.354544 3953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:28.356410 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:28.357577 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:28.357779 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:28.357915 3951 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:52:28.357944 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497548357929 us; error 0 us; skew 500 ppm
I20260207 20:52:28.358914 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:28.361944 2940 webserver.cc:492] Webserver started at http://127.2.223.3:40581/ using document root <none> and password file <none>
I20260207 20:52:28.362576 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:28.362890 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:28.363215 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:28.364593 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3"
format_stamp: "Formatted at 2026-02-07 20:52:28 on dist-test-slave-kqw4"
I20260207 20:52:28.370397 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260207 20:52:28.371527 3720 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [term 1 FOLLOWER]: Refusing update from remote peer 65cbb907122a4cb88ac548d325dfb188: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:28.372874 3946 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:28.374138 3589 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [term 1 FOLLOWER]: Refusing update from remote peer 65cbb907122a4cb88ac548d325dfb188: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:28.375799 3946 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:28.385871 3755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65cbb907122a4cb88ac548d325dfb188. Latest consensus state: current_term: 1 leader_uuid: "65cbb907122a4cb88ac548d325dfb188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } } }
I20260207 20:52:28.390277 3755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:28.392014 3959 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:28.395388 2940 fs_manager.cc:730] Time spent opening block manager: real 0.023s user 0.012s sys 0.004s
I20260207 20:52:28.395792 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3"
format_stamp: "Formatted at 2026-02-07 20:52:28 on dist-test-slave-kqw4"
I20260207 20:52:28.395670 3754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65cbb907122a4cb88ac548d325dfb188. Latest consensus state: current_term: 1 leader_uuid: "65cbb907122a4cb88ac548d325dfb188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } } }
I20260207 20:52:28.396384 3754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:28.396153 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:28.404062 3755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "65cbb907122a4cb88ac548d325dfb188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } } }
I20260207 20:52:28.404835 3755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:28.407894 3947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "65cbb907122a4cb88ac548d325dfb188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } } }
I20260207 20:52:28.408703 3947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:28.409533 3947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "65cbb907122a4cb88ac548d325dfb188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } } }
I20260207 20:52:28.410034 3951 catalog_manager.cc:1357] Generated new cluster ID: 2dd4fd31426146e5969671a0b003a647
I20260207 20:52:28.410436 3951 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:52:28.410210 3947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:28.415594 3754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "65cbb907122a4cb88ac548d325dfb188" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17314d2f65e64fc89b32816c81f85d1e" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 37577 } } peers { permanent_uuid: "65cbb907122a4cb88ac548d325dfb188" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38895 } } peers { permanent_uuid: "441c5e5a415442f4a7d508b5548dbf13" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 39309 } } }
I20260207 20:52:28.416296 3754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:28.455075 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:28.456817 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:28.461422 3951 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:52:28.464602 3951 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:52:28.465698 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:28.471230 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:28.471604 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260207 20:52:28.471963 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:28.472191 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:28.503085 3951 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188: Generated new TSK 0
I20260207 20:52:28.503899 3951 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:52:28.513638 3643 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50288
I20260207 20:52:28.514319 3644 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50294
I20260207 20:52:28.527154 3939 heartbeater.cc:499] Master 127.2.223.61:38895 was elected leader, sending a full tablet report...
I20260207 20:52:28.527545 3861 heartbeater.cc:499] Master 127.2.223.61:38895 was elected leader, sending a full tablet report...
I20260207 20:52:28.563992 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:44859
I20260207 20:52:28.564072 4028 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:44859 every 8 connection(s)
I20260207 20:52:28.599105 4029 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38895
I20260207 20:52:28.599238 4030 heartbeater.cc:344] Connected to a master server at 127.2.223.60:39309
I20260207 20:52:28.599606 4029 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:28.599704 4030 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:28.600643 4029 heartbeater.cc:507] Master 127.2.223.61:38895 requested a full tablet report, sending...
I20260207 20:52:28.600661 4030 heartbeater.cc:507] Master 127.2.223.60:39309 requested a full tablet report, sending...
I20260207 20:52:28.603322 3644 ts_manager.cc:194] Registered new tserver with Master: 6be49ea05ccc47eaa62a9e27d7c52cb3 (127.2.223.3:44859)
I20260207 20:52:28.603482 3710 ts_manager.cc:194] Registered new tserver with Master: 6be49ea05ccc47eaa62a9e27d7c52cb3 (127.2.223.3:44859)
I20260207 20:52:28.605249 3644 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50306
I20260207 20:52:28.614645 4031 heartbeater.cc:344] Connected to a master server at 127.2.223.62:37577
I20260207 20:52:28.615025 4031 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:28.615622 4031 heartbeater.cc:507] Master 127.2.223.62:37577 requested a full tablet report, sending...
I20260207 20:52:28.618363 3579 ts_manager.cc:194] Registered new tserver with Master: 6be49ea05ccc47eaa62a9e27d7c52cb3 (127.2.223.3:44859)
I20260207 20:52:28.618572 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.011755942s
I20260207 20:52:28.621260 4029 heartbeater.cc:499] Master 127.2.223.61:38895 was elected leader, sending a full tablet report...
I20260207 20:52:28.668627 3642 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50308:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:52:28.674081 3642 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:52:28.799664 3826 tablet_service.cc:1505] Processing CreateTablet for tablet 30d9ec506ce646b4b6facfdb58646879 (DEFAULT_TABLE table=ksck-test-table [id=14b50f4dfefb42c89e5838c86501aadc]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:28.801162 3826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d9ec506ce646b4b6facfdb58646879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:28.803676 3825 tablet_service.cc:1505] Processing CreateTablet for tablet 2bdf91cf66bc4a2595b8092dd99c6def (DEFAULT_TABLE table=ksck-test-table [id=14b50f4dfefb42c89e5838c86501aadc]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:28.804575 3904 tablet_service.cc:1505] Processing CreateTablet for tablet 30d9ec506ce646b4b6facfdb58646879 (DEFAULT_TABLE table=ksck-test-table [id=14b50f4dfefb42c89e5838c86501aadc]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:28.805114 3825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bdf91cf66bc4a2595b8092dd99c6def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:28.805853 3904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d9ec506ce646b4b6facfdb58646879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:28.805601 3902 tablet_service.cc:1505] Processing CreateTablet for tablet ef57cb47c1ef431f96a715f80a87e9b0 (DEFAULT_TABLE table=ksck-test-table [id=14b50f4dfefb42c89e5838c86501aadc]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:28.806814 3902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef57cb47c1ef431f96a715f80a87e9b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:28.809194 3824 tablet_service.cc:1505] Processing CreateTablet for tablet ef57cb47c1ef431f96a715f80a87e9b0 (DEFAULT_TABLE table=ksck-test-table [id=14b50f4dfefb42c89e5838c86501aadc]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:28.804090 3903 tablet_service.cc:1505] Processing CreateTablet for tablet 2bdf91cf66bc4a2595b8092dd99c6def (DEFAULT_TABLE table=ksck-test-table [id=14b50f4dfefb42c89e5838c86501aadc]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:28.812294 3903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bdf91cf66bc4a2595b8092dd99c6def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:28.810496 3824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef57cb47c1ef431f96a715f80a87e9b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:28.849888 3994 tablet_service.cc:1505] Processing CreateTablet for tablet 30d9ec506ce646b4b6facfdb58646879 (DEFAULT_TABLE table=ksck-test-table [id=14b50f4dfefb42c89e5838c86501aadc]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:28.850322 3993 tablet_service.cc:1505] Processing CreateTablet for tablet 2bdf91cf66bc4a2595b8092dd99c6def (DEFAULT_TABLE table=ksck-test-table [id=14b50f4dfefb42c89e5838c86501aadc]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:28.851581 3993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bdf91cf66bc4a2595b8092dd99c6def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:28.852212 3994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d9ec506ce646b4b6facfdb58646879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:28.854202 3992 tablet_service.cc:1505] Processing CreateTablet for tablet ef57cb47c1ef431f96a715f80a87e9b0 (DEFAULT_TABLE table=ksck-test-table [id=14b50f4dfefb42c89e5838c86501aadc]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:28.856396 3992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef57cb47c1ef431f96a715f80a87e9b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:28.889143 4051 tablet_bootstrap.cc:492] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503: Bootstrap starting.
I20260207 20:52:28.891247 4050 tablet_bootstrap.cc:492] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05: Bootstrap starting.
I20260207 20:52:28.904362 4051 tablet_bootstrap.cc:654] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:28.914882 4052 tablet_bootstrap.cc:492] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3: Bootstrap starting.
I20260207 20:52:28.915783 4051 tablet_bootstrap.cc:492] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503: No bootstrap required, opened a new log
I20260207 20:52:28.916288 4051 ts_tablet_manager.cc:1403] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503: Time spent bootstrapping tablet: real 0.027s user 0.014s sys 0.000s
I20260207 20:52:28.919085 4051 raft_consensus.cc:359] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:28.919807 4051 raft_consensus.cc:385] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:28.920104 4051 raft_consensus.cc:740] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d49446a0e9c84b1280996c6bc4862503, State: Initialized, Role: FOLLOWER
I20260207 20:52:28.920912 4051 consensus_queue.cc:260] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:28.927099 4051 ts_tablet_manager.cc:1434] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260207 20:52:28.928223 4051 tablet_bootstrap.cc:492] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503: Bootstrap starting.
I20260207 20:52:28.933796 4051 tablet_bootstrap.cc:654] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:28.946410 4052 tablet_bootstrap.cc:654] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:28.962052 4050 tablet_bootstrap.cc:654] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:28.967655 4052 tablet_bootstrap.cc:492] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3: No bootstrap required, opened a new log
I20260207 20:52:28.968152 4052 ts_tablet_manager.cc:1403] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3: Time spent bootstrapping tablet: real 0.054s user 0.007s sys 0.005s
I20260207 20:52:28.971062 4052 raft_consensus.cc:359] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:28.971752 4052 raft_consensus.cc:385] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:28.972383 4051 tablet_bootstrap.cc:492] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503: No bootstrap required, opened a new log
I20260207 20:52:28.972936 4051 ts_tablet_manager.cc:1403] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503: Time spent bootstrapping tablet: real 0.045s user 0.015s sys 0.014s
I20260207 20:52:28.972044 4052 raft_consensus.cc:740] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be49ea05ccc47eaa62a9e27d7c52cb3, State: Initialized, Role: FOLLOWER
I20260207 20:52:28.974911 4052 consensus_queue.cc:260] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:28.977517 4050 tablet_bootstrap.cc:492] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05: No bootstrap required, opened a new log
I20260207 20:52:28.977981 4050 ts_tablet_manager.cc:1403] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05: Time spent bootstrapping tablet: real 0.087s user 0.012s sys 0.000s
I20260207 20:52:28.979175 3774 catalog_manager.cc:1269] Loaded cluster ID: 2dd4fd31426146e5969671a0b003a647
I20260207 20:52:28.979496 3774 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e: loading cluster ID for follower catalog manager: success
I20260207 20:52:28.986526 3784 catalog_manager.cc:1269] Loaded cluster ID: 2dd4fd31426146e5969671a0b003a647
I20260207 20:52:28.986861 3784 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13: loading cluster ID for follower catalog manager: success
I20260207 20:52:28.987986 4051 raft_consensus.cc:359] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:28.988511 4051 raft_consensus.cc:385] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:28.988788 4051 raft_consensus.cc:740] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d49446a0e9c84b1280996c6bc4862503, State: Initialized, Role: FOLLOWER
I20260207 20:52:28.990844 4051 consensus_queue.cc:260] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:28.993041 4051 ts_tablet_manager.cc:1434] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503: Time spent starting tablet: real 0.020s user 0.003s sys 0.001s
I20260207 20:52:28.993351 3784 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13: acquiring CA information for follower catalog manager: success
I20260207 20:52:28.994031 4051 tablet_bootstrap.cc:492] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503: Bootstrap starting.
I20260207 20:52:28.980674 4050 raft_consensus.cc:359] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:28.998778 4050 raft_consensus.cc:385] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:28.999092 4050 raft_consensus.cc:740] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d184dc660a34b97b9f020b390bcdb05, State: Initialized, Role: FOLLOWER
I20260207 20:52:29.002030 3774 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e: acquiring CA information for follower catalog manager: success
I20260207 20:52:29.004946 4050 consensus_queue.cc:260] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:28.981662 4052 ts_tablet_manager.cc:1434] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3: Time spent starting tablet: real 0.013s user 0.007s sys 0.002s
I20260207 20:52:29.014317 3774 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:52:29.015226 4054 raft_consensus.cc:493] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:29.017138 4054 raft_consensus.cc:515] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.019552 4054 leader_election.cc:290] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d184dc660a34b97b9f020b390bcdb05 (127.2.223.1:44769), 6be49ea05ccc47eaa62a9e27d7c52cb3 (127.2.223.3:44859)
I20260207 20:52:29.016285 4052 tablet_bootstrap.cc:492] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3: Bootstrap starting.
I20260207 20:52:29.023571 3784 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:52:29.025112 4051 tablet_bootstrap.cc:654] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:29.032665 4050 ts_tablet_manager.cc:1434] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05: Time spent starting tablet: real 0.054s user 0.016s sys 0.005s
I20260207 20:52:29.053699 4050 tablet_bootstrap.cc:492] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05: Bootstrap starting.
I20260207 20:52:29.060014 4050 tablet_bootstrap.cc:654] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:29.063956 4052 tablet_bootstrap.cc:654] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:29.070159 4059 raft_consensus.cc:493] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:29.070717 4059 raft_consensus.cc:515] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.073153 4059 leader_election.cc:290] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d49446a0e9c84b1280996c6bc4862503 (127.2.223.2:46121), 6be49ea05ccc47eaa62a9e27d7c52cb3 (127.2.223.3:44859)
I20260207 20:52:29.083753 3836 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef57cb47c1ef431f96a715f80a87e9b0" candidate_uuid: "d49446a0e9c84b1280996c6bc4862503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d184dc660a34b97b9f020b390bcdb05" is_pre_election: true
I20260207 20:52:29.093026 4050 tablet_bootstrap.cc:492] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05: No bootstrap required, opened a new log
I20260207 20:52:29.093549 4050 ts_tablet_manager.cc:1403] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05: Time spent bootstrapping tablet: real 0.040s user 0.008s sys 0.005s
I20260207 20:52:29.096398 4050 raft_consensus.cc:359] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.097097 4050 raft_consensus.cc:385] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:29.097388 4050 raft_consensus.cc:740] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d184dc660a34b97b9f020b390bcdb05, State: Initialized, Role: FOLLOWER
W20260207 20:52:29.105625 3880 leader_election.cc:343] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d184dc660a34b97b9f020b390bcdb05 (127.2.223.1:44769): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:29.100224 4050 consensus_queue.cc:260] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.110862 4051 tablet_bootstrap.cc:492] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503: No bootstrap required, opened a new log
I20260207 20:52:29.115367 4051 ts_tablet_manager.cc:1403] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503: Time spent bootstrapping tablet: real 0.122s user 0.007s sys 0.018s
I20260207 20:52:29.116427 4054 raft_consensus.cc:493] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:29.116927 4054 raft_consensus.cc:515] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.123930 4054 leader_election.cc:290] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d184dc660a34b97b9f020b390bcdb05 (127.2.223.1:44769), 6be49ea05ccc47eaa62a9e27d7c52cb3 (127.2.223.3:44859)
I20260207 20:52:29.125643 4050 ts_tablet_manager.cc:1434] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05: Time spent starting tablet: real 0.032s user 0.008s sys 0.001s
I20260207 20:52:29.127174 4050 tablet_bootstrap.cc:492] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05: Bootstrap starting.
I20260207 20:52:29.133607 4050 tablet_bootstrap.cc:654] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:29.138724 3836 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bdf91cf66bc4a2595b8092dd99c6def" candidate_uuid: "d49446a0e9c84b1280996c6bc4862503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d184dc660a34b97b9f020b390bcdb05" is_pre_election: true
I20260207 20:52:29.139436 3836 raft_consensus.cc:2468] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d49446a0e9c84b1280996c6bc4862503 in term 0.
I20260207 20:52:29.142294 3880 leader_election.cc:304] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d184dc660a34b97b9f020b390bcdb05, d49446a0e9c84b1280996c6bc4862503; no voters:
I20260207 20:52:29.144436 4004 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef57cb47c1ef431f96a715f80a87e9b0" candidate_uuid: "d49446a0e9c84b1280996c6bc4862503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" is_pre_election: true
I20260207 20:52:29.145038 4054 raft_consensus.cc:2804] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:29.145478 4054 raft_consensus.cc:493] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:29.145833 4054 raft_consensus.cc:3060] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:29.151072 4051 raft_consensus.cc:359] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.151857 4051 raft_consensus.cc:385] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:29.152159 4051 raft_consensus.cc:740] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d49446a0e9c84b1280996c6bc4862503, State: Initialized, Role: FOLLOWER
I20260207 20:52:29.153622 4004 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bdf91cf66bc4a2595b8092dd99c6def" candidate_uuid: "d49446a0e9c84b1280996c6bc4862503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" is_pre_election: true
W20260207 20:52:29.156606 3877 leader_election.cc:343] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6be49ea05ccc47eaa62a9e27d7c52cb3 (127.2.223.3:44859): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:29.157110 3877 leader_election.cc:304] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d49446a0e9c84b1280996c6bc4862503; no voters: 0d184dc660a34b97b9f020b390bcdb05, 6be49ea05ccc47eaa62a9e27d7c52cb3
I20260207 20:52:29.192358 4052 tablet_bootstrap.cc:492] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3: No bootstrap required, opened a new log
I20260207 20:52:29.192845 4052 ts_tablet_manager.cc:1403] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3: Time spent bootstrapping tablet: real 0.177s user 0.015s sys 0.006s
I20260207 20:52:29.203150 4050 tablet_bootstrap.cc:492] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05: No bootstrap required, opened a new log
I20260207 20:52:29.202941 4054 raft_consensus.cc:515] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.203676 4050 ts_tablet_manager.cc:1403] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05: Time spent bootstrapping tablet: real 0.077s user 0.006s sys 0.016s
I20260207 20:52:29.203459 4052 raft_consensus.cc:359] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.204151 4052 raft_consensus.cc:385] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:29.204470 4052 raft_consensus.cc:740] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be49ea05ccc47eaa62a9e27d7c52cb3, State: Initialized, Role: FOLLOWER
I20260207 20:52:29.205094 4054 leader_election.cc:290] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [CANDIDATE]: Term 1 election: Requested vote from peers 0d184dc660a34b97b9f020b390bcdb05 (127.2.223.1:44769), 6be49ea05ccc47eaa62a9e27d7c52cb3 (127.2.223.3:44859)
I20260207 20:52:29.205642 4054 raft_consensus.cc:2749] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:52:29.205420 4052 consensus_queue.cc:260] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.205932 3836 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bdf91cf66bc4a2595b8092dd99c6def" candidate_uuid: "d49446a0e9c84b1280996c6bc4862503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d184dc660a34b97b9f020b390bcdb05"
I20260207 20:52:29.206513 3836 raft_consensus.cc:3060] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:29.207682 4052 ts_tablet_manager.cc:1434] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20260207 20:52:29.208724 4050 raft_consensus.cc:359] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.209398 4050 raft_consensus.cc:385] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:29.209687 4050 raft_consensus.cc:740] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d184dc660a34b97b9f020b390bcdb05, State: Initialized, Role: FOLLOWER
I20260207 20:52:29.210325 4050 consensus_queue.cc:260] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.219652 3914 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bdf91cf66bc4a2595b8092dd99c6def" candidate_uuid: "0d184dc660a34b97b9f020b390bcdb05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d49446a0e9c84b1280996c6bc4862503" is_pre_election: true
I20260207 20:52:29.220625 3914 raft_consensus.cc:2393] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d184dc660a34b97b9f020b390bcdb05 in current term 1: Already voted for candidate d49446a0e9c84b1280996c6bc4862503 in this term.
I20260207 20:52:29.187485 4051 consensus_queue.cc:260] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.216599 4050 ts_tablet_manager.cc:1434] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05: Time spent starting tablet: real 0.013s user 0.008s sys 0.000s
I20260207 20:52:29.233414 4052 tablet_bootstrap.cc:492] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3: Bootstrap starting.
I20260207 20:52:29.220927 3836 raft_consensus.cc:2468] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d49446a0e9c84b1280996c6bc4862503 in term 1.
I20260207 20:52:29.240101 3880 leader_election.cc:304] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d184dc660a34b97b9f020b390bcdb05, d49446a0e9c84b1280996c6bc4862503; no voters:
I20260207 20:52:29.242501 4054 raft_consensus.cc:2804] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:29.248847 4054 raft_consensus.cc:697] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [term 1 LEADER]: Becoming Leader. State: Replica: d49446a0e9c84b1280996c6bc4862503, State: Running, Role: LEADER
I20260207 20:52:29.249725 4054 consensus_queue.cc:237] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.252640 4052 tablet_bootstrap.cc:654] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:29.254441 4051 ts_tablet_manager.cc:1434] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503: Time spent starting tablet: real 0.139s user 0.000s sys 0.007s
W20260207 20:52:29.237329 3877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.223.3:44859, user_credentials={real_user=slave}} blocked reactor thread for 80898.5us
W20260207 20:52:29.257752 3877 leader_election.cc:343] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6be49ea05ccc47eaa62a9e27d7c52cb3 (127.2.223.3:44859): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:29.260959 4004 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bdf91cf66bc4a2595b8092dd99c6def" candidate_uuid: "d49446a0e9c84b1280996c6bc4862503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3"
I20260207 20:52:29.261551 4004 raft_consensus.cc:3060] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:29.270901 4052 tablet_bootstrap.cc:492] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3: No bootstrap required, opened a new log
I20260207 20:52:29.271409 4052 ts_tablet_manager.cc:1403] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.005s
I20260207 20:52:29.275681 4052 raft_consensus.cc:359] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.276363 4052 raft_consensus.cc:385] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:29.276675 4052 raft_consensus.cc:740] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be49ea05ccc47eaa62a9e27d7c52cb3, State: Initialized, Role: FOLLOWER
I20260207 20:52:29.277356 4052 consensus_queue.cc:260] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.279659 4052 ts_tablet_manager.cc:1434] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3: Time spent starting tablet: real 0.008s user 0.004s sys 0.003s
I20260207 20:52:29.285280 4004 raft_consensus.cc:2468] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d49446a0e9c84b1280996c6bc4862503 in term 1.
I20260207 20:52:29.292790 4003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bdf91cf66bc4a2595b8092dd99c6def" candidate_uuid: "0d184dc660a34b97b9f020b390bcdb05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" is_pre_election: true
I20260207 20:52:29.293467 4003 raft_consensus.cc:2393] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d184dc660a34b97b9f020b390bcdb05 in current term 1: Already voted for candidate d49446a0e9c84b1280996c6bc4862503 in this term.
I20260207 20:52:29.294914 3799 leader_election.cc:304] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d184dc660a34b97b9f020b390bcdb05; no voters: 6be49ea05ccc47eaa62a9e27d7c52cb3, d49446a0e9c84b1280996c6bc4862503
I20260207 20:52:29.295755 4059 raft_consensus.cc:2749] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:52:29.288071 3643 catalog_manager.cc:5654] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 reported cstate change: term changed from 0 to 1, leader changed from <none> to d49446a0e9c84b1280996c6bc4862503 (127.2.223.2). New cstate: current_term: 1 leader_uuid: "d49446a0e9c84b1280996c6bc4862503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:29.306524 4058 raft_consensus.cc:493] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:29.307039 4058 raft_consensus.cc:515] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.316262 4058 leader_election.cc:290] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d184dc660a34b97b9f020b390bcdb05 (127.2.223.1:44769), d49446a0e9c84b1280996c6bc4862503 (127.2.223.2:46121)
I20260207 20:52:29.373145 3836 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30d9ec506ce646b4b6facfdb58646879" candidate_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d184dc660a34b97b9f020b390bcdb05" is_pre_election: true
I20260207 20:52:29.373759 3836 raft_consensus.cc:2468] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6be49ea05ccc47eaa62a9e27d7c52cb3 in term 0.
I20260207 20:52:29.373801 3914 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30d9ec506ce646b4b6facfdb58646879" candidate_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d49446a0e9c84b1280996c6bc4862503" is_pre_election: true
I20260207 20:52:29.374511 3914 raft_consensus.cc:2468] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6be49ea05ccc47eaa62a9e27d7c52cb3 in term 0.
I20260207 20:52:29.375267 3970 leader_election.cc:304] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d184dc660a34b97b9f020b390bcdb05, 6be49ea05ccc47eaa62a9e27d7c52cb3; no voters:
I20260207 20:52:29.376077 4058 raft_consensus.cc:2804] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:29.376426 4058 raft_consensus.cc:493] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:29.376757 4058 raft_consensus.cc:3060] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:29.381717 4058 raft_consensus.cc:515] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.384517 4058 leader_election.cc:290] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [CANDIDATE]: Term 1 election: Requested vote from peers 0d184dc660a34b97b9f020b390bcdb05 (127.2.223.1:44769), d49446a0e9c84b1280996c6bc4862503 (127.2.223.2:46121)
I20260207 20:52:29.386637 3914 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30d9ec506ce646b4b6facfdb58646879" candidate_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d49446a0e9c84b1280996c6bc4862503"
I20260207 20:52:29.387247 3914 raft_consensus.cc:3060] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:29.388913 3836 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30d9ec506ce646b4b6facfdb58646879" candidate_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d184dc660a34b97b9f020b390bcdb05"
I20260207 20:52:29.389493 3836 raft_consensus.cc:3060] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:29.393648 3914 raft_consensus.cc:2468] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be49ea05ccc47eaa62a9e27d7c52cb3 in term 1.
I20260207 20:52:29.395131 3966 leader_election.cc:304] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6be49ea05ccc47eaa62a9e27d7c52cb3, d49446a0e9c84b1280996c6bc4862503; no voters:
I20260207 20:52:29.396667 3836 raft_consensus.cc:2468] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6be49ea05ccc47eaa62a9e27d7c52cb3 in term 1.
I20260207 20:52:29.400498 4058 raft_consensus.cc:2804] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:29.402325 4058 raft_consensus.cc:697] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 1 LEADER]: Becoming Leader. State: Replica: 6be49ea05ccc47eaa62a9e27d7c52cb3, State: Running, Role: LEADER
I20260207 20:52:29.403285 4058 consensus_queue.cc:237] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.415637 3644 catalog_manager.cc:5654] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6be49ea05ccc47eaa62a9e27d7c52cb3 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } health_report { overall_health: HEALTHY } } }
I20260207 20:52:29.464493 4059 raft_consensus.cc:493] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:29.465016 4059 raft_consensus.cc:515] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.467842 4059 leader_election.cc:290] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d49446a0e9c84b1280996c6bc4862503 (127.2.223.2:46121), 6be49ea05ccc47eaa62a9e27d7c52cb3 (127.2.223.3:44859)
I20260207 20:52:29.469918 4003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef57cb47c1ef431f96a715f80a87e9b0" candidate_uuid: "0d184dc660a34b97b9f020b390bcdb05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" is_pre_election: true
I20260207 20:52:29.470844 4003 raft_consensus.cc:2468] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d184dc660a34b97b9f020b390bcdb05 in term 0.
I20260207 20:52:29.470009 3914 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef57cb47c1ef431f96a715f80a87e9b0" candidate_uuid: "0d184dc660a34b97b9f020b390bcdb05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d49446a0e9c84b1280996c6bc4862503" is_pre_election: true
I20260207 20:52:29.471939 3799 leader_election.cc:304] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d184dc660a34b97b9f020b390bcdb05, 6be49ea05ccc47eaa62a9e27d7c52cb3; no voters:
I20260207 20:52:29.472172 3914 raft_consensus.cc:2468] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d184dc660a34b97b9f020b390bcdb05 in term 0.
I20260207 20:52:29.473948 4059 raft_consensus.cc:2804] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:29.474313 4059 raft_consensus.cc:493] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:29.474670 4059 raft_consensus.cc:3060] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:29.484184 4059 raft_consensus.cc:515] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.486343 4059 leader_election.cc:290] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [CANDIDATE]: Term 1 election: Requested vote from peers d49446a0e9c84b1280996c6bc4862503 (127.2.223.2:46121), 6be49ea05ccc47eaa62a9e27d7c52cb3 (127.2.223.3:44859)
I20260207 20:52:29.487306 4003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef57cb47c1ef431f96a715f80a87e9b0" candidate_uuid: "0d184dc660a34b97b9f020b390bcdb05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3"
I20260207 20:52:29.487843 4003 raft_consensus.cc:3060] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:29.487668 3914 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef57cb47c1ef431f96a715f80a87e9b0" candidate_uuid: "0d184dc660a34b97b9f020b390bcdb05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d49446a0e9c84b1280996c6bc4862503"
I20260207 20:52:29.488279 3914 raft_consensus.cc:3060] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:29.498409 4003 raft_consensus.cc:2468] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d184dc660a34b97b9f020b390bcdb05 in term 1.
I20260207 20:52:29.501029 3799 leader_election.cc:304] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d184dc660a34b97b9f020b390bcdb05, 6be49ea05ccc47eaa62a9e27d7c52cb3; no voters:
I20260207 20:52:29.502224 3914 raft_consensus.cc:2468] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d184dc660a34b97b9f020b390bcdb05 in term 1.
I20260207 20:52:29.503958 4059 raft_consensus.cc:2804] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:29.506166 4059 raft_consensus.cc:697] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [term 1 LEADER]: Becoming Leader. State: Replica: 0d184dc660a34b97b9f020b390bcdb05, State: Running, Role: LEADER
I20260207 20:52:29.507925 4059 consensus_queue.cc:237] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } }
I20260207 20:52:29.521227 3644 catalog_manager.cc:5654] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d184dc660a34b97b9f020b390bcdb05 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "0d184dc660a34b97b9f020b390bcdb05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:29.751199 4054 consensus_queue.cc:1048] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:29.808852 4099 consensus_queue.cc:1048] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:29.927534 4058 consensus_queue.cc:1048] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:29.950119 4058 consensus_queue.cc:1048] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d184dc660a34b97b9f020b390bcdb05" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 44769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:29.956817 4083 consensus_queue.cc:1048] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d49446a0e9c84b1280996c6bc4862503" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:30.028928 4083 consensus_queue.cc:1048] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be49ea05ccc47eaa62a9e27d7c52cb3" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260207 20:52:30.094982 3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.223.1:44769, user_credentials={real_user=slave}} blocked reactor thread for 95172us
I20260207 20:52:30.464249 3824 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:52:30.500244 3902 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:52:30.518342 3992 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:52:30.867689 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
W20260207 20:52:30.897316 3880 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260207 20:52:30.918946 3880 consensus_peers.cc:597] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 -> Peer 0d184dc660a34b97b9f020b390bcdb05 (127.2.223.1:44769): Couldn't send request to peer 0d184dc660a34b97b9f020b390bcdb05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260207 20:52:30.930497 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:30.931092 2940 tablet_replica.cc:333] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05: stopping tablet replica
I20260207 20:52:30.931604 2940 raft_consensus.cc:2243] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:30.931988 2940 raft_consensus.cc:2272] T 30d9ec506ce646b4b6facfdb58646879 P 0d184dc660a34b97b9f020b390bcdb05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:30.934238 2940 tablet_replica.cc:333] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05: stopping tablet replica
I20260207 20:52:30.934777 2940 raft_consensus.cc:2243] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:30.935567 2940 raft_consensus.cc:2272] T ef57cb47c1ef431f96a715f80a87e9b0 P 0d184dc660a34b97b9f020b390bcdb05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:30.937408 2940 tablet_replica.cc:333] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05: stopping tablet replica
I20260207 20:52:30.937834 2940 raft_consensus.cc:2243] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:30.938194 2940 raft_consensus.cc:2272] T 2bdf91cf66bc4a2595b8092dd99c6def P 0d184dc660a34b97b9f020b390bcdb05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:30.955698 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:52:30.966460 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:52:30.996503 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:30.997046 2940 tablet_replica.cc:333] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503: stopping tablet replica
I20260207 20:52:30.997561 2940 raft_consensus.cc:2243] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:30.997946 2940 raft_consensus.cc:2272] T 30d9ec506ce646b4b6facfdb58646879 P d49446a0e9c84b1280996c6bc4862503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:30.999805 2940 tablet_replica.cc:333] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503: stopping tablet replica
I20260207 20:52:31.000267 2940 raft_consensus.cc:2243] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:31.000900 2940 raft_consensus.cc:2272] T 2bdf91cf66bc4a2595b8092dd99c6def P d49446a0e9c84b1280996c6bc4862503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:31.002411 2940 tablet_replica.cc:333] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503: stopping tablet replica
I20260207 20:52:31.002838 2940 raft_consensus.cc:2243] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:31.003293 2940 raft_consensus.cc:2272] T ef57cb47c1ef431f96a715f80a87e9b0 P d49446a0e9c84b1280996c6bc4862503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:31.026041 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:52:31.036813 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:52:31.058413 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:31.059018 2940 tablet_replica.cc:333] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3: stopping tablet replica
I20260207 20:52:31.059567 2940 raft_consensus.cc:2243] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:31.059924 2940 raft_consensus.cc:2272] T ef57cb47c1ef431f96a715f80a87e9b0 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:31.061759 2940 tablet_replica.cc:333] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3: stopping tablet replica
I20260207 20:52:31.062189 2940 raft_consensus.cc:2243] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:31.062532 2940 raft_consensus.cc:2272] T 2bdf91cf66bc4a2595b8092dd99c6def P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:31.064031 2940 tablet_replica.cc:333] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3: stopping tablet replica
I20260207 20:52:31.064502 2940 raft_consensus.cc:2243] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:31.065436 2940 raft_consensus.cc:2272] T 30d9ec506ce646b4b6facfdb58646879 P 6be49ea05ccc47eaa62a9e27d7c52cb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:31.084568 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:52:31.095113 2940 master.cc:561] Master@127.2.223.62:37577 shutting down...
W20260207 20:52:31.239837 3628 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.223.62:37577, user_credentials={real_user=slave}} blocked reactor thread for 52510.2us
I20260207 20:52:31.240698 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:31.241238 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:31.241632 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 17314d2f65e64fc89b32816c81f85d1e: stopping tablet replica
W20260207 20:52:31.241788 3628 consensus_peers.cc:597] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 -> Peer 17314d2f65e64fc89b32816c81f85d1e (127.2.223.62:37577): Couldn't send request to peer 17314d2f65e64fc89b32816c81f85d1e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260207 20:52:31.259820 2940 master.cc:583] Master@127.2.223.62:37577 shutdown complete.
I20260207 20:52:31.270881 2940 master.cc:561] Master@127.2.223.61:38895 shutting down...
I20260207 20:52:31.284976 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:31.285754 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:31.286058 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 65cbb907122a4cb88ac548d325dfb188: stopping tablet replica
I20260207 20:52:31.305269 2940 master.cc:583] Master@127.2.223.61:38895 shutdown complete.
I20260207 20:52:31.315853 2940 master.cc:561] Master@127.2.223.60:39309 shutting down...
I20260207 20:52:31.329516 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:31.330006 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:31.330296 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 441c5e5a415442f4a7d508b5548dbf13: stopping tablet replica
I20260207 20:52:31.348244 2940 master.cc:583] Master@127.2.223.60:39309 shutdown complete.
[ OK ] RemoteKsckTest.TestCheckUnusualFlags (3752 ms)
[ RUN ] RemoteKsckTest.TestTabletServerMismatchedUUID
I20260207 20:52:31.375650 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:43401,127.2.223.61:37099,127.2.223.60:44393
I20260207 20:52:31.376900 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:31.381656 4145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:31.382210 4144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:31.382874 4147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:31.383489 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:31.384101 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:31.384285 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:31.384398 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497551384388 us; error 0 us; skew 500 ppm
I20260207 20:52:31.384822 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:31.386924 2940 webserver.cc:492] Webserver started at http://127.2.223.62:37573/ using document root <none> and password file <none>
I20260207 20:52:31.387338 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:31.387501 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:31.387702 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:31.388626 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "948f2c0874e04024a87ef1834a5de985"
format_stamp: "Formatted at 2026-02-07 20:52:31 on dist-test-slave-kqw4"
I20260207 20:52:31.392521 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260207 20:52:31.395435 4152 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:31.396082 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:52:31.396317 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "948f2c0874e04024a87ef1834a5de985"
format_stamp: "Formatted at 2026-02-07 20:52:31 on dist-test-slave-kqw4"
I20260207 20:52:31.396553 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:31.405866 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:31.406754 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:31.438524 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:43401
I20260207 20:52:31.438642 4203 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:43401 every 8 connection(s)
I20260207 20:52:31.442070 4204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:31.442179 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:31.447050 4206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:31.447932 4207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:31.448834 4204 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:31.449611 4209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:31.450313 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:31.451445 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:31.451719 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:31.451920 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497551451904 us; error 0 us; skew 500 ppm
I20260207 20:52:31.452461 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:31.455111 2940 webserver.cc:492] Webserver started at http://127.2.223.61:46417/ using document root <none> and password file <none>
I20260207 20:52:31.455562 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:31.455734 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:31.455961 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:31.457243 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "0bb4751901154db5bcf6a013a584f52c"
format_stamp: "Formatted at 2026-02-07 20:52:31 on dist-test-slave-kqw4"
I20260207 20:52:31.461630 4204 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:31.462260 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.005s
I20260207 20:52:31.465939 4217 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:31.466770 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
W20260207 20:52:31.466977 4204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:37099: Network error: Client connection negotiation failed: client connection to 127.2.223.61:37099: connect: Connection refused (error 111)
I20260207 20:52:31.467059 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "0bb4751901154db5bcf6a013a584f52c"
format_stamp: "Formatted at 2026-02-07 20:52:31 on dist-test-slave-kqw4"
I20260207 20:52:31.467468 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:31.480006 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:31.480938 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:31.514127 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:37099
I20260207 20:52:31.514192 4268 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:37099 every 8 connection(s)
I20260207 20:52:31.515501 4204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } attempt: 1
I20260207 20:52:31.518290 4269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:31.519789 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:31.524948 4272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:31.526410 4273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:31.528826 4269 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:31.531419 4204 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:31.532115 4275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:31.536016 2940 server_base.cc:1060] running on GCE node
W20260207 20:52:31.536077 4204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:44393: Network error: Client connection negotiation failed: client connection to 127.2.223.60:44393: connect: Connection refused (error 111)
I20260207 20:52:31.536958 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:31.537161 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:31.537315 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497551537298 us; error 0 us; skew 500 ppm
I20260207 20:52:31.538028 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:31.540621 2940 webserver.cc:492] Webserver started at http://127.2.223.60:34251/ using document root <none> and password file <none>
I20260207 20:52:31.541059 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:31.541276 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:31.541072 4269 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:31.541652 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:31.542752 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "3d7bc11f214f46568db68f8d541b57e4"
format_stamp: "Formatted at 2026-02-07 20:52:31 on dist-test-slave-kqw4"
I20260207 20:52:31.547919 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260207 20:52:31.551381 4269 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:31.551645 4281 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:31.552598 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20260207 20:52:31.552915 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "3d7bc11f214f46568db68f8d541b57e4"
format_stamp: "Formatted at 2026-02-07 20:52:31 on dist-test-slave-kqw4"
I20260207 20:52:31.553236 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:52:31.556514 4269 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:44393: Network error: Client connection negotiation failed: client connection to 127.2.223.60:44393: connect: Connection refused (error 111)
I20260207 20:52:31.562109 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:31.563099 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:31.567631 4204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } attempt: 1
W20260207 20:52:31.571723 4204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:44393: Network error: Client connection negotiation failed: client connection to 127.2.223.60:44393: connect: Connection refused (error 111)
I20260207 20:52:31.595006 4269 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } attempt: 1
I20260207 20:52:31.597312 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:44393
I20260207 20:52:31.597404 4333 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:44393 every 8 connection(s)
I20260207 20:52:31.601478 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:52:31.602360 4335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:31.608239 4335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:31.613050 4269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c: Bootstrap starting.
I20260207 20:52:31.618180 4269 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:31.618692 4335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:31.623191 4269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c: No bootstrap required, opened a new log
I20260207 20:52:31.625636 4269 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } }
I20260207 20:52:31.626181 4269 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:31.626468 4269 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bb4751901154db5bcf6a013a584f52c, State: Initialized, Role: FOLLOWER
I20260207 20:52:31.627144 4269 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } }
I20260207 20:52:31.628151 4335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:31.629012 4339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } } }
I20260207 20:52:31.629639 4339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:31.630477 4269 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:31.644176 4335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4: Bootstrap starting.
W20260207 20:52:31.644982 4350 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:31.645291 4350 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:52:31.645267 4204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } attempt: 2
I20260207 20:52:31.648654 4335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:31.652748 4335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4: No bootstrap required, opened a new log
I20260207 20:52:31.654915 4335 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } }
I20260207 20:52:31.655440 4335 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:31.655642 4335 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7bc11f214f46568db68f8d541b57e4, State: Initialized, Role: FOLLOWER
I20260207 20:52:31.656107 4335 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } }
I20260207 20:52:31.657735 4352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } } }
I20260207 20:52:31.658408 4352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:31.658911 4335 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:31.659920 4204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985: Bootstrap starting.
I20260207 20:52:31.664958 4204 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:31.669826 4204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985: No bootstrap required, opened a new log
I20260207 20:52:31.672365 4204 raft_consensus.cc:359] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } }
I20260207 20:52:31.673038 4204 raft_consensus.cc:385] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:31.673317 4204 raft_consensus.cc:740] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 948f2c0874e04024a87ef1834a5de985, State: Initialized, Role: FOLLOWER
W20260207 20:52:31.673836 4364 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:31.674157 4364 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:52:31.673969 4204 consensus_queue.cc:260] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } }
I20260207 20:52:31.675649 4365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } } }
I20260207 20:52:31.676151 4365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:31.676797 4204 sys_catalog.cc:565] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:31.685945 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:52:31.686236 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:52:31.687918 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:31.689855 4376 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:31.690193 4376 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:52:31.694362 4377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:31.694792 4378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:31.696434 4380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:31.697135 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:31.697842 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:31.698017 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:31.698216 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497551698197 us; error 0 us; skew 500 ppm
I20260207 20:52:31.698734 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:31.700831 2940 webserver.cc:492] Webserver started at http://127.2.223.1:35219/ using document root <none> and password file <none>
I20260207 20:52:31.701292 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:31.701448 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:31.701646 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:31.702630 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "7470d6630dcc4f07851e63c7bb3e0b71"
format_stamp: "Formatted at 2026-02-07 20:52:31 on dist-test-slave-kqw4"
I20260207 20:52:31.706511 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260207 20:52:31.709499 4385 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:31.710243 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260207 20:52:31.710508 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "7470d6630dcc4f07851e63c7bb3e0b71"
format_stamp: "Formatted at 2026-02-07 20:52:31 on dist-test-slave-kqw4"
I20260207 20:52:31.710801 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:31.726433 4365 raft_consensus.cc:493] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:31.727144 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:31.726904 4365 raft_consensus.cc:515] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } }
I20260207 20:52:31.728207 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:31.728765 4365 leader_election.cc:290] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bb4751901154db5bcf6a013a584f52c (127.2.223.61:37099), 3d7bc11f214f46568db68f8d541b57e4 (127.2.223.60:44393)
I20260207 20:52:31.729655 4244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "948f2c0874e04024a87ef1834a5de985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bb4751901154db5bcf6a013a584f52c" is_pre_election: true
I20260207 20:52:31.729974 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:31.729851 4309 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "948f2c0874e04024a87ef1834a5de985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bc11f214f46568db68f8d541b57e4" is_pre_election: true
I20260207 20:52:31.730443 4244 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 948f2c0874e04024a87ef1834a5de985 in term 0.
I20260207 20:52:31.730545 4309 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 948f2c0874e04024a87ef1834a5de985 in term 0.
I20260207 20:52:31.731456 4155 leader_election.cc:304] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bb4751901154db5bcf6a013a584f52c, 948f2c0874e04024a87ef1834a5de985; no voters:
I20260207 20:52:31.732105 4365 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:31.732420 4365 raft_consensus.cc:493] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:31.732676 4365 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:31.733114 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:31.733331 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:31.733565 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:31.733759 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:31.737012 4365 raft_consensus.cc:515] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } }
I20260207 20:52:31.738497 4365 leader_election.cc:290] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [CANDIDATE]: Term 1 election: Requested vote from peers 0bb4751901154db5bcf6a013a584f52c (127.2.223.61:37099), 3d7bc11f214f46568db68f8d541b57e4 (127.2.223.60:44393)
I20260207 20:52:31.739176 4244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "948f2c0874e04024a87ef1834a5de985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bb4751901154db5bcf6a013a584f52c"
I20260207 20:52:31.739571 4309 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "948f2c0874e04024a87ef1834a5de985" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bc11f214f46568db68f8d541b57e4"
I20260207 20:52:31.740198 4309 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:31.739678 4244 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:31.745890 4309 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 948f2c0874e04024a87ef1834a5de985 in term 1.
I20260207 20:52:31.746881 4156 leader_election.cc:304] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d7bc11f214f46568db68f8d541b57e4, 948f2c0874e04024a87ef1834a5de985; no voters:
I20260207 20:52:31.747521 4244 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 948f2c0874e04024a87ef1834a5de985 in term 1.
I20260207 20:52:31.747707 4365 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:31.748991 4365 raft_consensus.cc:697] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [term 1 LEADER]: Becoming Leader. State: Replica: 948f2c0874e04024a87ef1834a5de985, State: Running, Role: LEADER
I20260207 20:52:31.749888 4365 consensus_queue.cc:237] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } }
I20260207 20:52:31.755576 4402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 948f2c0874e04024a87ef1834a5de985. Latest consensus state: current_term: 1 leader_uuid: "948f2c0874e04024a87ef1834a5de985" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } } }
I20260207 20:52:31.756383 4402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:31.757949 4416 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:52:31.762653 4416 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:52:31.771119 4309 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [term 1 FOLLOWER]: Refusing update from remote peer 948f2c0874e04024a87ef1834a5de985: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:31.772128 4244 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [term 1 FOLLOWER]: Refusing update from remote peer 948f2c0874e04024a87ef1834a5de985: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:31.772557 4402 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:31.773682 4365 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:31.786484 4352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 948f2c0874e04024a87ef1834a5de985. Latest consensus state: current_term: 1 leader_uuid: "948f2c0874e04024a87ef1834a5de985" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } } }
I20260207 20:52:31.787065 4352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:31.793183 4402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "948f2c0874e04024a87ef1834a5de985" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } } }
I20260207 20:52:31.793903 4402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:31.795158 4416 catalog_manager.cc:1357] Generated new cluster ID: a45cf8cbd9ce4995ad1fc0fcf49048a7
I20260207 20:52:31.795501 4416 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:52:31.808758 4339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 948f2c0874e04024a87ef1834a5de985. Latest consensus state: current_term: 1 leader_uuid: "948f2c0874e04024a87ef1834a5de985" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } } }
I20260207 20:52:31.809497 4339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:31.813442 4365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "948f2c0874e04024a87ef1834a5de985" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } } }
I20260207 20:52:31.814116 4365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:31.817689 4352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "948f2c0874e04024a87ef1834a5de985" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } } }
I20260207 20:52:31.818547 4352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:31.822381 4339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "948f2c0874e04024a87ef1834a5de985" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948f2c0874e04024a87ef1834a5de985" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43401 } } peers { permanent_uuid: "0bb4751901154db5bcf6a013a584f52c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 37099 } } peers { permanent_uuid: "3d7bc11f214f46568db68f8d541b57e4" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 44393 } } }
I20260207 20:52:31.823061 4339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:31.825858 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:37447
I20260207 20:52:31.825979 4457 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:37447 every 8 connection(s)
I20260207 20:52:31.868135 4416 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:52:31.870199 4416 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:52:31.871814 4459 heartbeater.cc:344] Connected to a master server at 127.2.223.60:44393
I20260207 20:52:31.872303 4459 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:31.873329 4459 heartbeater.cc:507] Master 127.2.223.60:44393 requested a full tablet report, sending...
I20260207 20:52:31.876485 4299 ts_manager.cc:194] Registered new tserver with Master: 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1:37447)
I20260207 20:52:31.883986 4460 heartbeater.cc:344] Connected to a master server at 127.2.223.61:37099
I20260207 20:52:31.884569 4460 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:31.885808 4460 heartbeater.cc:507] Master 127.2.223.61:37099 requested a full tablet report, sending...
I20260207 20:52:31.888984 4234 ts_manager.cc:194] Registered new tserver with Master: 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1:37447)
I20260207 20:52:31.908708 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:31.910622 4416 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985: Generated new TSK 0
I20260207 20:52:31.911263 4416 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20260207 20:52:31.916320 4466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:31.916379 4461 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43401
I20260207 20:52:31.917028 4461 heartbeater.cc:461] Registering TS with master...
W20260207 20:52:31.917706 4467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:31.917789 4461 heartbeater.cc:507] Master 127.2.223.62:43401 requested a full tablet report, sending...
I20260207 20:52:31.920060 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:31.920334 4169 ts_manager.cc:194] Registered new tserver with Master: 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1:37447)
W20260207 20:52:31.921233 4469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:31.922083 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:31.922304 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:31.922363 4169 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58122
I20260207 20:52:31.922484 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497551922468 us; error 0 us; skew 500 ppm
I20260207 20:52:31.923182 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:31.927049 2940 webserver.cc:492] Webserver started at http://127.2.223.2:34515/ using document root <none> and password file <none>
I20260207 20:52:31.927523 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:31.927700 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:31.927925 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:31.928859 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "36b689c7e3c246b8b16bed3910c700f1"
format_stamp: "Formatted at 2026-02-07 20:52:31 on dist-test-slave-kqw4"
I20260207 20:52:31.932894 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260207 20:52:31.935374 4461 heartbeater.cc:499] Master 127.2.223.62:43401 was elected leader, sending a full tablet report...
I20260207 20:52:31.935886 4474 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:31.936725 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:52:31.937067 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "36b689c7e3c246b8b16bed3910c700f1"
format_stamp: "Formatted at 2026-02-07 20:52:31 on dist-test-slave-kqw4"
I20260207 20:52:31.937445 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:31.955219 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:31.956151 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:31.957419 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:31.959482 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:31.959658 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:31.959877 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:31.960069 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:32.002486 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:39059
I20260207 20:52:32.002624 4536 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:39059 every 8 connection(s)
I20260207 20:52:32.040373 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:32.044709 4538 heartbeater.cc:344] Connected to a master server at 127.2.223.61:37099
I20260207 20:52:32.045145 4538 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:32.045468 4537 heartbeater.cc:344] Connected to a master server at 127.2.223.60:44393
I20260207 20:52:32.045861 4537 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:32.046025 4538 heartbeater.cc:507] Master 127.2.223.61:37099 requested a full tablet report, sending...
I20260207 20:52:32.046789 4537 heartbeater.cc:507] Master 127.2.223.60:44393 requested a full tablet report, sending...
I20260207 20:52:32.052915 4299 ts_manager.cc:194] Registered new tserver with Master: 36b689c7e3c246b8b16bed3910c700f1 (127.2.223.2:39059)
I20260207 20:52:32.054898 4234 ts_manager.cc:194] Registered new tserver with Master: 36b689c7e3c246b8b16bed3910c700f1 (127.2.223.2:39059)
I20260207 20:52:32.055215 4539 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43401
I20260207 20:52:32.055685 4539 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:32.056653 4539 heartbeater.cc:507] Master 127.2.223.62:43401 requested a full tablet report, sending...
W20260207 20:52:32.058151 4544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:32.058974 4169 ts_manager.cc:194] Registered new tserver with Master: 36b689c7e3c246b8b16bed3910c700f1 (127.2.223.2:39059)
W20260207 20:52:32.059140 4545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:32.060920 4169 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58126
I20260207 20:52:32.061440 2940 server_base.cc:1060] running on GCE node
W20260207 20:52:32.062384 4548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:32.063431 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:32.063740 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:32.063915 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497552063897 us; error 0 us; skew 500 ppm
I20260207 20:52:32.064591 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:32.068056 2940 webserver.cc:492] Webserver started at http://127.2.223.3:46157/ using document root <none> and password file <none>
I20260207 20:52:32.068730 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:32.068971 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:32.069274 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:32.070403 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "4cb695c5b2f8428ea2f436699ff03d00"
format_stamp: "Formatted at 2026-02-07 20:52:32 on dist-test-slave-kqw4"
I20260207 20:52:32.073632 4539 heartbeater.cc:499] Master 127.2.223.62:43401 was elected leader, sending a full tablet report...
I20260207 20:52:32.074759 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260207 20:52:32.079413 4552 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:32.080468 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260207 20:52:32.080811 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "4cb695c5b2f8428ea2f436699ff03d00"
format_stamp: "Formatted at 2026-02-07 20:52:32 on dist-test-slave-kqw4"
I20260207 20:52:32.081136 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:32.101866 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:32.103282 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:32.105533 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:32.108587 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:32.108796 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:32.108983 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:32.109108 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:32.168066 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:40549
I20260207 20:52:32.168154 4614 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:40549 every 8 connection(s)
I20260207 20:52:32.195375 4615 heartbeater.cc:344] Connected to a master server at 127.2.223.60:44393
I20260207 20:52:32.195819 4615 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:32.196712 4615 heartbeater.cc:507] Master 127.2.223.60:44393 requested a full tablet report, sending...
I20260207 20:52:32.198879 4616 heartbeater.cc:344] Connected to a master server at 127.2.223.61:37099
I20260207 20:52:32.199254 4616 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:32.199849 4298 ts_manager.cc:194] Registered new tserver with Master: 4cb695c5b2f8428ea2f436699ff03d00 (127.2.223.3:40549)
I20260207 20:52:32.200003 4616 heartbeater.cc:507] Master 127.2.223.61:37099 requested a full tablet report, sending...
I20260207 20:52:32.205674 4234 ts_manager.cc:194] Registered new tserver with Master: 4cb695c5b2f8428ea2f436699ff03d00 (127.2.223.3:40549)
I20260207 20:52:32.212734 4617 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43401
I20260207 20:52:32.213115 4617 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:32.213797 4617 heartbeater.cc:507] Master 127.2.223.62:43401 requested a full tablet report, sending...
I20260207 20:52:32.216337 4168 ts_manager.cc:194] Registered new tserver with Master: 4cb695c5b2f8428ea2f436699ff03d00 (127.2.223.3:40549)
I20260207 20:52:32.216967 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.024592037s
I20260207 20:52:32.217941 4168 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58136
I20260207 20:52:32.230611 4617 heartbeater.cc:499] Master 127.2.223.62:43401 was elected leader, sending a full tablet report...
I20260207 20:52:32.261850 4168 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58146:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:52:32.264285 4168 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:52:32.389897 4580 tablet_service.cc:1505] Processing CreateTablet for tablet 7c877ca0cd734f2986ce6a9695cd34a0 (DEFAULT_TABLE table=ksck-test-table [id=249c0464393d4a6f9dc7eeedeb0cc7f4]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:32.391268 4580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c877ca0cd734f2986ce6a9695cd34a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:32.397342 4415 tablet_service.cc:1505] Processing CreateTablet for tablet 7c877ca0cd734f2986ce6a9695cd34a0 (DEFAULT_TABLE table=ksck-test-table [id=249c0464393d4a6f9dc7eeedeb0cc7f4]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:32.397882 4413 tablet_service.cc:1505] Processing CreateTablet for tablet 22e38575ba65428b92d3c19efe1d5295 (DEFAULT_TABLE table=ksck-test-table [id=249c0464393d4a6f9dc7eeedeb0cc7f4]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:32.398810 4414 tablet_service.cc:1505] Processing CreateTablet for tablet a1919962fdef4d928e3cd8c1509c95db (DEFAULT_TABLE table=ksck-test-table [id=249c0464393d4a6f9dc7eeedeb0cc7f4]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:32.399296 4413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e38575ba65428b92d3c19efe1d5295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:32.406490 4414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1919962fdef4d928e3cd8c1509c95db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:32.408126 4579 tablet_service.cc:1505] Processing CreateTablet for tablet a1919962fdef4d928e3cd8c1509c95db (DEFAULT_TABLE table=ksck-test-table [id=249c0464393d4a6f9dc7eeedeb0cc7f4]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:32.409399 4579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1919962fdef4d928e3cd8c1509c95db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:32.411711 4415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c877ca0cd734f2986ce6a9695cd34a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:32.411499 4578 tablet_service.cc:1505] Processing CreateTablet for tablet 22e38575ba65428b92d3c19efe1d5295 (DEFAULT_TABLE table=ksck-test-table [id=249c0464393d4a6f9dc7eeedeb0cc7f4]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:32.412837 4578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e38575ba65428b92d3c19efe1d5295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:32.419543 4502 tablet_service.cc:1505] Processing CreateTablet for tablet 7c877ca0cd734f2986ce6a9695cd34a0 (DEFAULT_TABLE table=ksck-test-table [id=249c0464393d4a6f9dc7eeedeb0cc7f4]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:32.420747 4502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c877ca0cd734f2986ce6a9695cd34a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:32.437243 4500 tablet_service.cc:1505] Processing CreateTablet for tablet 22e38575ba65428b92d3c19efe1d5295 (DEFAULT_TABLE table=ksck-test-table [id=249c0464393d4a6f9dc7eeedeb0cc7f4]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:32.438333 4500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e38575ba65428b92d3c19efe1d5295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:32.437130 4501 tablet_service.cc:1505] Processing CreateTablet for tablet a1919962fdef4d928e3cd8c1509c95db (DEFAULT_TABLE table=ksck-test-table [id=249c0464393d4a6f9dc7eeedeb0cc7f4]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:32.447098 4501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1919962fdef4d928e3cd8c1509c95db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:32.486284 4636 tablet_bootstrap.cc:492] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71: Bootstrap starting.
I20260207 20:52:32.491528 4637 tablet_bootstrap.cc:492] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00: Bootstrap starting.
I20260207 20:52:32.501734 4638 tablet_bootstrap.cc:492] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1: Bootstrap starting.
I20260207 20:52:32.506026 4636 tablet_bootstrap.cc:654] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:32.511039 4637 tablet_bootstrap.cc:654] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:32.516610 4638 tablet_bootstrap.cc:654] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:32.529441 4636 tablet_bootstrap.cc:492] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71: No bootstrap required, opened a new log
I20260207 20:52:32.529942 4636 ts_tablet_manager.cc:1403] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71: Time spent bootstrapping tablet: real 0.044s user 0.010s sys 0.000s
I20260207 20:52:32.532436 4637 tablet_bootstrap.cc:492] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00: No bootstrap required, opened a new log
I20260207 20:52:32.532908 4637 ts_tablet_manager.cc:1403] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00: Time spent bootstrapping tablet: real 0.042s user 0.010s sys 0.004s
I20260207 20:52:32.533821 4638 tablet_bootstrap.cc:492] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1: No bootstrap required, opened a new log
I20260207 20:52:32.534338 4638 ts_tablet_manager.cc:1403] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1: Time spent bootstrapping tablet: real 0.033s user 0.008s sys 0.004s
I20260207 20:52:32.536757 4638 raft_consensus.cc:359] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.537664 4638 raft_consensus.cc:385] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:32.538005 4638 raft_consensus.cc:740] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b689c7e3c246b8b16bed3910c700f1, State: Initialized, Role: FOLLOWER
I20260207 20:52:32.539021 4638 consensus_queue.cc:260] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.540287 4636 raft_consensus.cc:359] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.542410 4636 raft_consensus.cc:385] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:32.542734 4636 raft_consensus.cc:740] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7470d6630dcc4f07851e63c7bb3e0b71, State: Initialized, Role: FOLLOWER
I20260207 20:52:32.543500 4636 consensus_queue.cc:260] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.539052 4637 raft_consensus.cc:359] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } }
I20260207 20:52:32.550612 4637 raft_consensus.cc:385] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:32.551013 4637 raft_consensus.cc:740] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cb695c5b2f8428ea2f436699ff03d00, State: Initialized, Role: FOLLOWER
I20260207 20:52:32.557938 4638 ts_tablet_manager.cc:1434] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1: Time spent starting tablet: real 0.023s user 0.004s sys 0.008s
I20260207 20:52:32.558279 4636 ts_tablet_manager.cc:1434] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71: Time spent starting tablet: real 0.028s user 0.010s sys 0.000s
I20260207 20:52:32.559108 4638 tablet_bootstrap.cc:492] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1: Bootstrap starting.
I20260207 20:52:32.556304 4637 consensus_queue.cc:260] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } }
I20260207 20:52:32.574383 4638 tablet_bootstrap.cc:654] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:32.578764 4636 tablet_bootstrap.cc:492] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71: Bootstrap starting.
I20260207 20:52:32.583318 4637 ts_tablet_manager.cc:1434] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00: Time spent starting tablet: real 0.050s user 0.009s sys 0.000s
I20260207 20:52:32.584467 4637 tablet_bootstrap.cc:492] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00: Bootstrap starting.
I20260207 20:52:32.598944 4636 tablet_bootstrap.cc:654] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:32.600149 4638 tablet_bootstrap.cc:492] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1: No bootstrap required, opened a new log
I20260207 20:52:32.600679 4638 ts_tablet_manager.cc:1403] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.006s
I20260207 20:52:32.603397 4638 raft_consensus.cc:359] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } }
I20260207 20:52:32.604233 4638 raft_consensus.cc:385] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:32.604550 4638 raft_consensus.cc:740] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b689c7e3c246b8b16bed3910c700f1, State: Initialized, Role: FOLLOWER
I20260207 20:52:32.605497 4637 tablet_bootstrap.cc:654] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:32.605195 4638 consensus_queue.cc:260] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } }
I20260207 20:52:32.613098 4638 ts_tablet_manager.cc:1434] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1: Time spent starting tablet: real 0.008s user 0.007s sys 0.001s
I20260207 20:52:32.614208 4638 tablet_bootstrap.cc:492] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1: Bootstrap starting.
I20260207 20:52:32.619827 4637 tablet_bootstrap.cc:492] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00: No bootstrap required, opened a new log
I20260207 20:52:32.620345 4637 ts_tablet_manager.cc:1403] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00: Time spent bootstrapping tablet: real 0.036s user 0.009s sys 0.006s
I20260207 20:52:32.623029 4637 raft_consensus.cc:359] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.623714 4637 raft_consensus.cc:385] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:32.624020 4637 raft_consensus.cc:740] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cb695c5b2f8428ea2f436699ff03d00, State: Initialized, Role: FOLLOWER
I20260207 20:52:32.603402 4636 tablet_bootstrap.cc:492] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71: No bootstrap required, opened a new log
I20260207 20:52:32.624730 4636 ts_tablet_manager.cc:1403] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71: Time spent bootstrapping tablet: real 0.048s user 0.010s sys 0.000s
I20260207 20:52:32.624871 4637 consensus_queue.cc:260] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.628046 4638 tablet_bootstrap.cc:654] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:32.631696 4637 ts_tablet_manager.cc:1434] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20260207 20:52:32.638499 4637 tablet_bootstrap.cc:492] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00: Bootstrap starting.
I20260207 20:52:32.644239 4637 tablet_bootstrap.cc:654] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:32.646235 4636 raft_consensus.cc:359] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.646966 4636 raft_consensus.cc:385] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:32.647254 4636 raft_consensus.cc:740] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7470d6630dcc4f07851e63c7bb3e0b71, State: Initialized, Role: FOLLOWER
I20260207 20:52:32.648001 4636 consensus_queue.cc:260] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.650153 4636 ts_tablet_manager.cc:1434] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71: Time spent starting tablet: real 0.025s user 0.004s sys 0.000s
I20260207 20:52:32.650633 4350 catalog_manager.cc:1269] Loaded cluster ID: a45cf8cbd9ce4995ad1fc0fcf49048a7
I20260207 20:52:32.650888 4350 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c: loading cluster ID for follower catalog manager: success
I20260207 20:52:32.651163 4636 tablet_bootstrap.cc:492] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71: Bootstrap starting.
I20260207 20:52:32.660167 4350 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c: acquiring CA information for follower catalog manager: success
I20260207 20:52:32.667564 4350 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:52:32.670027 4636 tablet_bootstrap.cc:654] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:32.674966 4637 tablet_bootstrap.cc:492] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00: No bootstrap required, opened a new log
I20260207 20:52:32.675509 4637 ts_tablet_manager.cc:1403] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00: Time spent bootstrapping tablet: real 0.037s user 0.010s sys 0.003s
I20260207 20:52:32.678143 4637 raft_consensus.cc:359] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.681160 4637 raft_consensus.cc:385] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:32.681484 4637 raft_consensus.cc:740] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cb695c5b2f8428ea2f436699ff03d00, State: Initialized, Role: FOLLOWER
I20260207 20:52:32.682399 4637 consensus_queue.cc:260] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.684495 4364 catalog_manager.cc:1269] Loaded cluster ID: a45cf8cbd9ce4995ad1fc0fcf49048a7
I20260207 20:52:32.684774 4364 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4: loading cluster ID for follower catalog manager: success
I20260207 20:52:32.687783 4642 raft_consensus.cc:493] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:32.688118 4637 ts_tablet_manager.cc:1434] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260207 20:52:32.688248 4642 raft_consensus.cc:515] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.690361 4642 leader_election.cc:290] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1:37447), 4cb695c5b2f8428ea2f436699ff03d00 (127.2.223.3:40549)
I20260207 20:52:32.695703 4638 tablet_bootstrap.cc:492] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1: No bootstrap required, opened a new log
I20260207 20:52:32.696193 4638 ts_tablet_manager.cc:1403] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1: Time spent bootstrapping tablet: real 0.082s user 0.017s sys 0.007s
I20260207 20:52:32.705390 4364 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4: acquiring CA information for follower catalog manager: success
I20260207 20:52:32.710371 4364 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:52:32.710922 4636 tablet_bootstrap.cc:492] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71: No bootstrap required, opened a new log
I20260207 20:52:32.712769 4636 ts_tablet_manager.cc:1403] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71: Time spent bootstrapping tablet: real 0.062s user 0.013s sys 0.004s
I20260207 20:52:32.715557 4638 raft_consensus.cc:359] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.715793 4636 raft_consensus.cc:359] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } }
I20260207 20:52:32.716272 4638 raft_consensus.cc:385] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:32.716605 4638 raft_consensus.cc:740] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b689c7e3c246b8b16bed3910c700f1, State: Initialized, Role: FOLLOWER
I20260207 20:52:32.717451 4638 consensus_queue.cc:260] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.719692 4638 ts_tablet_manager.cc:1434] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1: Time spent starting tablet: real 0.023s user 0.003s sys 0.003s
I20260207 20:52:32.716521 4636 raft_consensus.cc:385] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:32.729887 4636 raft_consensus.cc:740] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7470d6630dcc4f07851e63c7bb3e0b71, State: Initialized, Role: FOLLOWER
I20260207 20:52:32.730360 4426 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22e38575ba65428b92d3c19efe1d5295" candidate_uuid: "36b689c7e3c246b8b16bed3910c700f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" is_pre_election: true
I20260207 20:52:32.730710 4636 consensus_queue.cc:260] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } }
I20260207 20:52:32.731086 4426 raft_consensus.cc:2468] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b689c7e3c246b8b16bed3910c700f1 in term 0.
I20260207 20:52:32.732602 4476 leader_election.cc:304] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b689c7e3c246b8b16bed3910c700f1, 7470d6630dcc4f07851e63c7bb3e0b71; no voters:
I20260207 20:52:32.733426 4642 raft_consensus.cc:2804] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:32.733752 4642 raft_consensus.cc:493] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:32.734066 4642 raft_consensus.cc:3060] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:32.738917 4644 raft_consensus.cc:493] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:32.739387 4644 raft_consensus.cc:515] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.740803 4636 ts_tablet_manager.cc:1434] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71: Time spent starting tablet: real 0.027s user 0.002s sys 0.003s
I20260207 20:52:32.741739 4644 leader_election.cc:290] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1:37447), 36b689c7e3c246b8b16bed3910c700f1 (127.2.223.2:39059)
I20260207 20:52:32.746001 4642 raft_consensus.cc:515] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.748574 4426 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22e38575ba65428b92d3c19efe1d5295" candidate_uuid: "36b689c7e3c246b8b16bed3910c700f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7470d6630dcc4f07851e63c7bb3e0b71"
I20260207 20:52:32.749112 4426 raft_consensus.cc:3060] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:32.767441 4426 raft_consensus.cc:2468] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b689c7e3c246b8b16bed3910c700f1 in term 1.
I20260207 20:52:32.768651 4590 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22e38575ba65428b92d3c19efe1d5295" candidate_uuid: "36b689c7e3c246b8b16bed3910c700f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cb695c5b2f8428ea2f436699ff03d00" is_pre_election: true
I20260207 20:52:32.769423 4589 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22e38575ba65428b92d3c19efe1d5295" candidate_uuid: "36b689c7e3c246b8b16bed3910c700f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cb695c5b2f8428ea2f436699ff03d00"
I20260207 20:52:32.770413 4590 raft_consensus.cc:2468] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b689c7e3c246b8b16bed3910c700f1 in term 0.
I20260207 20:52:32.769829 4642 leader_election.cc:290] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [CANDIDATE]: Term 1 election: Requested vote from peers 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1:37447), 4cb695c5b2f8428ea2f436699ff03d00 (127.2.223.3:40549)
I20260207 20:52:32.773167 4476 leader_election.cc:304] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b689c7e3c246b8b16bed3910c700f1, 7470d6630dcc4f07851e63c7bb3e0b71; no voters: 4cb695c5b2f8428ea2f436699ff03d00
I20260207 20:52:32.774655 4642 raft_consensus.cc:2804] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:32.774977 4512 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22e38575ba65428b92d3c19efe1d5295" candidate_uuid: "4cb695c5b2f8428ea2f436699ff03d00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b689c7e3c246b8b16bed3910c700f1" is_pre_election: true
I20260207 20:52:32.786645 4426 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22e38575ba65428b92d3c19efe1d5295" candidate_uuid: "4cb695c5b2f8428ea2f436699ff03d00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" is_pre_election: true
I20260207 20:52:32.787328 4426 raft_consensus.cc:2393] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cb695c5b2f8428ea2f436699ff03d00 in current term 1: Already voted for candidate 36b689c7e3c246b8b16bed3910c700f1 in this term.
I20260207 20:52:32.786160 4642 raft_consensus.cc:697] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 1 LEADER]: Becoming Leader. State: Replica: 36b689c7e3c246b8b16bed3910c700f1, State: Running, Role: LEADER
I20260207 20:52:32.789032 4642 consensus_queue.cc:237] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.809860 4553 leader_election.cc:304] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cb695c5b2f8428ea2f436699ff03d00; no voters: 36b689c7e3c246b8b16bed3910c700f1, 7470d6630dcc4f07851e63c7bb3e0b71
I20260207 20:52:32.811292 4644 raft_consensus.cc:3060] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:32.811750 4168 catalog_manager.cc:5654] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b689c7e3c246b8b16bed3910c700f1 (127.2.223.2). New cstate: current_term: 1 leader_uuid: "36b689c7e3c246b8b16bed3910c700f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:32.820015 4644 raft_consensus.cc:2749] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:52:32.871254 4643 raft_consensus.cc:493] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:32.871670 4643 raft_consensus.cc:515] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.873025 4642 raft_consensus.cc:493] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:32.873658 4643 leader_election.cc:290] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b689c7e3c246b8b16bed3910c700f1 (127.2.223.2:39059), 4cb695c5b2f8428ea2f436699ff03d00 (127.2.223.3:40549)
I20260207 20:52:32.873517 4642 raft_consensus.cc:515] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } }
I20260207 20:52:32.875473 4642 leader_election.cc:290] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1:37447), 4cb695c5b2f8428ea2f436699ff03d00 (127.2.223.3:40549)
I20260207 20:52:32.876915 4426 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c877ca0cd734f2986ce6a9695cd34a0" candidate_uuid: "36b689c7e3c246b8b16bed3910c700f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" is_pre_election: true
I20260207 20:52:32.877560 4426 raft_consensus.cc:2468] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b689c7e3c246b8b16bed3910c700f1 in term 0.
I20260207 20:52:32.878273 4589 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c877ca0cd734f2986ce6a9695cd34a0" candidate_uuid: "36b689c7e3c246b8b16bed3910c700f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cb695c5b2f8428ea2f436699ff03d00" is_pre_election: true
I20260207 20:52:32.878664 4476 leader_election.cc:304] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b689c7e3c246b8b16bed3910c700f1, 7470d6630dcc4f07851e63c7bb3e0b71; no voters:
I20260207 20:52:32.878870 4589 raft_consensus.cc:2468] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b689c7e3c246b8b16bed3910c700f1 in term 0.
I20260207 20:52:32.879490 4642 raft_consensus.cc:2804] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:32.879858 4642 raft_consensus.cc:493] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:32.880182 4642 raft_consensus.cc:3060] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:32.894788 4512 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1919962fdef4d928e3cd8c1509c95db" candidate_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b689c7e3c246b8b16bed3910c700f1" is_pre_election: true
I20260207 20:52:32.895381 4512 raft_consensus.cc:2468] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7470d6630dcc4f07851e63c7bb3e0b71 in term 0.
I20260207 20:52:32.895656 4642 raft_consensus.cc:515] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } }
I20260207 20:52:32.896450 4386 leader_election.cc:304] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b689c7e3c246b8b16bed3910c700f1, 7470d6630dcc4f07851e63c7bb3e0b71; no voters:
I20260207 20:52:32.898177 4642 leader_election.cc:290] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [CANDIDATE]: Term 1 election: Requested vote from peers 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1:37447), 4cb695c5b2f8428ea2f436699ff03d00 (127.2.223.3:40549)
I20260207 20:52:32.898124 4426 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c877ca0cd734f2986ce6a9695cd34a0" candidate_uuid: "36b689c7e3c246b8b16bed3910c700f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7470d6630dcc4f07851e63c7bb3e0b71"
I20260207 20:52:32.898906 4426 raft_consensus.cc:3060] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:32.898247 4643 raft_consensus.cc:2804] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:32.899528 4643 raft_consensus.cc:493] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:32.899843 4643 raft_consensus.cc:3060] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:32.906579 4426 raft_consensus.cc:2468] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b689c7e3c246b8b16bed3910c700f1 in term 1.
I20260207 20:52:32.907681 4476 leader_election.cc:304] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b689c7e3c246b8b16bed3910c700f1, 7470d6630dcc4f07851e63c7bb3e0b71; no voters:
I20260207 20:52:32.906319 4643 raft_consensus.cc:515] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.898387 4589 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c877ca0cd734f2986ce6a9695cd34a0" candidate_uuid: "36b689c7e3c246b8b16bed3910c700f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cb695c5b2f8428ea2f436699ff03d00"
I20260207 20:52:32.910735 4589 raft_consensus.cc:3060] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:32.911530 4643 leader_election.cc:290] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [CANDIDATE]: Term 1 election: Requested vote from peers 36b689c7e3c246b8b16bed3910c700f1 (127.2.223.2:39059), 4cb695c5b2f8428ea2f436699ff03d00 (127.2.223.3:40549)
I20260207 20:52:32.913537 4512 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1919962fdef4d928e3cd8c1509c95db" candidate_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b689c7e3c246b8b16bed3910c700f1"
I20260207 20:52:32.914084 4512 raft_consensus.cc:3060] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:32.915293 4590 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1919962fdef4d928e3cd8c1509c95db" candidate_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cb695c5b2f8428ea2f436699ff03d00" is_pre_election: true
I20260207 20:52:32.913380 4642 raft_consensus.cc:2804] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:32.915892 4590 raft_consensus.cc:2468] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7470d6630dcc4f07851e63c7bb3e0b71 in term 0.
I20260207 20:52:32.916956 4642 raft_consensus.cc:697] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [term 1 LEADER]: Becoming Leader. State: Replica: 36b689c7e3c246b8b16bed3910c700f1, State: Running, Role: LEADER
I20260207 20:52:32.917706 4642 consensus_queue.cc:237] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } }
I20260207 20:52:32.915854 4588 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1919962fdef4d928e3cd8c1509c95db" candidate_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cb695c5b2f8428ea2f436699ff03d00"
I20260207 20:52:32.922515 4588 raft_consensus.cc:3060] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:32.925863 4512 raft_consensus.cc:2468] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7470d6630dcc4f07851e63c7bb3e0b71 in term 1.
I20260207 20:52:32.927126 4386 leader_election.cc:304] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b689c7e3c246b8b16bed3910c700f1, 7470d6630dcc4f07851e63c7bb3e0b71; no voters:
I20260207 20:52:32.929152 4643 raft_consensus.cc:2804] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:32.932752 4168 catalog_manager.cc:5654] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b689c7e3c246b8b16bed3910c700f1 (127.2.223.2). New cstate: current_term: 1 leader_uuid: "36b689c7e3c246b8b16bed3910c700f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } health_report { overall_health: HEALTHY } } }
I20260207 20:52:32.936424 4588 raft_consensus.cc:2468] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7470d6630dcc4f07851e63c7bb3e0b71 in term 1.
I20260207 20:52:32.938102 4643 raft_consensus.cc:697] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [term 1 LEADER]: Becoming Leader. State: Replica: 7470d6630dcc4f07851e63c7bb3e0b71, State: Running, Role: LEADER
I20260207 20:52:32.939098 4643 consensus_queue.cc:237] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:32.940610 4589 raft_consensus.cc:2468] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b689c7e3c246b8b16bed3910c700f1 in term 1.
I20260207 20:52:32.947474 4166 catalog_manager.cc:5654] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:33.239032 4642 consensus_queue.cc:1048] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:33.311748 4655 consensus_queue.cc:1048] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:33.346215 4655 consensus_queue.cc:1048] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:33.389825 4655 consensus_queue.cc:1048] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:33.437471 4643 consensus_queue.cc:1048] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:33.538159 4643 consensus_queue.cc:1048] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:33.816541 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:52:33.855394 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:33.856158 2940 tablet_replica.cc:333] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71: stopping tablet replica
I20260207 20:52:33.856909 2940 raft_consensus.cc:2243] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:33.857416 2940 raft_consensus.cc:2272] T 7c877ca0cd734f2986ce6a9695cd34a0 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:33.861419 2940 tablet_replica.cc:333] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71: stopping tablet replica
I20260207 20:52:33.862072 2940 raft_consensus.cc:2243] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:33.863024 2940 raft_consensus.cc:2272] T a1919962fdef4d928e3cd8c1509c95db P 7470d6630dcc4f07851e63c7bb3e0b71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:33.865037 2940 tablet_replica.cc:333] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71: stopping tablet replica
I20260207 20:52:33.865460 2940 raft_consensus.cc:2243] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:33.865788 2940 raft_consensus.cc:2272] T 22e38575ba65428b92d3c19efe1d5295 P 7470d6630dcc4f07851e63c7bb3e0b71 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260207 20:52:33.877738 4476 connection.cc:700] client connection to 127.2.223.1:37447 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260207 20:52:33.895892 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
W20260207 20:52:33.896384 4476 consensus_peers.cc:597] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 -> Peer 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1:37447): Couldn't send request to peer 7470d6630dcc4f07851e63c7bb3e0b71. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:37447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260207 20:52:33.896780 4476 consensus_peers.cc:597] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 -> Peer 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1:37447): Couldn't send request to peer 7470d6630dcc4f07851e63c7bb3e0b71. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:37447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:52:33.910851 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:33.918627 4716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:33.919337 4715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:33.922683 2940 server_base.cc:1060] running on GCE node
W20260207 20:52:33.926608 4718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:33.927381 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:33.927588 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:33.927722 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497553927712 us; error 0 us; skew 500 ppm
I20260207 20:52:33.928151 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:33.930781 2940 webserver.cc:492] Webserver started at http://127.2.223.1:37491/ using document root <none> and password file <none>
I20260207 20:52:33.931241 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:33.931442 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:33.931746 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:33.932870 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-0-root2/instance:
uuid: "db6894bc6ba64e1d97dbd6ed28c40b0a"
format_stamp: "Formatted at 2026-02-07 20:52:33 on dist-test-slave-kqw4"
I20260207 20:52:33.940068 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.005s sys 0.003s
I20260207 20:52:33.943660 4723 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:33.944831 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260207 20:52:33.945120 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-0-root2
uuid: "db6894bc6ba64e1d97dbd6ed28c40b0a"
format_stamp: "Formatted at 2026-02-07 20:52:33 on dist-test-slave-kqw4"
I20260207 20:52:33.945389 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-0-root2
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-0-root2
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1770497537224219-2940-0/minicluster-data/ts-0-root2/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:33.973114 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:33.974241 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:33.975870 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:33.980010 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:33.980211 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:33.980440 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:33.980592 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:34.049532 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:37447
I20260207 20:52:34.049616 4785 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:37447 every 8 connection(s)
W20260207 20:52:34.063061 4786 heartbeater.cc:646] Failed to heartbeat to 127.0.0.1:7051 (0 consecutive failures): Network error: Failed to ping master at 127.0.0.1:7051: Client connection negotiation failed: client connection to 127.0.0.1:7051: connect: Connection refused (error 111)
W20260207 20:52:34.076056 4786 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260207 20:52:34.102911 4501 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260207 20:52:34.121377 4578 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260207 20:52:34.303105 4761 tablet_service.cc:409] Invalid argument: UpdateConsensus: Wrong destination UUID requested. Local UUID: db6894bc6ba64e1d97dbd6ed28c40b0a. Requested UUID: 7470d6630dcc4f07851e63c7bb3e0b71: from {username='slave'} at 127.0.0.1:60690: tablet_id: "22e38575ba65428b92d3c19efe1d5295" caller_uuid: "36b689c7e3c246b8b16bed3910c700f1" caller_term: 1 preceding_id { term: 1 index: 1 } dest_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" committed_index: 1 all_replicated_index: 1 safe_timestamp: 7251957982257565696 last_idx_appended_to_leader: 1
I20260207 20:52:34.305693 4476 consensus_queue.cc:579] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: The tablet replica hosted on peer 7470d6630dcc4f07851e63c7bb3e0b71 has failed
I20260207 20:52:34.325132 4512 consensus_queue.cc:237] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:34.334204 4589 raft_consensus.cc:1275] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Refusing update from remote peer 36b689c7e3c246b8b16bed3910c700f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:34.335736 4712 consensus_queue.cc:1048] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260207 20:52:34.345002 4655 raft_consensus.cc:2955] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } }
I20260207 20:52:34.345890 4589 raft_consensus.cc:2955] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } }
I20260207 20:52:34.365881 4153 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 22e38575ba65428b92d3c19efe1d5295 with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260207 20:52:34.372624 4166 catalog_manager.cc:5654] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 reported cstate change: config changed from index -1 to 2, VOTER 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1) evicted. New cstate: current_term: 1 leader_uuid: "36b689c7e3c246b8b16bed3910c700f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } health_report { overall_health: HEALTHY } } }
W20260207 20:52:34.430413 4761 tablet_service.cc:409] Invalid argument: UpdateConsensus: Wrong destination UUID requested. Local UUID: db6894bc6ba64e1d97dbd6ed28c40b0a. Requested UUID: 7470d6630dcc4f07851e63c7bb3e0b71: from {username='slave'} at 127.0.0.1:60690: tablet_id: "7c877ca0cd734f2986ce6a9695cd34a0" caller_uuid: "36b689c7e3c246b8b16bed3910c700f1" caller_term: 1 preceding_id { term: 1 index: 1 } dest_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" committed_index: 1 all_replicated_index: 1 safe_timestamp: 7251957982927560704 last_idx_appended_to_leader: 1
I20260207 20:52:34.431767 4476 consensus_queue.cc:579] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: The tablet replica hosted on peer 7470d6630dcc4f07851e63c7bb3e0b71 has failed
I20260207 20:52:34.432929 4512 consensus_queue.cc:237] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: NON_VOTER last_known_addr { host: "127.2.223.1" port: 37447 } attrs { promote: true } }
I20260207 20:52:34.446246 2940 tablet_server.cc:178] TabletServer@127.2.223.1:37447 shutting down...
W20260207 20:52:34.447526 4761 tablet_service.cc:409] Invalid argument: UpdateConsensus: Wrong destination UUID requested. Local UUID: db6894bc6ba64e1d97dbd6ed28c40b0a. Requested UUID: 7470d6630dcc4f07851e63c7bb3e0b71: from {username='slave'} at 127.0.0.1:60690: tablet_id: "22e38575ba65428b92d3c19efe1d5295" caller_uuid: "36b689c7e3c246b8b16bed3910c700f1" caller_term: 1 preceding_id { term: 1 index: 3 } dest_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" committed_index: 2 all_replicated_index: 0 safe_timestamp: 7251957983002169344 last_idx_appended_to_leader: 3
I20260207 20:52:34.448921 4476 consensus_queue.cc:579] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: The tablet replica hosted on peer 7470d6630dcc4f07851e63c7bb3e0b71 has failed
W20260207 20:52:34.449373 4476 consensus_peers.cc:597] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 -> Peer 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1:37447): Couldn't send request to peer 7470d6630dcc4f07851e63c7bb3e0b71. Error code: WRONG_SERVER_UUID (16). Status: Invalid argument: UpdateConsensus: Wrong destination UUID requested. Local UUID: db6894bc6ba64e1d97dbd6ed28c40b0a. Requested UUID: 7470d6630dcc4f07851e63c7bb3e0b71. This is attempt 1: this message will repeat every 5th retry.
I20260207 20:52:34.448760 4589 raft_consensus.cc:1275] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Refusing update from remote peer 36b689c7e3c246b8b16bed3910c700f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260207 20:52:34.466637 4642 consensus_queue.cc:1048] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260207 20:52:34.468587 4512 consensus_queue.cc:237] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } }
I20260207 20:52:34.473953 4588 raft_consensus.cc:1275] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Refusing update from remote peer 36b689c7e3c246b8b16bed3910c700f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:34.475029 4642 raft_consensus.cc:2955] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: NON_VOTER last_known_addr { host: "127.2.223.1" port: 37447 } attrs { promote: true } } }
I20260207 20:52:34.480916 4712 consensus_queue.cc:1048] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260207 20:52:34.487180 4588 raft_consensus.cc:2955] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: NON_VOTER last_known_addr { host: "127.2.223.1" port: 37447 } attrs { promote: true } } }
I20260207 20:52:34.509894 4655 raft_consensus.cc:2955] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } }
I20260207 20:52:34.512547 4589 raft_consensus.cc:2955] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } }
I20260207 20:52:34.518379 4153 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 22e38575ba65428b92d3c19efe1d5295 with cas_config_opid_index 2: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260207 20:52:34.526974 4166 catalog_manager.cc:5654] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 reported cstate change: config changed from index 2 to 3, NON_VOTER 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1) added. New cstate: current_term: 1 leader_uuid: "36b689c7e3c246b8b16bed3910c700f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } peers { permanent_uuid: "7470d6630dcc4f07851e63c7bb3e0b71" member_type: NON_VOTER last_known_addr { host: "127.2.223.1" port: 37447 } attrs { promote: true } } }
I20260207 20:52:34.529654 4153 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 7c877ca0cd734f2986ce6a9695cd34a0 with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260207 20:52:34.530679 4154 catalog_manager.cc:4712] TS 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1:37447): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 22e38575ba65428b92d3c19efe1d5295: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260207 20:52:34.531855 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:34.547796 2940 tablet_server.cc:195] TabletServer@127.2.223.1:37447 shutdown complete.
I20260207 20:52:34.550799 4169 catalog_manager.cc:5654] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 reported cstate change: config changed from index -1 to 2, VOTER 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1) evicted. New cstate: current_term: 1 leader_uuid: "36b689c7e3c246b8b16bed3910c700f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } health_report { overall_health: HEALTHY } } }
I20260207 20:52:34.572350 4512 consensus_queue.cc:237] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } }
I20260207 20:52:34.572782 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:52:34.584849 4589 raft_consensus.cc:1275] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Refusing update from remote peer 36b689c7e3c246b8b16bed3910c700f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260207 20:52:34.588224 4655 consensus_queue.cc:1048] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260207 20:52:34.597711 4712 raft_consensus.cc:2955] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, NON_VOTER 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } }
I20260207 20:52:34.599679 4589 raft_consensus.cc:2955] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, NON_VOTER 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } } }
I20260207 20:52:34.605182 4153 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 22e38575ba65428b92d3c19efe1d5295 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260207 20:52:34.611764 4166 catalog_manager.cc:5654] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 reported cstate change: config changed from index 3 to 4, NON_VOTER 7470d6630dcc4f07851e63c7bb3e0b71 (127.2.223.1) evicted. New cstate: current_term: 1 leader_uuid: "36b689c7e3c246b8b16bed3910c700f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36b689c7e3c246b8b16bed3910c700f1" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cb695c5b2f8428ea2f436699ff03d00" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40549 } health_report { overall_health: HEALTHY } } }
I20260207 20:52:34.646198 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:34.646790 2940 tablet_replica.cc:333] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1: stopping tablet replica
I20260207 20:52:34.647418 2940 raft_consensus.cc:2243] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:34.647783 2940 raft_consensus.cc:2272] T a1919962fdef4d928e3cd8c1509c95db P 36b689c7e3c246b8b16bed3910c700f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:34.649387 2940 tablet_replica.cc:333] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1: stopping tablet replica
I20260207 20:52:34.649839 2940 raft_consensus.cc:2243] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:34.650441 2940 raft_consensus.cc:2272] T 7c877ca0cd734f2986ce6a9695cd34a0 P 36b689c7e3c246b8b16bed3910c700f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:34.652451 2940 tablet_replica.cc:333] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1: stopping tablet replica
I20260207 20:52:34.652877 2940 raft_consensus.cc:2243] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:34.653442 2940 raft_consensus.cc:2272] T 22e38575ba65428b92d3c19efe1d5295 P 36b689c7e3c246b8b16bed3910c700f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:34.665936 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:52:34.679571 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:52:34.701423 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:34.701970 2940 tablet_replica.cc:333] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00: stopping tablet replica
I20260207 20:52:34.702467 2940 raft_consensus.cc:2243] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:34.702953 2940 raft_consensus.cc:2272] T 22e38575ba65428b92d3c19efe1d5295 P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:34.704871 2940 tablet_replica.cc:333] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00: stopping tablet replica
I20260207 20:52:34.705335 2940 raft_consensus.cc:2243] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:34.705710 2940 raft_consensus.cc:2272] T a1919962fdef4d928e3cd8c1509c95db P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:34.707247 2940 tablet_replica.cc:333] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00: stopping tablet replica
I20260207 20:52:34.707660 2940 raft_consensus.cc:2243] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:34.708034 2940 raft_consensus.cc:2272] T 7c877ca0cd734f2986ce6a9695cd34a0 P 4cb695c5b2f8428ea2f436699ff03d00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:34.726881 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:52:34.738468 2940 master.cc:561] Master@127.2.223.62:43401 shutting down...
I20260207 20:52:34.920861 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:34.921720 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:34.922050 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 948f2c0874e04024a87ef1834a5de985: stopping tablet replica
I20260207 20:52:34.941543 2940 master.cc:583] Master@127.2.223.62:43401 shutdown complete.
I20260207 20:52:34.952908 2940 master.cc:561] Master@127.2.223.61:37099 shutting down...
I20260207 20:52:34.967451 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:34.967942 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:34.968242 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0bb4751901154db5bcf6a013a584f52c: stopping tablet replica
I20260207 20:52:34.986892 2940 master.cc:583] Master@127.2.223.61:37099 shutdown complete.
I20260207 20:52:34.996630 2940 master.cc:561] Master@127.2.223.60:44393 shutting down...
I20260207 20:52:35.010933 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:35.011431 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:35.011734 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3d7bc11f214f46568db68f8d541b57e4: stopping tablet replica
I20260207 20:52:35.029783 2940 master.cc:583] Master@127.2.223.60:44393 shutdown complete.
[ OK ] RemoteKsckTest.TestTabletServerMismatchedUUID (3684 ms)
[ RUN ] RemoteKsckTest.TestTableConsistency
I20260207 20:52:35.060604 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:33815,127.2.223.61:36845,127.2.223.60:37581
I20260207 20:52:35.061832 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:35.066437 4815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:35.066516 4816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:35.067410 4818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:35.068511 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:35.069290 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:35.069478 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:35.069615 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497555069598 us; error 0 us; skew 500 ppm
I20260207 20:52:35.070077 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:35.072324 2940 webserver.cc:492] Webserver started at http://127.2.223.62:33747/ using document root <none> and password file <none>
I20260207 20:52:35.072731 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:35.072889 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:35.073117 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:35.074086 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "6c2f1171cc6d4e649889d232bc06ab6b"
format_stamp: "Formatted at 2026-02-07 20:52:35 on dist-test-slave-kqw4"
I20260207 20:52:35.078042 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260207 20:52:35.080909 4823 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:35.081538 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:52:35.081775 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "6c2f1171cc6d4e649889d232bc06ab6b"
format_stamp: "Formatted at 2026-02-07 20:52:35 on dist-test-slave-kqw4"
I20260207 20:52:35.082005 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:35.112838 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:35.113785 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:35.145254 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:33815
I20260207 20:52:35.145340 4874 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:33815 every 8 connection(s)
I20260207 20:52:35.148696 4875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:35.148866 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:35.153806 4877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:35.154724 4878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:35.155423 4875 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:35.157289 4880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:35.159032 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:35.159961 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:35.160216 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:35.160411 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497555160392 us; error 0 us; skew 500 ppm
I20260207 20:52:35.160930 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:35.163326 2940 webserver.cc:492] Webserver started at http://127.2.223.61:40907/ using document root <none> and password file <none>
I20260207 20:52:35.163738 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:35.163906 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:35.164143 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:35.165143 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "2464c47b32c54b37ae6219d7559bf264"
format_stamp: "Formatted at 2026-02-07 20:52:35 on dist-test-slave-kqw4"
I20260207 20:52:35.167109 4875 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:35.169530 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
W20260207 20:52:35.171437 4875 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:36845: Network error: Client connection negotiation failed: client connection to 127.2.223.61:36845: connect: Connection refused (error 111)
I20260207 20:52:35.172732 4888 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:35.173411 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:52:35.173655 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "2464c47b32c54b37ae6219d7559bf264"
format_stamp: "Formatted at 2026-02-07 20:52:35 on dist-test-slave-kqw4"
I20260207 20:52:35.173878 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:35.191711 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:35.192603 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:35.224527 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:36845
I20260207 20:52:35.224612 4939 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:36845 every 8 connection(s)
I20260207 20:52:35.228044 4940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:35.228168 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:35.229892 4875 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } attempt: 1
I20260207 20:52:35.235288 4940 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:35.235414 4942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:35.242662 4944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:35.245867 4947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:35.247699 4875 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:35.248132 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:35.249431 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:35.249680 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:35.249883 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497555249862 us; error 0 us; skew 500 ppm
I20260207 20:52:35.250545 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:35.252183 4940 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:35.252987 4875 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:37581: Network error: Client connection negotiation failed: client connection to 127.2.223.60:37581: connect: Connection refused (error 111)
I20260207 20:52:35.253922 2940 webserver.cc:492] Webserver started at http://127.2.223.60:38335/ using document root <none> and password file <none>
I20260207 20:52:35.254392 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:35.254567 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:35.254846 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:35.255829 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "5801a8c4831741f7ad11cb9322be194c"
format_stamp: "Formatted at 2026-02-07 20:52:35 on dist-test-slave-kqw4"
I20260207 20:52:35.260241 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260207 20:52:35.261169 4940 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:35.263691 4952 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:35.264559 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260207 20:52:35.264817 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "5801a8c4831741f7ad11cb9322be194c"
format_stamp: "Formatted at 2026-02-07 20:52:35 on dist-test-slave-kqw4"
I20260207 20:52:35.265116 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:52:35.266191 4940 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:37581: Network error: Client connection negotiation failed: client connection to 127.2.223.60:37581: connect: Connection refused (error 111)
I20260207 20:52:35.289337 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:35.290426 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:35.304591 4940 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } attempt: 1
I20260207 20:52:35.305471 4875 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } attempt: 1
W20260207 20:52:35.309898 4940 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:37581: Network error: Client connection negotiation failed: client connection to 127.2.223.60:37581: connect: Connection refused (error 111)
W20260207 20:52:35.310564 4875 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:37581: Network error: Client connection negotiation failed: client connection to 127.2.223.60:37581: connect: Connection refused (error 111)
I20260207 20:52:35.326205 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:37581
I20260207 20:52:35.326323 5004 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:37581 every 8 connection(s)
I20260207 20:52:35.329025 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:52:35.329908 5005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:35.335503 5005 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:35.345055 5005 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:35.347398 4940 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } attempt: 2
I20260207 20:52:35.354765 5005 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:35.357007 4875 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } attempt: 2
I20260207 20:52:35.364161 4940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264: Bootstrap starting.
I20260207 20:52:35.369824 4940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:35.372197 5005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c: Bootstrap starting.
I20260207 20:52:35.374424 4875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b: Bootstrap starting.
I20260207 20:52:35.374558 4940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264: No bootstrap required, opened a new log
I20260207 20:52:35.377228 4940 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:35.377919 4940 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:35.378088 5005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:35.378255 4940 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2464c47b32c54b37ae6219d7559bf264, State: Initialized, Role: FOLLOWER
I20260207 20:52:35.378643 4875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:35.378995 4940 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:35.381161 5011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:35.382015 5011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:35.383134 4940 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:35.385334 5005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c: No bootstrap required, opened a new log
I20260207 20:52:35.385461 4875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b: No bootstrap required, opened a new log
I20260207 20:52:35.388123 5005 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:35.388267 4875 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:35.388917 5005 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:35.389034 4875 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:35.389328 5005 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801a8c4831741f7ad11cb9322be194c, State: Initialized, Role: FOLLOWER
I20260207 20:52:35.389432 4875 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c2f1171cc6d4e649889d232bc06ab6b, State: Initialized, Role: FOLLOWER
I20260207 20:52:35.390233 4875 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:35.390161 5005 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:35.392098 5019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:35.392854 5019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:35.393630 4875 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:35.400451 5005 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:35.402959 5020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:35.403705 5020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: This master's current role is: FOLLOWER
W20260207 20:52:35.406910 5030 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:35.407255 5030 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:52:35.412809 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:52:35.413026 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
W20260207 20:52:35.415856 5043 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:35.416114 5043 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:52:35.417898 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:35.419487 5048 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:35.419735 5048 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:52:35.423614 5049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:35.423983 5050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:35.425890 5052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:35.426571 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:35.427235 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:35.427451 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:35.427590 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497555427578 us; error 0 us; skew 500 ppm
I20260207 20:52:35.428004 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:35.430873 2940 webserver.cc:492] Webserver started at http://127.2.223.1:40457/ using document root <none> and password file <none>
I20260207 20:52:35.431269 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:35.431419 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:35.431623 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:35.432531 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "0d12db020ba0404797e6e0c883f82b80"
format_stamp: "Formatted at 2026-02-07 20:52:35 on dist-test-slave-kqw4"
I20260207 20:52:35.436313 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260207 20:52:35.439060 5057 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:35.439716 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260207 20:52:35.439952 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "0d12db020ba0404797e6e0c883f82b80"
format_stamp: "Formatted at 2026-02-07 20:52:35 on dist-test-slave-kqw4"
I20260207 20:52:35.440167 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:35.459337 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:35.460348 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:35.461633 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:35.463805 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:35.463979 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:35.464201 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:35.464339 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:35.500011 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:32961
I20260207 20:52:35.500115 5119 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:32961 every 8 connection(s)
I20260207 20:52:35.507898 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:35.519127 5120 heartbeater.cc:344] Connected to a master server at 127.2.223.60:37581
I20260207 20:52:35.519588 5120 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:35.520434 5120 heartbeater.cc:507] Master 127.2.223.60:37581 requested a full tablet report, sending...
W20260207 20:52:35.521435 5127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:35.522269 5121 heartbeater.cc:344] Connected to a master server at 127.2.223.61:36845
I20260207 20:52:35.522715 5121 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:35.523523 5121 heartbeater.cc:507] Master 127.2.223.61:36845 requested a full tablet report, sending...
I20260207 20:52:35.524104 4970 ts_manager.cc:194] Registered new tserver with Master: 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961)
W20260207 20:52:35.525758 5128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:35.525862 5122 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33815
I20260207 20:52:35.526146 4905 ts_manager.cc:194] Registered new tserver with Master: 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961)
I20260207 20:52:35.526384 5122 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:35.527478 5122 heartbeater.cc:507] Master 127.2.223.62:33815 requested a full tablet report, sending...
W20260207 20:52:35.529887 5130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:35.530812 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:35.531241 4840 ts_manager.cc:194] Registered new tserver with Master: 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961)
I20260207 20:52:35.531766 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:35.532032 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:35.532217 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497555532191 us; error 0 us; skew 500 ppm
I20260207 20:52:35.532771 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:35.534847 2940 webserver.cc:492] Webserver started at http://127.2.223.2:45207/ using document root <none> and password file <none>
I20260207 20:52:35.535317 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:35.535499 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:35.535735 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:35.536700 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d"
format_stamp: "Formatted at 2026-02-07 20:52:35 on dist-test-slave-kqw4"
I20260207 20:52:35.541334 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260207 20:52:35.544957 5135 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:35.545715 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:52:35.545981 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d"
format_stamp: "Formatted at 2026-02-07 20:52:35 on dist-test-slave-kqw4"
I20260207 20:52:35.546212 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:35.558193 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:35.559178 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:35.560456 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:35.562541 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:35.562767 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:35.562974 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:35.563122 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:35.599779 5020 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:35.600330 5020 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:35.602047 5020 leader_election.cc:290] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c2f1171cc6d4e649889d232bc06ab6b (127.2.223.62:33815), 2464c47b32c54b37ae6219d7559bf264 (127.2.223.61:36845)
I20260207 20:52:35.602779 4850 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5801a8c4831741f7ad11cb9322be194c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" is_pre_election: true
I20260207 20:52:35.603453 4850 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801a8c4831741f7ad11cb9322be194c in term 0.
I20260207 20:52:35.603331 4915 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5801a8c4831741f7ad11cb9322be194c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2464c47b32c54b37ae6219d7559bf264" is_pre_election: true
I20260207 20:52:35.604265 4915 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801a8c4831741f7ad11cb9322be194c in term 0.
I20260207 20:52:35.604544 4956 leader_election.cc:304] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801a8c4831741f7ad11cb9322be194c, 6c2f1171cc6d4e649889d232bc06ab6b; no voters:
I20260207 20:52:35.605443 5020 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:35.605808 5020 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:35.606102 5020 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:35.612079 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:45883
I20260207 20:52:35.612172 5197 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:45883 every 8 connection(s)
I20260207 20:52:35.611867 5020 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:35.615387 5020 leader_election.cc:290] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [CANDIDATE]: Term 1 election: Requested vote from peers 6c2f1171cc6d4e649889d232bc06ab6b (127.2.223.62:33815), 2464c47b32c54b37ae6219d7559bf264 (127.2.223.61:36845)
I20260207 20:52:35.616000 4850 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5801a8c4831741f7ad11cb9322be194c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c2f1171cc6d4e649889d232bc06ab6b"
I20260207 20:52:35.616313 4915 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5801a8c4831741f7ad11cb9322be194c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2464c47b32c54b37ae6219d7559bf264"
I20260207 20:52:35.616587 4850 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:35.616886 4915 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:35.623914 4915 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801a8c4831741f7ad11cb9322be194c in term 1.
I20260207 20:52:35.625028 4954 leader_election.cc:304] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2464c47b32c54b37ae6219d7559bf264, 5801a8c4831741f7ad11cb9322be194c; no voters:
I20260207 20:52:35.626052 5020 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:35.629750 4850 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801a8c4831741f7ad11cb9322be194c in term 1.
I20260207 20:52:35.646931 5020 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 1 LEADER]: Becoming Leader. State: Replica: 5801a8c4831741f7ad11cb9322be194c, State: Running, Role: LEADER
I20260207 20:52:35.648173 5020 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:35.657577 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:35.659497 5199 heartbeater.cc:344] Connected to a master server at 127.2.223.61:36845
I20260207 20:52:35.659914 5199 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:35.660779 5199 heartbeater.cc:507] Master 127.2.223.61:36845 requested a full tablet report, sending...
I20260207 20:52:35.664008 5198 heartbeater.cc:344] Connected to a master server at 127.2.223.60:37581
I20260207 20:52:35.664391 5198 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:35.664765 4905 ts_manager.cc:194] Registered new tserver with Master: 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883)
I20260207 20:52:35.664647 5201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5801a8c4831741f7ad11cb9322be194c. Latest consensus state: current_term: 1 leader_uuid: "5801a8c4831741f7ad11cb9322be194c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:35.665162 5198 heartbeater.cc:507] Master 127.2.223.60:37581 requested a full tablet report, sending...
I20260207 20:52:35.665376 5201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:35.667373 5207 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
W20260207 20:52:35.668738 5206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:35.671013 4970 ts_manager.cc:194] Registered new tserver with Master: 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883)
W20260207 20:52:35.674722 5208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:35.676146 5207 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:52:35.684845 2940 server_base.cc:1060] running on GCE node
W20260207 20:52:35.685688 5211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:35.686872 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:35.687211 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:35.687326 4850 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 1 FOLLOWER]: Refusing update from remote peer 5801a8c4831741f7ad11cb9322be194c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:35.687665 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497555687644 us; error 0 us; skew 500 ppm
I20260207 20:52:35.688575 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:35.687147 4915 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 1 FOLLOWER]: Refusing update from remote peer 5801a8c4831741f7ad11cb9322be194c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:35.688994 5201 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260207 20:52:35.691344 5020 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:35.692654 5202 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33815
I20260207 20:52:35.693053 5202 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:35.693797 5202 heartbeater.cc:507] Master 127.2.223.62:33815 requested a full tablet report, sending...
I20260207 20:52:35.701642 5011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5801a8c4831741f7ad11cb9322be194c. Latest consensus state: current_term: 1 leader_uuid: "5801a8c4831741f7ad11cb9322be194c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:35.702450 5011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:35.707324 2940 webserver.cc:492] Webserver started at http://127.2.223.3:42363/ using document root <none> and password file <none>
I20260207 20:52:35.707907 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:35.708184 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:35.708560 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:35.709957 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "db40719931e143418375cd82197cd884"
format_stamp: "Formatted at 2026-02-07 20:52:35 on dist-test-slave-kqw4"
I20260207 20:52:35.716020 5020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5801a8c4831741f7ad11cb9322be194c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:35.716782 5020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:35.717733 4840 ts_manager.cc:194] Registered new tserver with Master: 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883)
I20260207 20:52:35.718010 5207 catalog_manager.cc:1357] Generated new cluster ID: 8848db71dfc94b4f89c2afd1dbd1e55b
I20260207 20:52:35.718322 5207 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:52:35.722038 5019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5801a8c4831741f7ad11cb9322be194c. Latest consensus state: current_term: 1 leader_uuid: "5801a8c4831741f7ad11cb9322be194c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:35.722739 5019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:35.718374 5011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5801a8c4831741f7ad11cb9322be194c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:35.723511 5011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:35.725098 5201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5801a8c4831741f7ad11cb9322be194c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:35.725816 5201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:35.731907 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.021s user 0.005s sys 0.003s
I20260207 20:52:35.744915 5223 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:35.746966 2940 fs_manager.cc:730] Time spent opening block manager: real 0.012s user 0.005s sys 0.004s
I20260207 20:52:35.747349 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "db40719931e143418375cd82197cd884"
format_stamp: "Formatted at 2026-02-07 20:52:35 on dist-test-slave-kqw4"
I20260207 20:52:35.747709 5207 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:52:35.747686 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:35.748672 5019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5801a8c4831741f7ad11cb9322be194c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:35.749351 5019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:35.749320 5207 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:52:35.786758 5207 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c: Generated new TSK 0
I20260207 20:52:35.787295 5207 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:52:35.793041 4969 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57172
I20260207 20:52:35.804276 4969 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57176
I20260207 20:52:35.806363 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:35.807544 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:35.809410 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:35.810075 5120 heartbeater.cc:499] Master 127.2.223.60:37581 was elected leader, sending a full tablet report...
I20260207 20:52:35.812309 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:35.812556 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:35.812780 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:35.812933 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:35.816347 5198 heartbeater.cc:499] Master 127.2.223.60:37581 was elected leader, sending a full tablet report...
I20260207 20:52:35.874428 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:45779
I20260207 20:52:35.874552 5287 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:45779 every 8 connection(s)
I20260207 20:52:35.912283 5288 heartbeater.cc:344] Connected to a master server at 127.2.223.60:37581
I20260207 20:52:35.912735 5288 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:35.913602 5288 heartbeater.cc:507] Master 127.2.223.60:37581 requested a full tablet report, sending...
I20260207 20:52:35.916759 4969 ts_manager.cc:194] Registered new tserver with Master: db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:35.918663 5289 heartbeater.cc:344] Connected to a master server at 127.2.223.61:36845
I20260207 20:52:35.919041 5289 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:35.919131 5290 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33815
I20260207 20:52:35.919523 5290 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:35.919840 5289 heartbeater.cc:507] Master 127.2.223.61:36845 requested a full tablet report, sending...
I20260207 20:52:35.920236 5290 heartbeater.cc:507] Master 127.2.223.62:33815 requested a full tablet report, sending...
I20260207 20:52:35.918393 4969 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57184
I20260207 20:52:35.922619 4840 ts_manager.cc:194] Registered new tserver with Master: db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:35.923491 4904 ts_manager.cc:194] Registered new tserver with Master: db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:35.923936 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.024246772s
I20260207 20:52:35.933542 5288 heartbeater.cc:499] Master 127.2.223.60:37581 was elected leader, sending a full tablet report...
I20260207 20:52:35.980253 4969 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57188:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:52:35.982316 4969 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:52:36.109294 5085 tablet_service.cc:1505] Processing CreateTablet for tablet ed25aea2e18e46f7b6c6d32e33e3a085 (DEFAULT_TABLE table=ksck-test-table [id=bb24a52ed913454a923fc9f0eb268d90]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:36.110666 5085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed25aea2e18e46f7b6c6d32e33e3a085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:36.119855 5084 tablet_service.cc:1505] Processing CreateTablet for tablet f25095d0fbe84afca252ca473e84894a (DEFAULT_TABLE table=ksck-test-table [id=bb24a52ed913454a923fc9f0eb268d90]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:36.121162 5084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f25095d0fbe84afca252ca473e84894a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:36.124341 5163 tablet_service.cc:1505] Processing CreateTablet for tablet ed25aea2e18e46f7b6c6d32e33e3a085 (DEFAULT_TABLE table=ksck-test-table [id=bb24a52ed913454a923fc9f0eb268d90]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:36.125030 5161 tablet_service.cc:1505] Processing CreateTablet for tablet c084406891b945d587d28330fd61cb2c (DEFAULT_TABLE table=ksck-test-table [id=bb24a52ed913454a923fc9f0eb268d90]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:36.125641 5163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed25aea2e18e46f7b6c6d32e33e3a085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:36.126298 5161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c084406891b945d587d28330fd61cb2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:36.127992 5162 tablet_service.cc:1505] Processing CreateTablet for tablet f25095d0fbe84afca252ca473e84894a (DEFAULT_TABLE table=ksck-test-table [id=bb24a52ed913454a923fc9f0eb268d90]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:36.129201 5162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f25095d0fbe84afca252ca473e84894a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:36.131197 5083 tablet_service.cc:1505] Processing CreateTablet for tablet c084406891b945d587d28330fd61cb2c (DEFAULT_TABLE table=ksck-test-table [id=bb24a52ed913454a923fc9f0eb268d90]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:36.132508 5083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c084406891b945d587d28330fd61cb2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:36.158140 5253 tablet_service.cc:1505] Processing CreateTablet for tablet ed25aea2e18e46f7b6c6d32e33e3a085 (DEFAULT_TABLE table=ksck-test-table [id=bb24a52ed913454a923fc9f0eb268d90]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:36.158694 5251 tablet_service.cc:1505] Processing CreateTablet for tablet c084406891b945d587d28330fd61cb2c (DEFAULT_TABLE table=ksck-test-table [id=bb24a52ed913454a923fc9f0eb268d90]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:36.159484 5253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed25aea2e18e46f7b6c6d32e33e3a085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:36.159777 5252 tablet_service.cc:1505] Processing CreateTablet for tablet f25095d0fbe84afca252ca473e84894a (DEFAULT_TABLE table=ksck-test-table [id=bb24a52ed913454a923fc9f0eb268d90]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:36.161134 5252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f25095d0fbe84afca252ca473e84894a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:36.167460 5251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c084406891b945d587d28330fd61cb2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:36.182627 5309 tablet_bootstrap.cc:492] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d: Bootstrap starting.
I20260207 20:52:36.207271 5309 tablet_bootstrap.cc:654] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:36.213972 5310 tablet_bootstrap.cc:492] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80: Bootstrap starting.
I20260207 20:52:36.217136 5309 tablet_bootstrap.cc:492] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d: No bootstrap required, opened a new log
I20260207 20:52:36.219798 5309 ts_tablet_manager.cc:1403] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d: Time spent bootstrapping tablet: real 0.037s user 0.005s sys 0.006s
I20260207 20:52:36.225558 5311 tablet_bootstrap.cc:492] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884: Bootstrap starting.
I20260207 20:52:36.225845 5309 raft_consensus.cc:359] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.226490 5309 raft_consensus.cc:385] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:36.226969 5309 raft_consensus.cc:740] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c61b0da4b8543d0b9e6a6aa1619d32d, State: Initialized, Role: FOLLOWER
I20260207 20:52:36.227656 5309 consensus_queue.cc:260] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.238781 5310 tablet_bootstrap.cc:654] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:36.244048 5311 tablet_bootstrap.cc:654] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:36.248422 5309 ts_tablet_manager.cc:1434] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d: Time spent starting tablet: real 0.028s user 0.011s sys 0.008s
I20260207 20:52:36.250349 5309 tablet_bootstrap.cc:492] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d: Bootstrap starting.
I20260207 20:52:36.256814 5309 tablet_bootstrap.cc:654] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:36.261207 5310 tablet_bootstrap.cc:492] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80: No bootstrap required, opened a new log
I20260207 20:52:36.261636 5311 tablet_bootstrap.cc:492] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884: No bootstrap required, opened a new log
I20260207 20:52:36.261677 5310 ts_tablet_manager.cc:1403] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80: Time spent bootstrapping tablet: real 0.048s user 0.000s sys 0.010s
I20260207 20:52:36.262247 5311 ts_tablet_manager.cc:1403] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884: Time spent bootstrapping tablet: real 0.037s user 0.012s sys 0.000s
I20260207 20:52:36.264519 5310 raft_consensus.cc:359] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.264861 5311 raft_consensus.cc:359] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.265480 5310 raft_consensus.cc:385] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:36.265615 5311 raft_consensus.cc:385] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:36.265884 5310 raft_consensus.cc:740] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d12db020ba0404797e6e0c883f82b80, State: Initialized, Role: FOLLOWER
I20260207 20:52:36.265981 5311 raft_consensus.cc:740] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db40719931e143418375cd82197cd884, State: Initialized, Role: FOLLOWER
I20260207 20:52:36.266772 5310 consensus_queue.cc:260] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.266876 5311 consensus_queue.cc:260] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.270375 5309 tablet_bootstrap.cc:492] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d: No bootstrap required, opened a new log
I20260207 20:52:36.270872 5309 ts_tablet_manager.cc:1403] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.002s
I20260207 20:52:36.274258 5309 raft_consensus.cc:359] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.274907 5309 raft_consensus.cc:385] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:36.278666 5309 raft_consensus.cc:740] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c61b0da4b8543d0b9e6a6aa1619d32d, State: Initialized, Role: FOLLOWER
I20260207 20:52:36.279306 5309 consensus_queue.cc:260] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.279924 5310 ts_tablet_manager.cc:1434] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80: Time spent starting tablet: real 0.018s user 0.006s sys 0.001s
I20260207 20:52:36.281404 5309 ts_tablet_manager.cc:1434] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s
I20260207 20:52:36.283200 5309 tablet_bootstrap.cc:492] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d: Bootstrap starting.
I20260207 20:52:36.285974 5310 tablet_bootstrap.cc:492] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80: Bootstrap starting.
I20260207 20:52:36.288882 5309 tablet_bootstrap.cc:654] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:36.299710 5310 tablet_bootstrap.cc:654] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:36.304343 5311 ts_tablet_manager.cc:1434] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884: Time spent starting tablet: real 0.042s user 0.011s sys 0.005s
I20260207 20:52:36.308863 5310 tablet_bootstrap.cc:492] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80: No bootstrap required, opened a new log
I20260207 20:52:36.309353 5310 ts_tablet_manager.cc:1403] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80: Time spent bootstrapping tablet: real 0.024s user 0.010s sys 0.000s
I20260207 20:52:36.318424 5319 raft_consensus.cc:493] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:36.318917 5319 raft_consensus.cc:515] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.321197 5319 leader_election.cc:290] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883)
I20260207 20:52:36.323058 5309 tablet_bootstrap.cc:492] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d: No bootstrap required, opened a new log
I20260207 20:52:36.323551 5309 ts_tablet_manager.cc:1403] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d: Time spent bootstrapping tablet: real 0.041s user 0.025s sys 0.009s
I20260207 20:52:36.326174 5309 raft_consensus.cc:359] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.326856 5309 raft_consensus.cc:385] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:36.327123 5309 raft_consensus.cc:740] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c61b0da4b8543d0b9e6a6aa1619d32d, State: Initialized, Role: FOLLOWER
I20260207 20:52:36.328437 5311 tablet_bootstrap.cc:492] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884: Bootstrap starting.
I20260207 20:52:36.327941 5309 consensus_queue.cc:260] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.332093 5309 ts_tablet_manager.cc:1434] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260207 20:52:36.336828 5311 tablet_bootstrap.cc:654] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:36.345147 5313 raft_consensus.cc:493] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:36.345619 5313 raft_consensus.cc:515] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.345866 5173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25095d0fbe84afca252ca473e84894a" candidate_uuid: "db40719931e143418375cd82197cd884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" is_pre_election: true
I20260207 20:52:36.346576 5173 raft_consensus.cc:2468] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db40719931e143418375cd82197cd884 in term 0.
I20260207 20:52:36.348032 5313 leader_election.cc:290] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:36.344760 5310 raft_consensus.cc:359] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.351915 5310 raft_consensus.cc:385] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:36.352202 5310 raft_consensus.cc:740] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d12db020ba0404797e6e0c883f82b80, State: Initialized, Role: FOLLOWER
I20260207 20:52:36.352533 5227 leader_election.cc:304] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c61b0da4b8543d0b9e6a6aa1619d32d, db40719931e143418375cd82197cd884; no voters:
I20260207 20:52:36.354933 5318 raft_consensus.cc:2804] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:36.355337 5318 raft_consensus.cc:493] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:36.355669 5318 raft_consensus.cc:3060] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:36.355841 5095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25095d0fbe84afca252ca473e84894a" candidate_uuid: "db40719931e143418375cd82197cd884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d12db020ba0404797e6e0c883f82b80" is_pre_election: true
I20260207 20:52:36.356791 5310 consensus_queue.cc:260] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
W20260207 20:52:36.357412 5227 leader_election.cc:343] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:36.365155 5310 ts_tablet_manager.cc:1434] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80: Time spent starting tablet: real 0.055s user 0.005s sys 0.001s
I20260207 20:52:36.366335 5310 tablet_bootstrap.cc:492] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80: Bootstrap starting.
I20260207 20:52:36.371371 5318 raft_consensus.cc:515] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.371795 5317 raft_consensus.cc:493] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:36.372534 5317 raft_consensus.cc:515] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.373476 5318 leader_election.cc:290] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 1 election: Requested vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883)
I20260207 20:52:36.374552 5095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25095d0fbe84afca252ca473e84894a" candidate_uuid: "db40719931e143418375cd82197cd884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d12db020ba0404797e6e0c883f82b80"
W20260207 20:52:36.376922 5227 leader_election.cc:343] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:36.377157 5317 leader_election.cc:290] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883), db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:36.379045 5310 tablet_bootstrap.cc:654] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:36.383972 5173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25095d0fbe84afca252ca473e84894a" candidate_uuid: "db40719931e143418375cd82197cd884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d"
I20260207 20:52:36.384598 5173 raft_consensus.cc:3060] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:36.394572 5263 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c084406891b945d587d28330fd61cb2c" candidate_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db40719931e143418375cd82197cd884" is_pre_election: true
W20260207 20:52:36.396080 5136 leader_election.cc:343] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer db40719931e143418375cd82197cd884 (127.2.223.3:45779): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:36.397796 5173 raft_consensus.cc:2468] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db40719931e143418375cd82197cd884 in term 1.
I20260207 20:52:36.399343 5227 leader_election.cc:304] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c61b0da4b8543d0b9e6a6aa1619d32d, db40719931e143418375cd82197cd884; no voters: 0d12db020ba0404797e6e0c883f82b80
I20260207 20:52:36.400875 5318 raft_consensus.cc:2804] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:36.401366 5318 raft_consensus.cc:697] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 1 LEADER]: Becoming Leader. State: Replica: db40719931e143418375cd82197cd884, State: Running, Role: LEADER
I20260207 20:52:36.402148 5318 consensus_queue.cc:237] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.412761 5095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c084406891b945d587d28330fd61cb2c" candidate_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d12db020ba0404797e6e0c883f82b80" is_pre_election: true
I20260207 20:52:36.413280 5030 catalog_manager.cc:1269] Loaded cluster ID: 8848db71dfc94b4f89c2afd1dbd1e55b
I20260207 20:52:36.413450 5095 raft_consensus.cc:2468] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c61b0da4b8543d0b9e6a6aa1619d32d in term 0.
I20260207 20:52:36.413583 5030 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264: loading cluster ID for follower catalog manager: success
I20260207 20:52:36.414535 5137 leader_election.cc:304] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d12db020ba0404797e6e0c883f82b80, 2c61b0da4b8543d0b9e6a6aa1619d32d; no voters: db40719931e143418375cd82197cd884
I20260207 20:52:36.415845 5313 raft_consensus.cc:2804] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:36.416203 5313 raft_consensus.cc:493] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:36.416525 5313 raft_consensus.cc:3060] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:36.421051 5043 catalog_manager.cc:1269] Loaded cluster ID: 8848db71dfc94b4f89c2afd1dbd1e55b
I20260207 20:52:36.421346 5043 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b: loading cluster ID for follower catalog manager: success
I20260207 20:52:36.424718 5317 raft_consensus.cc:493] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:36.425269 5317 raft_consensus.cc:515] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.428445 5043 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b: acquiring CA information for follower catalog manager: success
I20260207 20:52:36.424804 5313 raft_consensus.cc:515] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.430711 5313 leader_election.cc:290] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 1 election: Requested vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:36.430989 5095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c084406891b945d587d28330fd61cb2c" candidate_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d12db020ba0404797e6e0c883f82b80"
I20260207 20:52:36.435602 5095 raft_consensus.cc:3060] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:36.443279 5263 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c084406891b945d587d28330fd61cb2c" candidate_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db40719931e143418375cd82197cd884"
I20260207 20:52:36.443652 5043 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:52:36.428417 5030 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264: acquiring CA information for follower catalog manager: success
I20260207 20:52:36.431222 5317 leader_election.cc:290] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883), db40719931e143418375cd82197cd884 (127.2.223.3:45779)
W20260207 20:52:36.445309 5136 leader_election.cc:343] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer db40719931e143418375cd82197cd884 (127.2.223.3:45779): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:36.453243 5030 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:52:36.456238 4968 catalog_manager.cc:5654] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 reported cstate change: term changed from 0 to 1, leader changed from <none> to db40719931e143418375cd82197cd884 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "db40719931e143418375cd82197cd884" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } health_report { overall_health: HEALTHY } } }
I20260207 20:52:36.462944 5095 raft_consensus.cc:2468] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c61b0da4b8543d0b9e6a6aa1619d32d in term 1.
I20260207 20:52:36.464121 5137 leader_election.cc:304] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d12db020ba0404797e6e0c883f82b80, 2c61b0da4b8543d0b9e6a6aa1619d32d; no voters: db40719931e143418375cd82197cd884
I20260207 20:52:36.465018 5313 raft_consensus.cc:2804] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:36.479403 5313 raft_consensus.cc:697] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 LEADER]: Becoming Leader. State: Replica: 2c61b0da4b8543d0b9e6a6aa1619d32d, State: Running, Role: LEADER
I20260207 20:52:36.487574 5173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c084406891b945d587d28330fd61cb2c" candidate_uuid: "0d12db020ba0404797e6e0c883f82b80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" is_pre_election: true
I20260207 20:52:36.487969 5262 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "0d12db020ba0404797e6e0c883f82b80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db40719931e143418375cd82197cd884" is_pre_election: true
I20260207 20:52:36.488193 5263 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c084406891b945d587d28330fd61cb2c" candidate_uuid: "0d12db020ba0404797e6e0c883f82b80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db40719931e143418375cd82197cd884" is_pre_election: true
I20260207 20:52:36.489271 5331 raft_consensus.cc:493] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260207 20:52:36.489516 5058 leader_election.cc:343] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer db40719931e143418375cd82197cd884 (127.2.223.3:45779): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:36.491410 5310 tablet_bootstrap.cc:492] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80: No bootstrap required, opened a new log
I20260207 20:52:36.491916 5313 consensus_queue.cc:237] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
W20260207 20:52:36.493475 5058 leader_election.cc:343] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer db40719931e143418375cd82197cd884 (127.2.223.3:45779): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:36.493911 5058 leader_election.cc:304] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d12db020ba0404797e6e0c883f82b80; no voters: 2c61b0da4b8543d0b9e6a6aa1619d32d, db40719931e143418375cd82197cd884
I20260207 20:52:36.495350 5317 raft_consensus.cc:2749] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:52:36.497893 5173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "0d12db020ba0404797e6e0c883f82b80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" is_pre_election: true
I20260207 20:52:36.499251 5310 ts_tablet_manager.cc:1403] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80: Time spent bootstrapping tablet: real 0.133s user 0.012s sys 0.016s
I20260207 20:52:36.500917 5331 raft_consensus.cc:515] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.501883 5173 raft_consensus.cc:2468] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d12db020ba0404797e6e0c883f82b80 in term 0.
I20260207 20:52:36.505000 5059 leader_election.cc:304] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d12db020ba0404797e6e0c883f82b80, 2c61b0da4b8543d0b9e6a6aa1619d32d; no voters: db40719931e143418375cd82197cd884
I20260207 20:52:36.506112 5317 raft_consensus.cc:2804] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:36.506491 5317 raft_consensus.cc:493] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:36.506851 5317 raft_consensus.cc:3060] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:36.508701 5095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d12db020ba0404797e6e0c883f82b80" is_pre_election: true
I20260207 20:52:36.508867 5331 leader_election.cc:290] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:36.512826 5263 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db40719931e143418375cd82197cd884" is_pre_election: true
I20260207 20:52:36.516593 5310 raft_consensus.cc:359] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.517329 5310 raft_consensus.cc:385] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:36.517616 5310 raft_consensus.cc:740] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d12db020ba0404797e6e0c883f82b80, State: Initialized, Role: FOLLOWER
I20260207 20:52:36.518352 5310 consensus_queue.cc:260] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.519841 5317 raft_consensus.cc:515] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.521353 5095 raft_consensus.cc:2393] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c61b0da4b8543d0b9e6a6aa1619d32d in current term 1: Already voted for candidate 0d12db020ba0404797e6e0c883f82b80 in this term.
I20260207 20:52:36.521808 5311 tablet_bootstrap.cc:492] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884: No bootstrap required, opened a new log
I20260207 20:52:36.522289 5311 ts_tablet_manager.cc:1403] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884: Time spent bootstrapping tablet: real 0.194s user 0.026s sys 0.006s
I20260207 20:52:36.524535 5173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "0d12db020ba0404797e6e0c883f82b80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d"
I20260207 20:52:36.524811 5311 raft_consensus.cc:359] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.525516 5311 raft_consensus.cc:385] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:36.525839 5311 raft_consensus.cc:740] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db40719931e143418375cd82197cd884, State: Initialized, Role: FOLLOWER
I20260207 20:52:36.525152 5173 raft_consensus.cc:3060] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 0 FOLLOWER]: Advancing to term 1
W20260207 20:52:36.529661 5136 leader_election.cc:343] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer db40719931e143418375cd82197cd884 (127.2.223.3:45779): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:36.530108 5136 leader_election.cc:304] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c61b0da4b8543d0b9e6a6aa1619d32d; no voters: 0d12db020ba0404797e6e0c883f82b80, db40719931e143418375cd82197cd884
I20260207 20:52:36.534956 5310 ts_tablet_manager.cc:1434] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80: Time spent starting tablet: real 0.035s user 0.009s sys 0.010s
I20260207 20:52:36.539414 5173 raft_consensus.cc:2468] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d12db020ba0404797e6e0c883f82b80 in term 1.
I20260207 20:52:36.540612 5059 leader_election.cc:304] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d12db020ba0404797e6e0c883f82b80, 2c61b0da4b8543d0b9e6a6aa1619d32d; no voters:
I20260207 20:52:36.540856 5313 raft_consensus.cc:2749] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:52:36.541666 5335 raft_consensus.cc:2804] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:36.543115 5317 leader_election.cc:290] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 1 election: Requested vote from peers 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883), db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:36.544135 5263 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "0d12db020ba0404797e6e0c883f82b80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db40719931e143418375cd82197cd884"
W20260207 20:52:36.545207 5058 leader_election.cc:343] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer db40719931e143418375cd82197cd884 (127.2.223.3:45779): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:36.546247 5311 consensus_queue.cc:260] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.546767 4968 catalog_manager.cc:5654] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2). New cstate: current_term: 1 leader_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:36.549358 5311 ts_tablet_manager.cc:1434] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884: Time spent starting tablet: real 0.027s user 0.006s sys 0.000s
I20260207 20:52:36.552230 5335 raft_consensus.cc:697] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 1 LEADER]: Becoming Leader. State: Replica: 0d12db020ba0404797e6e0c883f82b80, State: Running, Role: LEADER
I20260207 20:52:36.553165 5335 consensus_queue.cc:237] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.567813 4970 catalog_manager.cc:5654] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "0d12db020ba0404797e6e0c883f82b80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:36.574214 5311 tablet_bootstrap.cc:492] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884: Bootstrap starting.
I20260207 20:52:36.581665 5311 tablet_bootstrap.cc:654] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:36.602658 5311 tablet_bootstrap.cc:492] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884: No bootstrap required, opened a new log
I20260207 20:52:36.603192 5311 ts_tablet_manager.cc:1403] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884: Time spent bootstrapping tablet: real 0.029s user 0.018s sys 0.008s
I20260207 20:52:36.605564 5311 raft_consensus.cc:359] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.606089 5311 raft_consensus.cc:385] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:36.606324 5311 raft_consensus.cc:740] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db40719931e143418375cd82197cd884, State: Initialized, Role: FOLLOWER
I20260207 20:52:36.606914 5311 consensus_queue.cc:260] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.609099 5311 ts_tablet_manager.cc:1434] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260207 20:52:36.745759 5318 raft_consensus.cc:493] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:36.746387 5318 raft_consensus.cc:515] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.748459 5318 leader_election.cc:290] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883)
I20260207 20:52:36.750670 5095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "db40719931e143418375cd82197cd884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d12db020ba0404797e6e0c883f82b80" is_pre_election: true
I20260207 20:52:36.752969 5173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "db40719931e143418375cd82197cd884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" is_pre_election: true
I20260207 20:52:36.753796 5173 raft_consensus.cc:2393] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate db40719931e143418375cd82197cd884 in current term 1: Already voted for candidate 0d12db020ba0404797e6e0c883f82b80 in this term.
I20260207 20:52:36.755414 5227 leader_election.cc:304] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: db40719931e143418375cd82197cd884; no voters: 0d12db020ba0404797e6e0c883f82b80, 2c61b0da4b8543d0b9e6a6aa1619d32d
I20260207 20:52:36.760952 5318 raft_consensus.cc:3060] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:36.766947 5319 raft_consensus.cc:493] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:36.767491 5319 raft_consensus.cc:515] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:36.769546 5319 leader_election.cc:290] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883)
I20260207 20:52:36.771920 5095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c084406891b945d587d28330fd61cb2c" candidate_uuid: "db40719931e143418375cd82197cd884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d12db020ba0404797e6e0c883f82b80" is_pre_election: true
I20260207 20:52:36.772787 5095 raft_consensus.cc:2393] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate db40719931e143418375cd82197cd884 in current term 1: Already voted for candidate 2c61b0da4b8543d0b9e6a6aa1619d32d in this term.
I20260207 20:52:36.774078 5173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c084406891b945d587d28330fd61cb2c" candidate_uuid: "db40719931e143418375cd82197cd884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" is_pre_election: true
I20260207 20:52:36.775977 5227 leader_election.cc:304] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: db40719931e143418375cd82197cd884; no voters: 0d12db020ba0404797e6e0c883f82b80, 2c61b0da4b8543d0b9e6a6aa1619d32d
I20260207 20:52:36.777128 5319 raft_consensus.cc:3060] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:36.784629 5319 raft_consensus.cc:2749] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:52:36.831822 5318 raft_consensus.cc:2749] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:52:36.836525 5319 consensus_queue.cc:1048] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260207 20:52:37.086521 5313 consensus_queue.cc:1048] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [LEADER]: Connected to new peer: Peer: permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260207 20:52:37.692880 5173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.851s user 0.004s sys 0.005s
W20260207 20:52:37.693279 5173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s user 0.004s sys 0.005s
W20260207 20:52:37.816217 5313 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s user 0.015s sys 0.005s
W20260207 20:52:37.816561 5313 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s user 0.015s sys 0.005s
I20260207 20:52:38.513377 5313 raft_consensus.cc:493] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:38.514815 5313 raft_consensus.cc:515] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:38.519356 5313 leader_election.cc:290] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:38.520746 5263 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db40719931e143418375cd82197cd884" is_pre_election: true
I20260207 20:52:38.521834 5263 raft_consensus.cc:2468] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c61b0da4b8543d0b9e6a6aa1619d32d in term 1.
I20260207 20:52:38.523864 5136 leader_election.cc:304] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c61b0da4b8543d0b9e6a6aa1619d32d, db40719931e143418375cd82197cd884; no voters:
I20260207 20:52:38.524775 5313 raft_consensus.cc:2804] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260207 20:52:38.525252 5313 raft_consensus.cc:493] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:38.525663 5313 raft_consensus.cc:3060] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:52:38.538416 5346 raft_consensus.cc:493] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:38.540160 5346 raft_consensus.cc:515] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:38.545431 5346 leader_election.cc:290] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883)
I20260207 20:52:38.547927 5313 raft_consensus.cc:515] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:38.550540 5313 leader_election.cc:290] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 2 election: Requested vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:38.551323 5263 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db40719931e143418375cd82197cd884"
I20260207 20:52:38.551957 5263 raft_consensus.cc:3060] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:52:38.559769 5263 raft_consensus.cc:2468] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c61b0da4b8543d0b9e6a6aa1619d32d in term 2.
I20260207 20:52:38.560992 5136 leader_election.cc:304] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c61b0da4b8543d0b9e6a6aa1619d32d, db40719931e143418375cd82197cd884; no voters:
I20260207 20:52:38.564625 5313 raft_consensus.cc:2804] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 2 FOLLOWER]: Leader election won for term 2
I20260207 20:52:38.565856 5313 raft_consensus.cc:697] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 2 LEADER]: Becoming Leader. State: Replica: 2c61b0da4b8543d0b9e6a6aa1619d32d, State: Running, Role: LEADER
I20260207 20:52:38.567164 5313 consensus_queue.cc:237] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:38.595028 5348 raft_consensus.cc:493] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:38.595886 5348 raft_consensus.cc:515] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:38.600812 5094 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "db40719931e143418375cd82197cd884" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d12db020ba0404797e6e0c883f82b80" is_pre_election: true
I20260207 20:52:38.601171 5348 leader_election.cc:290] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883), db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:38.601955 5263 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25095d0fbe84afca252ca473e84894a" candidate_uuid: "0d12db020ba0404797e6e0c883f82b80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db40719931e143418375cd82197cd884" is_pre_election: true
I20260207 20:52:38.606110 5349 raft_consensus.cc:493] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader db40719931e143418375cd82197cd884)
I20260207 20:52:38.606721 5349 raft_consensus.cc:515] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:38.609858 5313 consensus_queue.cc:1048] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260207 20:52:38.615845 5349 leader_election.cc:290] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:38.619971 5263 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25095d0fbe84afca252ca473e84894a" candidate_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "db40719931e143418375cd82197cd884" is_pre_election: true
I20260207 20:52:38.625293 5093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d12db020ba0404797e6e0c883f82b80"
I20260207 20:52:38.627099 5093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25095d0fbe84afca252ca473e84894a" candidate_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d12db020ba0404797e6e0c883f82b80" is_pre_election: true
I20260207 20:52:38.627732 5093 raft_consensus.cc:2468] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c61b0da4b8543d0b9e6a6aa1619d32d in term 0.
I20260207 20:52:38.629132 5094 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d12db020ba0404797e6e0c883f82b80" is_pre_election: true
I20260207 20:52:38.635018 5137 leader_election.cc:304] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d12db020ba0404797e6e0c883f82b80, 2c61b0da4b8543d0b9e6a6aa1619d32d; no voters: db40719931e143418375cd82197cd884
I20260207 20:52:38.637521 5355 raft_consensus.cc:2804] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260207 20:52:38.640439 5263 raft_consensus.cc:1240] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Rejecting Update request from peer 0d12db020ba0404797e6e0c883f82b80 for earlier term 1. Current term is 2. Ops: []
I20260207 20:52:38.642302 5348 consensus_queue.cc:1059] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260207 20:52:38.644586 5352 raft_consensus.cc:3055] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 1 LEADER]: Stepping down as leader of term 1
I20260207 20:52:38.644901 5355 raft_consensus.cc:493] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Starting leader election (detected failure of leader db40719931e143418375cd82197cd884)
I20260207 20:52:38.645008 5352 raft_consensus.cc:740] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d12db020ba0404797e6e0c883f82b80, State: Running, Role: LEADER
I20260207 20:52:38.645403 5355 raft_consensus.cc:3060] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:52:38.646268 5352 consensus_queue.cc:260] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:38.647524 5354 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5801a8c4831741f7ad11cb9322be194c)
I20260207 20:52:38.647951 5352 raft_consensus.cc:3060] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:52:38.648087 5354 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:38.650665 5354 leader_election.cc:290] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c2f1171cc6d4e649889d232bc06ab6b (127.2.223.62:33815), 5801a8c4831741f7ad11cb9322be194c (127.2.223.60:37581)
I20260207 20:52:38.655730 5355 raft_consensus.cc:515] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:38.659240 5355 leader_election.cc:290] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 2 election: Requested vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:38.659147 5263 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25095d0fbe84afca252ca473e84894a" candidate_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "db40719931e143418375cd82197cd884"
I20260207 20:52:38.659147 5094 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25095d0fbe84afca252ca473e84894a" candidate_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d12db020ba0404797e6e0c883f82b80"
I20260207 20:52:38.660951 5094 raft_consensus.cc:3060] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 0 FOLLOWER]: Advancing to term 2
I20260207 20:52:38.668020 5094 raft_consensus.cc:2468] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c61b0da4b8543d0b9e6a6aa1619d32d in term 2.
I20260207 20:52:38.669555 5137 leader_election.cc:304] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d12db020ba0404797e6e0c883f82b80, 2c61b0da4b8543d0b9e6a6aa1619d32d; no voters: db40719931e143418375cd82197cd884
I20260207 20:52:38.671039 5355 raft_consensus.cc:2804] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 2 FOLLOWER]: Leader election won for term 2
I20260207 20:52:38.680810 5355 raft_consensus.cc:697] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 2 LEADER]: Becoming Leader. State: Replica: 2c61b0da4b8543d0b9e6a6aa1619d32d, State: Running, Role: LEADER
I20260207 20:52:38.689471 4969 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57176 (request call id 49) took 2050 ms. Trace:
I20260207 20:52:38.690006 4969 rpcz_store.cc:276] 0207 20:52:36.639213 (+ 0us) service_pool.cc:168] Inserting onto call queue
0207 20:52:38.687834 (+2048621us) service_pool.cc:225] Handling call
0207 20:52:38.689305 (+ 1471us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":0}
I20260207 20:52:38.691530 5095 raft_consensus.cc:1240] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Rejecting Update request from peer db40719931e143418375cd82197cd884 for earlier term 1. Current term is 2. Ops: []
I20260207 20:52:38.681917 5355 consensus_queue.cc:237] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:38.694954 4850 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2464c47b32c54b37ae6219d7559bf264" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" is_pre_election: true
I20260207 20:52:38.697268 5360 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5801a8c4831741f7ad11cb9322be194c)
I20260207 20:52:38.697836 5360 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:38.701261 4915 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "2464c47b32c54b37ae6219d7559bf264" is_pre_election: true
I20260207 20:52:38.701953 4980 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "5801a8c4831741f7ad11cb9322be194c" is_pre_election: true
I20260207 20:52:38.702026 4915 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c2f1171cc6d4e649889d232bc06ab6b in term 1.
I20260207 20:52:38.704540 4824 leader_election.cc:304] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2464c47b32c54b37ae6219d7559bf264, 6c2f1171cc6d4e649889d232bc06ab6b; no voters: 5801a8c4831741f7ad11cb9322be194c
I20260207 20:52:38.709481 5360 leader_election.cc:290] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2464c47b32c54b37ae6219d7559bf264 (127.2.223.61:36845), 5801a8c4831741f7ad11cb9322be194c (127.2.223.60:37581)
I20260207 20:52:38.710508 5360 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260207 20:52:38.711489 5360 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5801a8c4831741f7ad11cb9322be194c)
I20260207 20:52:38.712297 5360 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:52:38.724669 5360 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:38.727460 4915 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "2464c47b32c54b37ae6219d7559bf264"
I20260207 20:52:38.731003 4980 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "5801a8c4831741f7ad11cb9322be194c"
I20260207 20:52:38.732679 4824 leader_election.cc:304] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c2f1171cc6d4e649889d232bc06ab6b; no voters: 2464c47b32c54b37ae6219d7559bf264, 5801a8c4831741f7ad11cb9322be194c
I20260207 20:52:38.733909 5363 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260207 20:52:38.734783 5360 leader_election.cc:290] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [CANDIDATE]: Term 2 election: Requested vote from peers 2464c47b32c54b37ae6219d7559bf264 (127.2.223.61:36845), 5801a8c4831741f7ad11cb9322be194c (127.2.223.60:37581)
I20260207 20:52:38.748785 5346 consensus_queue.cc:1059] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260207 20:52:38.751835 5346 raft_consensus.cc:3055] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 1 LEADER]: Stepping down as leader of term 1
I20260207 20:52:38.752281 5346 raft_consensus.cc:740] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: db40719931e143418375cd82197cd884, State: Running, Role: LEADER
I20260207 20:52:38.753399 5346 consensus_queue.cc:260] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:38.754653 5346 raft_consensus.cc:3060] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:52:38.765614 5173 raft_consensus.cc:1240] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 2 LEADER]: Rejecting Update request from peer 0d12db020ba0404797e6e0c883f82b80 for earlier term 1. Current term is 2. Ops: []
I20260207 20:52:38.777602 4980 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2464c47b32c54b37ae6219d7559bf264" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "5801a8c4831741f7ad11cb9322be194c" is_pre_election: true
I20260207 20:52:38.778321 5172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25095d0fbe84afca252ca473e84894a" candidate_uuid: "0d12db020ba0404797e6e0c883f82b80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" is_pre_election: true
I20260207 20:52:38.779767 4889 leader_election.cc:304] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2464c47b32c54b37ae6219d7559bf264; no voters: 5801a8c4831741f7ad11cb9322be194c, 6c2f1171cc6d4e649889d232bc06ab6b
I20260207 20:52:38.779990 5059 leader_election.cc:304] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d12db020ba0404797e6e0c883f82b80; no voters: 2c61b0da4b8543d0b9e6a6aa1619d32d, db40719931e143418375cd82197cd884
I20260207 20:52:38.781195 5352 raft_consensus.cc:2749] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:52:38.781826 5354 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260207 20:52:38.800530 5172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "db40719931e143418375cd82197cd884" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" is_pre_election: true
I20260207 20:52:38.803901 4970 catalog_manager.cc:5654] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d reported cstate change: term changed from 1 to 2, leader changed from db40719931e143418375cd82197cd884 (127.2.223.3) to 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2). New cstate: current_term: 2 leader_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:38.811841 5227 leader_election.cc:304] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: db40719931e143418375cd82197cd884; no voters: 0d12db020ba0404797e6e0c883f82b80, 2c61b0da4b8543d0b9e6a6aa1619d32d
I20260207 20:52:38.813174 5346 raft_consensus.cc:2749] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260207 20:52:38.813872 4970 catalog_manager.cc:5654] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d reported cstate change: term changed from 1 to 2, leader changed from 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1) to 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2). New cstate: current_term: 2 leader_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:38.905529 4850 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 2 FOLLOWER]: Rejecting Update request from peer 5801a8c4831741f7ad11cb9322be194c for earlier term 1. Current term is 2. Ops: [1.10-1.10]
I20260207 20:52:38.907444 5353 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 }, Status: INVALID_TERM, Last received: 1.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260207 20:52:38.908999 5350 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 1 LEADER]: Stepping down as leader of term 1
I20260207 20:52:38.909380 5350 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5801a8c4831741f7ad11cb9322be194c, State: Running, Role: LEADER
I20260207 20:52:38.910265 5350 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.10, Last appended by leader: 10, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:38.918835 5350 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:52:38.958612 5095 raft_consensus.cc:1275] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Refusing update from remote peer 2c61b0da4b8543d0b9e6a6aa1619d32d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260207 20:52:38.959007 5095 pending_rounds.cc:85] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80: Aborting all ops after (but not including) 0
I20260207 20:52:38.959280 5095 pending_rounds.cc:107] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260207 20:52:38.959524 5095 raft_consensus.cc:2889] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260207 20:52:38.961628 5355 consensus_queue.cc:1048] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:39.026135 5263 raft_consensus.cc:1275] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Refusing update from remote peer 2c61b0da4b8543d0b9e6a6aa1619d32d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260207 20:52:39.033982 5313 consensus_queue.cc:1048] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [LEADER]: Connected to new peer: Peer: permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:39.154520 5263 raft_consensus.cc:1275] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Refusing update from remote peer 2c61b0da4b8543d0b9e6a6aa1619d32d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260207 20:52:39.155962 5355 consensus_queue.cc:1048] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [LEADER]: Connected to new peer: Peer: permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:39.192083 5095 raft_consensus.cc:1275] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Refusing update from remote peer 2c61b0da4b8543d0b9e6a6aa1619d32d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260207 20:52:39.193709 5313 consensus_queue.cc:1048] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tools/ksck_remote-test.cc:361: Failure
Failed
Bad status: Corruption: there are master consensus conflicts
I20260207 20:52:39.212957 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
W20260207 20:52:39.461772 5137 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 30 similar messages]
W20260207 20:52:39.464736 5137 consensus_peers.cc:597] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d -> Peer 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961): Couldn't send request to peer 0d12db020ba0404797e6e0c883f82b80. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260207 20:52:39.601799 5137 consensus_peers.cc:597] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d -> Peer 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961): Couldn't send request to peer 0d12db020ba0404797e6e0c883f82b80. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260207 20:52:39.603180 5048 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260207 20:52:39.675385 5194 debug-util.cc:398] Leaking SignalData structure 0x7b08000f77e0 after lost signal to thread 2943
W20260207 20:52:39.678725 5194 debug-util.cc:398] Leaking SignalData structure 0x7b08001c1940 after lost signal to thread 5119
W20260207 20:52:39.679891 5194 debug-util.cc:398] Leaking SignalData structure 0x7b08002230c0 after lost signal to thread 5197
W20260207 20:52:39.680759 5194 debug-util.cc:398] Leaking SignalData structure 0x7b0800189a80 after lost signal to thread 5287
W20260207 20:52:39.790264 5137 consensus_peers.cc:597] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d -> Peer 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961): Couldn't send request to peer 0d12db020ba0404797e6e0c883f82b80. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260207 20:52:40.180053 5387 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:40.180575 5387 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:40.183753 5387 leader_election.cc:290] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c2f1171cc6d4e649889d232bc06ab6b (127.2.223.62:33815), 2464c47b32c54b37ae6219d7559bf264 (127.2.223.61:36845)
I20260207 20:52:40.185115 4915 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5801a8c4831741f7ad11cb9322be194c" candidate_term: 3 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "2464c47b32c54b37ae6219d7559bf264" is_pre_election: true
I20260207 20:52:40.185144 4850 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5801a8c4831741f7ad11cb9322be194c" candidate_term: 3 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" is_pre_election: true
I20260207 20:52:40.186044 4850 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801a8c4831741f7ad11cb9322be194c in term 2.
I20260207 20:52:40.187489 4956 leader_election.cc:304] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801a8c4831741f7ad11cb9322be194c, 6c2f1171cc6d4e649889d232bc06ab6b; no voters: 2464c47b32c54b37ae6219d7559bf264
I20260207 20:52:40.190142 5387 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260207 20:52:40.190770 5387 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:40.191130 5387 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 2 FOLLOWER]: Advancing to term 3
I20260207 20:52:40.196242 5387 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:40.197654 5387 leader_election.cc:290] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [CANDIDATE]: Term 3 election: Requested vote from peers 6c2f1171cc6d4e649889d232bc06ab6b (127.2.223.62:33815), 2464c47b32c54b37ae6219d7559bf264 (127.2.223.61:36845)
I20260207 20:52:40.198720 4850 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5801a8c4831741f7ad11cb9322be194c" candidate_term: 3 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "6c2f1171cc6d4e649889d232bc06ab6b"
I20260207 20:52:40.198748 4915 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5801a8c4831741f7ad11cb9322be194c" candidate_term: 3 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "2464c47b32c54b37ae6219d7559bf264"
I20260207 20:52:40.199309 4850 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 2 FOLLOWER]: Advancing to term 3
I20260207 20:52:40.209424 4850 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801a8c4831741f7ad11cb9322be194c in term 3.
I20260207 20:52:40.213680 4956 leader_election.cc:304] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801a8c4831741f7ad11cb9322be194c, 6c2f1171cc6d4e649889d232bc06ab6b; no voters: 2464c47b32c54b37ae6219d7559bf264
I20260207 20:52:40.214896 5387 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 3 FOLLOWER]: Leader election won for term 3
I20260207 20:52:40.217157 5387 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 3 LEADER]: Becoming Leader. State: Replica: 5801a8c4831741f7ad11cb9322be194c, State: Running, Role: LEADER
I20260207 20:52:40.219537 5387 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.10, Last appended by leader: 10, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:40.224524 5388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5801a8c4831741f7ad11cb9322be194c. Latest consensus state: current_term: 3 leader_uuid: "5801a8c4831741f7ad11cb9322be194c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:40.225214 5388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: This master's current role is: LEADER
W20260207 20:52:40.249513 2940 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 5120)
I20260207 20:52:40.415263 5391 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5801a8c4831741f7ad11cb9322be194c)
I20260207 20:52:40.415799 5391 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } }
I20260207 20:52:40.417603 5391 leader_election.cc:290] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c2f1171cc6d4e649889d232bc06ab6b (127.2.223.62:33815), 5801a8c4831741f7ad11cb9322be194c (127.2.223.60:37581)
I20260207 20:52:40.418232 4850 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2464c47b32c54b37ae6219d7559bf264" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" is_pre_election: true
I20260207 20:52:40.419013 4850 raft_consensus.cc:2368] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2464c47b32c54b37ae6219d7559bf264 for earlier term 2. Current term is 3.
I20260207 20:52:40.420178 4891 leader_election.cc:400] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6c2f1171cc6d4e649889d232bc06ab6b (127.2.223.62:33815) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2464c47b32c54b37ae6219d7559bf264 for earlier term 2. Current term is 3.
I20260207 20:52:40.420430 4891 leader_election.cc:403] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260207 20:52:40.420965 5391 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 1 FOLLOWER]: Advancing to term 3
I20260207 20:52:40.422091 4980 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2464c47b32c54b37ae6219d7559bf264" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "5801a8c4831741f7ad11cb9322be194c" is_pre_election: true
I20260207 20:52:40.428090 5391 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6c2f1171cc6d4e649889d232bc06ab6b (127.2.223.62:33815) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2464c47b32c54b37ae6219d7559bf264 for earlier term 2. Current term is 3.
I20260207 20:52:40.529709 5392 raft_consensus.cc:493] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c61b0da4b8543d0b9e6a6aa1619d32d)
I20260207 20:52:40.530125 5392 raft_consensus.cc:515] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:40.532683 5172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "0d12db020ba0404797e6e0c883f82b80" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" is_pre_election: true
I20260207 20:52:40.532925 5262 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed25aea2e18e46f7b6c6d32e33e3a085" candidate_uuid: "0d12db020ba0404797e6e0c883f82b80" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "db40719931e143418375cd82197cd884" is_pre_election: true
I20260207 20:52:40.532265 5392 leader_election.cc:290] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883), db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:40.534786 5059 leader_election.cc:304] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d12db020ba0404797e6e0c883f82b80; no voters: 2c61b0da4b8543d0b9e6a6aa1619d32d, db40719931e143418375cd82197cd884
I20260207 20:52:40.535593 5392 raft_consensus.cc:2749] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260207 20:52:40.696179 5392 raft_consensus.cc:493] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c61b0da4b8543d0b9e6a6aa1619d32d)
I20260207 20:52:40.696691 5392 raft_consensus.cc:515] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:40.698522 5392 leader_election.cc:290] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883), db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:40.699144 5172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c084406891b945d587d28330fd61cb2c" candidate_uuid: "0d12db020ba0404797e6e0c883f82b80" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" is_pre_election: true
I20260207 20:52:40.700249 5262 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c084406891b945d587d28330fd61cb2c" candidate_uuid: "0d12db020ba0404797e6e0c883f82b80" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "db40719931e143418375cd82197cd884" is_pre_election: true
I20260207 20:52:40.701264 5392 raft_consensus.cc:493] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c61b0da4b8543d0b9e6a6aa1619d32d)
I20260207 20:52:40.701733 5392 raft_consensus.cc:515] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:40.701747 5058 leader_election.cc:304] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d12db020ba0404797e6e0c883f82b80; no voters: 2c61b0da4b8543d0b9e6a6aa1619d32d, db40719931e143418375cd82197cd884
I20260207 20:52:40.703912 5392 leader_election.cc:290] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883), db40719931e143418375cd82197cd884 (127.2.223.3:45779)
I20260207 20:52:40.704185 5172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25095d0fbe84afca252ca473e84894a" candidate_uuid: "0d12db020ba0404797e6e0c883f82b80" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" is_pre_election: true
I20260207 20:52:40.704417 5392 raft_consensus.cc:2749] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260207 20:52:40.711694 5262 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f25095d0fbe84afca252ca473e84894a" candidate_uuid: "0d12db020ba0404797e6e0c883f82b80" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "db40719931e143418375cd82197cd884" is_pre_election: true
I20260207 20:52:40.712965 5058 leader_election.cc:304] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d12db020ba0404797e6e0c883f82b80; no voters: 2c61b0da4b8543d0b9e6a6aa1619d32d, db40719931e143418375cd82197cd884
I20260207 20:52:40.713644 5393 raft_consensus.cc:2749] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260207 20:52:40.720479 4850 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 3 FOLLOWER]: Refusing update from remote peer 5801a8c4831741f7ad11cb9322be194c: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 3 index: 11. (index mismatch)
I20260207 20:52:40.722084 5388 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260207 20:52:40.735677 5394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5801a8c4831741f7ad11cb9322be194c. Latest consensus state: current_term: 3 leader_uuid: "5801a8c4831741f7ad11cb9322be194c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:40.738969 5394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:40.745467 4915 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 3 FOLLOWER]: Refusing update from remote peer 5801a8c4831741f7ad11cb9322be194c: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 3 index: 11. (index mismatch)
I20260207 20:52:40.748008 5397 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260207 20:52:40.754565 4970 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57176 (request call id 50) took 2009 ms. Trace:
I20260207 20:52:40.757313 4969 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57172 (request call id 62) took 1966 ms. Trace:
I20260207 20:52:40.763937 5388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "5801a8c4831741f7ad11cb9322be194c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:40.764298 4969 rpcz_store.cc:276] 0207 20:52:38.790933 (+ 0us) service_pool.cc:168] Inserting onto call queue
0207 20:52:38.792526 (+ 1593us) service_pool.cc:225] Handling call
0207 20:52:40.757240 (+1964714us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1288,"reported_tablets":1}
I20260207 20:52:40.764719 5388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:40.762324 4970 rpcz_store.cc:276] 0207 20:52:38.745143 (+ 0us) service_pool.cc:168] Inserting onto call queue
0207 20:52:38.745342 (+ 199us) service_pool.cc:225] Handling call
0207 20:52:40.754478 (+2009136us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0207 20:52:38.847402 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0207 20:52:38.849359 (+ 1957us) write_op.cc:432] Acquiring schema lock in shared mode
0207 20:52:38.849389 (+ 30us) write_op.cc:435] Acquired schema lock
0207 20:52:38.849405 (+ 16us) tablet.cc:660] Decoding operations
0207 20:52:38.867643 (+ 18238us) write_op.cc:620] Acquiring the partition lock for write op
0207 20:52:38.867734 (+ 91us) write_op.cc:641] Partition lock acquired for write op
0207 20:52:38.867762 (+ 28us) tablet.cc:683] Acquiring locks for 2 operations
0207 20:52:38.868162 (+ 400us) tablet.cc:699] Row locks acquired
0207 20:52:38.868181 (+ 19us) write_op.cc:260] PREPARE: finished
0207 20:52:38.868359 (+ 178us) write_op.cc:270] Start()
0207 20:52:38.870207 (+ 1848us) write_op.cc:276] Timestamp: P: 1770497558868311 usec, L: 0
0207 20:52:38.870245 (+ 38us) op_driver.cc:348] REPLICATION: starting
0207 20:52:38.870971 (+ 726us) log.cc:844] Serialized 912 byte log entry
0207 20:52:40.740798 (+1869827us) op_driver.cc:464] REPLICATION: finished
0207 20:52:40.744618 (+ 3820us) write_op.cc:301] APPLY: starting
0207 20:52:40.744704 (+ 86us) tablet.cc:1365] starting BulkCheckPresence
0207 20:52:40.746500 (+ 1796us) tablet.cc:1368] finished BulkCheckPresence
0207 20:52:40.746649 (+ 149us) tablet.cc:1370] starting ApplyRowOperation cycle
0207 20:52:40.746901 (+ 252us) tablet.cc:1381] finished ApplyRowOperation cycle
0207 20:52:40.747135 (+ 234us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0207 20:52:40.747177 (+ 42us) write_op.cc:312] APPLY: finished
0207 20:52:40.747444 (+ 267us) log.cc:844] Serialized 28 byte log entry
0207 20:52:40.747600 (+ 156us) write_op.cc:489] Releasing partition, row and schema locks
0207 20:52:40.747682 (+ 82us) write_op.cc:454] Released schema lock
0207 20:52:40.747721 (+ 39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":3573,"num_ops":2,"prepare.queue_time_us":27572,"prepare.run_cpu_time_us":9915,"prepare.run_wall_time_us":75419,"raft.queue_time_us":189,"raft.run_cpu_time_us":1881,"raft.run_wall_time_us":1886,"replication_time_us":1870421,"thread_start_us":57375,"threads_started":3,"wal-append.queue_time_us":23566,"wal-append.run_cpu_time_us":1669,"wal-append.run_wall_time_us":1037207}]]}
I20260207 20:52:40.789841 5391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5801a8c4831741f7ad11cb9322be194c. Latest consensus state: current_term: 3 leader_uuid: "5801a8c4831741f7ad11cb9322be194c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:40.792892 5391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:40.793807 5404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "5801a8c4831741f7ad11cb9322be194c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:40.794551 5404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:40.799852 5394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "5801a8c4831741f7ad11cb9322be194c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:40.800549 5394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:40.802609 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:40.803349 2940 tablet_replica.cc:333] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80: stopping tablet replica
I20260207 20:52:40.804037 2940 raft_consensus.cc:2243] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:40.804587 2940 raft_consensus.cc:2272] T f25095d0fbe84afca252ca473e84894a P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:40.807432 2940 tablet_replica.cc:333] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80: stopping tablet replica
I20260207 20:52:40.808003 2940 raft_consensus.cc:2243] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:40.808708 2940 raft_consensus.cc:2272] T ed25aea2e18e46f7b6c6d32e33e3a085 P 0d12db020ba0404797e6e0c883f82b80 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:40.813272 2940 tablet_replica.cc:333] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80: stopping tablet replica
I20260207 20:52:40.813885 2940 raft_consensus.cc:2243] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:40.814424 2940 raft_consensus.cc:2272] T c084406891b945d587d28330fd61cb2c P 0d12db020ba0404797e6e0c883f82b80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:40.844494 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:52:40.865350 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:52:40.889982 5390 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:52:40.906523 5390 catalog_manager.cc:679] Loaded metadata for table ksck-test-table [id=bb24a52ed913454a923fc9f0eb268d90]
I20260207 20:52:40.922482 5390 tablet_loader.cc:96] loaded metadata for tablet c084406891b945d587d28330fd61cb2c (table ksck-test-table [id=bb24a52ed913454a923fc9f0eb268d90])
I20260207 20:52:40.924063 5390 tablet_loader.cc:96] loaded metadata for tablet ed25aea2e18e46f7b6c6d32e33e3a085 (table ksck-test-table [id=bb24a52ed913454a923fc9f0eb268d90])
I20260207 20:52:40.925563 5390 tablet_loader.cc:96] loaded metadata for tablet f25095d0fbe84afca252ca473e84894a (table ksck-test-table [id=bb24a52ed913454a923fc9f0eb268d90])
I20260207 20:52:40.926128 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:40.926947 2940 tablet_replica.cc:333] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d: stopping tablet replica
I20260207 20:52:40.927690 5390 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:52:40.929175 2940 raft_consensus.cc:2243] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 2 LEADER]: Raft consensus shutting down.
I20260207 20:52:40.930137 2940 raft_consensus.cc:2272] T ed25aea2e18e46f7b6c6d32e33e3a085 P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:40.931080 5390 catalog_manager.cc:1269] Loaded cluster ID: 8848db71dfc94b4f89c2afd1dbd1e55b
I20260207 20:52:40.931332 5390 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:52:40.932524 2940 tablet_replica.cc:333] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d: stopping tablet replica
I20260207 20:52:40.933184 2940 raft_consensus.cc:2243] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 2 LEADER]: Raft consensus shutting down.
I20260207 20:52:40.935118 2940 raft_consensus.cc:2272] T f25095d0fbe84afca252ca473e84894a P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:40.935608 5390 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:52:40.937563 2940 tablet_replica.cc:333] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d: stopping tablet replica
I20260207 20:52:40.938177 2940 raft_consensus.cc:2243] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:40.939113 2940 raft_consensus.cc:2272] T c084406891b945d587d28330fd61cb2c P 2c61b0da4b8543d0b9e6a6aa1619d32d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:40.939154 5390 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c: Loaded TSK: 0
I20260207 20:52:40.940446 5390 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:52:40.959470 5288 heartbeater.cc:499] Master 127.2.223.60:37581 was elected leader, sending a full tablet report...
I20260207 20:52:41.154175 5397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "5801a8c4831741f7ad11cb9322be194c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c2f1171cc6d4e649889d232bc06ab6b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33815 } } peers { permanent_uuid: "2464c47b32c54b37ae6219d7559bf264" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36845 } } peers { permanent_uuid: "5801a8c4831741f7ad11cb9322be194c" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37581 } } }
I20260207 20:52:41.154953 5397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:41.926923 5405 raft_consensus.cc:493] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c61b0da4b8543d0b9e6a6aa1619d32d)
I20260207 20:52:41.927460 5405 raft_consensus.cc:515] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:41.929328 5405 leader_election.cc:290] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883)
W20260207 20:52:41.936447 5227 leader_election.cc:336] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961): Network error: Client connection negotiation failed: client connection to 127.2.223.1:32961: connect: Connection refused (error 111)
W20260207 20:52:41.937120 5227 leader_election.cc:336] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883): Network error: Client connection negotiation failed: client connection to 127.2.223.2:45883: connect: Connection refused (error 111)
I20260207 20:52:41.937546 5227 leader_election.cc:304] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: db40719931e143418375cd82197cd884; no voters: 0d12db020ba0404797e6e0c883f82b80, 2c61b0da4b8543d0b9e6a6aa1619d32d
I20260207 20:52:41.938242 5405 raft_consensus.cc:2749] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260207 20:52:41.961889 2940 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 5194)
I20260207 20:52:42.389125 5405 raft_consensus.cc:493] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c61b0da4b8543d0b9e6a6aa1619d32d)
I20260207 20:52:42.389577 5405 raft_consensus.cc:515] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:42.391299 5405 leader_election.cc:290] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883)
W20260207 20:52:42.395737 5227 leader_election.cc:336] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961): Network error: Client connection negotiation failed: client connection to 127.2.223.1:32961: connect: Connection refused (error 111)
W20260207 20:52:42.396445 5227 leader_election.cc:336] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883): Network error: Client connection negotiation failed: client connection to 127.2.223.2:45883: connect: Connection refused (error 111)
I20260207 20:52:42.396762 5227 leader_election.cc:304] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: db40719931e143418375cd82197cd884; no voters: 0d12db020ba0404797e6e0c883f82b80, 2c61b0da4b8543d0b9e6a6aa1619d32d
I20260207 20:52:42.397308 5405 raft_consensus.cc:2749] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260207 20:52:42.419250 5405 raft_consensus.cc:493] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c61b0da4b8543d0b9e6a6aa1619d32d)
I20260207 20:52:42.419764 5405 raft_consensus.cc:515] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d12db020ba0404797e6e0c883f82b80" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 32961 } } peers { permanent_uuid: "2c61b0da4b8543d0b9e6a6aa1619d32d" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45883 } } peers { permanent_uuid: "db40719931e143418375cd82197cd884" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45779 } }
I20260207 20:52:42.422794 5405 leader_election.cc:290] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961), 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883)
W20260207 20:52:42.425616 5227 leader_election.cc:336] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0d12db020ba0404797e6e0c883f82b80 (127.2.223.1:32961): Network error: Client connection negotiation failed: client connection to 127.2.223.1:32961: connect: Connection refused (error 111)
W20260207 20:52:42.426983 5227 leader_election.cc:336] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2c61b0da4b8543d0b9e6a6aa1619d32d (127.2.223.2:45883): Network error: Client connection negotiation failed: client connection to 127.2.223.2:45883: connect: Connection refused (error 111)
I20260207 20:52:42.427378 5227 leader_election.cc:304] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: db40719931e143418375cd82197cd884; no voters: 0d12db020ba0404797e6e0c883f82b80, 2c61b0da4b8543d0b9e6a6aa1619d32d
I20260207 20:52:42.427942 5405 raft_consensus.cc:2749] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260207 20:52:42.962282 2940 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 5194)
I20260207 20:52:43.074616 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:52:43.087235 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:52:43.109865 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:43.110425 2940 tablet_replica.cc:333] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884: stopping tablet replica
I20260207 20:52:43.110967 2940 raft_consensus.cc:2243] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:43.111344 2940 raft_consensus.cc:2272] T ed25aea2e18e46f7b6c6d32e33e3a085 P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:43.113027 2940 tablet_replica.cc:333] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884: stopping tablet replica
I20260207 20:52:43.113503 2940 raft_consensus.cc:2243] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:43.113895 2940 raft_consensus.cc:2272] T c084406891b945d587d28330fd61cb2c P db40719931e143418375cd82197cd884 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:43.115506 2940 tablet_replica.cc:333] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884: stopping tablet replica
I20260207 20:52:43.115881 2940 raft_consensus.cc:2243] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:43.116204 2940 raft_consensus.cc:2272] T f25095d0fbe84afca252ca473e84894a P db40719931e143418375cd82197cd884 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:43.135808 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:52:43.146925 2940 master.cc:561] Master@127.2.223.62:33815 shutting down...
I20260207 20:52:43.167418 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:43.167938 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:43.168200 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6c2f1171cc6d4e649889d232bc06ab6b: stopping tablet replica
I20260207 20:52:43.187167 2940 master.cc:583] Master@127.2.223.62:33815 shutdown complete.
I20260207 20:52:43.199239 2940 master.cc:561] Master@127.2.223.61:36845 shutting down...
I20260207 20:52:43.215754 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:43.216264 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:43.216563 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2464c47b32c54b37ae6219d7559bf264: stopping tablet replica
I20260207 20:52:43.234510 2940 master.cc:583] Master@127.2.223.61:36845 shutdown complete.
I20260207 20:52:43.247224 2940 master.cc:561] Master@127.2.223.60:37581 shutting down...
W20260207 20:52:43.265236 4954 consensus_peers.cc:597] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c -> Peer 2464c47b32c54b37ae6219d7559bf264 (127.2.223.61:36845): Couldn't send request to peer 2464c47b32c54b37ae6219d7559bf264. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.61:36845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:52:43.269999 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 3 LEADER]: Raft consensus shutting down.
I20260207 20:52:43.270784 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:43.271088 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5801a8c4831741f7ad11cb9322be194c: stopping tablet replica
I20260207 20:52:43.290032 2940 master.cc:583] Master@127.2.223.60:37581 shutdown complete.
I20260207 20:52:43.310446 2940 test_util.cc:183] -----------------------------------------------
I20260207 20:52:43.310673 2940 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1770497537224219-2940-0
[ FAILED ] RemoteKsckTest.TestTableConsistency (8253 ms)
[ RUN ] RemoteKsckTest.TestChecksum
I20260207 20:52:43.313786 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:43703,127.2.223.61:36893,127.2.223.60:37563
I20260207 20:52:43.315018 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:43.320010 5411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:43.320212 5412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:43.321345 2940 server_base.cc:1060] running on GCE node
W20260207 20:52:43.321702 5414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:43.322455 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:43.322659 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:43.322804 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497563322789 us; error 0 us; skew 500 ppm
I20260207 20:52:43.323256 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:43.325258 2940 webserver.cc:492] Webserver started at http://127.2.223.62:38585/ using document root <none> and password file <none>
I20260207 20:52:43.325667 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:43.325815 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:43.326047 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:43.327105 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "aa4b53a6888143b68e83577087fbe74a"
format_stamp: "Formatted at 2026-02-07 20:52:43 on dist-test-slave-kqw4"
I20260207 20:52:43.331153 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260207 20:52:43.334074 5419 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:43.334784 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260207 20:52:43.335028 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "aa4b53a6888143b68e83577087fbe74a"
format_stamp: "Formatted at 2026-02-07 20:52:43 on dist-test-slave-kqw4"
I20260207 20:52:43.335287 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:43.344116 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:43.345161 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:43.380057 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:43703
I20260207 20:52:43.380144 5470 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:43703 every 8 connection(s)
I20260207 20:52:43.383539 5471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:43.383672 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:43.388698 5473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:43.389125 5474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:43.391511 5476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:43.392019 5471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:43.392944 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:43.394115 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:43.394439 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:43.394753 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497563394731 us; error 0 us; skew 500 ppm
I20260207 20:52:43.395370 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:43.397799 2940 webserver.cc:492] Webserver started at http://127.2.223.61:39165/ using document root <none> and password file <none>
I20260207 20:52:43.398227 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:43.398386 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:43.398664 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:43.399591 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "53f5fa8b7be0489f95b79116c362a917"
format_stamp: "Formatted at 2026-02-07 20:52:43 on dist-test-slave-kqw4"
I20260207 20:52:43.403087 5471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:43.404376 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
W20260207 20:52:43.407646 5471 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:36893: Network error: Client connection negotiation failed: client connection to 127.2.223.61:36893: connect: Connection refused (error 111)
I20260207 20:52:43.407829 5484 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:43.408596 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:52:43.408819 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "53f5fa8b7be0489f95b79116c362a917"
format_stamp: "Formatted at 2026-02-07 20:52:43 on dist-test-slave-kqw4"
I20260207 20:52:43.409032 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:43.431346 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:43.432454 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:43.450145 5471 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } attempt: 1
W20260207 20:52:43.455641 5471 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:36893: Network error: Client connection negotiation failed: client connection to 127.2.223.61:36893: connect: Connection refused (error 111)
I20260207 20:52:43.476598 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:36893
I20260207 20:52:43.476722 5535 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:36893 every 8 connection(s)
I20260207 20:52:43.480188 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:43.480326 5536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260207 20:52:43.484889 5538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:43.487457 5539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:43.487790 5536 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:43.489111 5541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:43.489742 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:43.490567 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:43.490854 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:43.491037 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497563491023 us; error 0 us; skew 500 ppm
I20260207 20:52:43.491636 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:43.494011 2940 webserver.cc:492] Webserver started at http://127.2.223.60:35785/ using document root <none> and password file <none>
I20260207 20:52:43.494680 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:43.494902 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:43.495146 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:43.496172 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "12454def3fb346618c4cd3bd6943dbd7"
format_stamp: "Formatted at 2026-02-07 20:52:43 on dist-test-slave-kqw4"
I20260207 20:52:43.499176 5536 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:43.501327 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260207 20:52:43.505059 5548 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:43.505784 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:52:43.506031 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "12454def3fb346618c4cd3bd6943dbd7"
format_stamp: "Formatted at 2026-02-07 20:52:43 on dist-test-slave-kqw4"
I20260207 20:52:43.506392 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:43.509373 5536 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:43.514302 5536 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:37563: Network error: Client connection negotiation failed: client connection to 127.2.223.60:37563: connect: Connection refused (error 111)
I20260207 20:52:43.518302 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:43.519377 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:43.520080 5471 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } attempt: 2
I20260207 20:52:43.528811 5471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:43.533334 5471 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:37563: Network error: Client connection negotiation failed: client connection to 127.2.223.60:37563: connect: Connection refused (error 111)
I20260207 20:52:43.552780 5471 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } attempt: 1
W20260207 20:52:43.557538 5471 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:37563: Network error: Client connection negotiation failed: client connection to 127.2.223.60:37563: connect: Connection refused (error 111)
I20260207 20:52:43.558380 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:37563
I20260207 20:52:43.558672 5536 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } attempt: 1
I20260207 20:52:43.558477 5600 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:37563 every 8 connection(s)
I20260207 20:52:43.561853 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:52:43.562737 5602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:43.570044 5602 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:43.575923 5536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917: Bootstrap starting.
I20260207 20:52:43.580439 5602 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:43.581301 5536 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:43.585438 5536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917: No bootstrap required, opened a new log
I20260207 20:52:43.587554 5536 raft_consensus.cc:359] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } }
I20260207 20:52:43.588155 5536 raft_consensus.cc:385] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:43.588362 5536 raft_consensus.cc:740] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53f5fa8b7be0489f95b79116c362a917, State: Initialized, Role: FOLLOWER
I20260207 20:52:43.589264 5602 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:43.589015 5536 consensus_queue.cc:260] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } }
I20260207 20:52:43.590936 5606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } } }
I20260207 20:52:43.591799 5606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:43.592391 5536 sys_catalog.cc:565] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:43.605897 5602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7: Bootstrap starting.
W20260207 20:52:43.606981 5617 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:43.607245 5617 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:52:43.610419 5602 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:43.614184 5602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7: No bootstrap required, opened a new log
I20260207 20:52:43.616129 5602 raft_consensus.cc:359] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } }
I20260207 20:52:43.616622 5602 raft_consensus.cc:385] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:43.616808 5602 raft_consensus.cc:740] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12454def3fb346618c4cd3bd6943dbd7, State: Initialized, Role: FOLLOWER
I20260207 20:52:43.617334 5602 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } }
I20260207 20:52:43.619040 5619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } } }
I20260207 20:52:43.619535 5619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:43.620208 5602 sys_catalog.cc:565] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:43.625053 5471 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } attempt: 2
W20260207 20:52:43.634356 5630 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:43.634624 5630 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:52:43.639468 5471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a: Bootstrap starting.
I20260207 20:52:43.644121 5471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:43.647925 5471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a: No bootstrap required, opened a new log
I20260207 20:52:43.649762 5471 raft_consensus.cc:359] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } }
I20260207 20:52:43.650259 5471 raft_consensus.cc:385] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:43.650468 5471 raft_consensus.cc:740] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa4b53a6888143b68e83577087fbe74a, State: Initialized, Role: FOLLOWER
I20260207 20:52:43.651014 5471 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } }
I20260207 20:52:43.652506 5632 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } } }
I20260207 20:52:43.653015 5632 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:43.653730 5471 sys_catalog.cc:565] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:43.663400 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:52:43.663630 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:52:43.664849 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:43.666218 5643 catalog_manager.cc:1568] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:43.666484 5643 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:52:43.670688 5644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:43.671494 5645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:43.672904 2940 server_base.cc:1060] running on GCE node
W20260207 20:52:43.673548 5647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:43.674316 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:43.674520 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:43.674721 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497563674701 us; error 0 us; skew 500 ppm
I20260207 20:52:43.675195 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:43.677306 2940 webserver.cc:492] Webserver started at http://127.2.223.1:41203/ using document root <none> and password file <none>
I20260207 20:52:43.677736 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:43.677891 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:43.678092 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:43.679082 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "590e053be8704bc290376c3bf38bbc35"
format_stamp: "Formatted at 2026-02-07 20:52:43 on dist-test-slave-kqw4"
I20260207 20:52:43.683012 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260207 20:52:43.686045 5652 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:43.686757 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260207 20:52:43.687008 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "590e053be8704bc290376c3bf38bbc35"
format_stamp: "Formatted at 2026-02-07 20:52:43 on dist-test-slave-kqw4"
I20260207 20:52:43.687247 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:43.718398 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:43.719556 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:43.720889 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:43.723059 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:43.723246 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:43.723461 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:43.723608 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:43.727720 5619 raft_consensus.cc:493] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:43.728098 5619 raft_consensus.cc:515] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } }
I20260207 20:52:43.729657 5619 leader_election.cc:290] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa4b53a6888143b68e83577087fbe74a (127.2.223.62:43703), 53f5fa8b7be0489f95b79116c362a917 (127.2.223.61:36893)
I20260207 20:52:43.730571 5446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "12454def3fb346618c4cd3bd6943dbd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa4b53a6888143b68e83577087fbe74a" is_pre_election: true
I20260207 20:52:43.731397 5446 raft_consensus.cc:2468] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12454def3fb346618c4cd3bd6943dbd7 in term 0.
I20260207 20:52:43.731339 5511 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "12454def3fb346618c4cd3bd6943dbd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f5fa8b7be0489f95b79116c362a917" is_pre_election: true
I20260207 20:52:43.732290 5511 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12454def3fb346618c4cd3bd6943dbd7 in term 0.
I20260207 20:52:43.732899 5550 leader_election.cc:304] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12454def3fb346618c4cd3bd6943dbd7, aa4b53a6888143b68e83577087fbe74a; no voters:
I20260207 20:52:43.733753 5619 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:43.734076 5619 raft_consensus.cc:493] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:43.734321 5619 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:43.740077 5619 raft_consensus.cc:515] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } }
I20260207 20:52:43.742460 5619 leader_election.cc:290] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [CANDIDATE]: Term 1 election: Requested vote from peers aa4b53a6888143b68e83577087fbe74a (127.2.223.62:43703), 53f5fa8b7be0489f95b79116c362a917 (127.2.223.61:36893)
I20260207 20:52:43.742512 5446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "12454def3fb346618c4cd3bd6943dbd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa4b53a6888143b68e83577087fbe74a"
I20260207 20:52:43.742648 5511 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "12454def3fb346618c4cd3bd6943dbd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f5fa8b7be0489f95b79116c362a917"
I20260207 20:52:43.743482 5511 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:43.743407 5446 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:43.750339 5511 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12454def3fb346618c4cd3bd6943dbd7 in term 1.
I20260207 20:52:43.750897 5446 raft_consensus.cc:2468] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12454def3fb346618c4cd3bd6943dbd7 in term 1.
I20260207 20:52:43.751524 5549 leader_election.cc:304] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12454def3fb346618c4cd3bd6943dbd7, 53f5fa8b7be0489f95b79116c362a917; no voters:
I20260207 20:52:43.752279 5619 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:43.753700 5619 raft_consensus.cc:697] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [term 1 LEADER]: Becoming Leader. State: Replica: 12454def3fb346618c4cd3bd6943dbd7, State: Running, Role: LEADER
I20260207 20:52:43.754539 5619 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } }
I20260207 20:52:43.758307 5686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12454def3fb346618c4cd3bd6943dbd7. Latest consensus state: current_term: 1 leader_uuid: "12454def3fb346618c4cd3bd6943dbd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } } }
I20260207 20:52:43.759163 5686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:43.761364 5697 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:52:43.766352 5697 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:52:43.775553 5446 raft_consensus.cc:1275] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [term 1 FOLLOWER]: Refusing update from remote peer 12454def3fb346618c4cd3bd6943dbd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:43.775942 5511 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [term 1 FOLLOWER]: Refusing update from remote peer 12454def3fb346618c4cd3bd6943dbd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:43.776839 5686 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:43.777626 5619 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:43.779786 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:36449
I20260207 20:52:43.780030 5718 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:36449 every 8 connection(s)
I20260207 20:52:43.798250 5632 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12454def3fb346618c4cd3bd6943dbd7. Latest consensus state: current_term: 1 leader_uuid: "12454def3fb346618c4cd3bd6943dbd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } } }
I20260207 20:52:43.799005 5632 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:43.807667 5632 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "12454def3fb346618c4cd3bd6943dbd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } } }
I20260207 20:52:43.808609 5632 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:43.811482 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:43.814195 5722 heartbeater.cc:344] Connected to a master server at 127.2.223.60:37563
I20260207 20:52:43.814718 5722 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:43.815693 5722 heartbeater.cc:507] Master 127.2.223.60:37563 requested a full tablet report, sending...
I20260207 20:52:43.823706 5606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12454def3fb346618c4cd3bd6943dbd7. Latest consensus state: current_term: 1 leader_uuid: "12454def3fb346618c4cd3bd6943dbd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } } }
I20260207 20:52:43.824414 5606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:43.829016 5724 heartbeater.cc:344] Connected to a master server at 127.2.223.61:36893
I20260207 20:52:43.829481 5724 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:43.830305 5724 heartbeater.cc:507] Master 127.2.223.61:36893 requested a full tablet report, sending...
I20260207 20:52:43.831185 5697 catalog_manager.cc:1357] Generated new cluster ID: 3310320e3cf24f5ca531e71ae9da1ec1
I20260207 20:52:43.831527 5697 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:52:43.832850 5686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "12454def3fb346618c4cd3bd6943dbd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } } }
I20260207 20:52:43.833530 5686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:43.837471 5725 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43703
I20260207 20:52:43.837908 5725 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:43.838811 5725 heartbeater.cc:507] Master 127.2.223.62:43703 requested a full tablet report, sending...
I20260207 20:52:43.839695 5566 ts_manager.cc:194] Registered new tserver with Master: 590e053be8704bc290376c3bf38bbc35 (127.2.223.1:36449)
I20260207 20:52:43.842121 5436 ts_manager.cc:194] Registered new tserver with Master: 590e053be8704bc290376c3bf38bbc35 (127.2.223.1:36449)
I20260207 20:52:43.843748 5606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "12454def3fb346618c4cd3bd6943dbd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } } }
I20260207 20:52:43.844395 5606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:43.846091 5501 ts_manager.cc:194] Registered new tserver with Master: 590e053be8704bc290376c3bf38bbc35 (127.2.223.1:36449)
W20260207 20:52:43.849313 5734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:43.849682 5619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "12454def3fb346618c4cd3bd6943dbd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa4b53a6888143b68e83577087fbe74a" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43703 } } peers { permanent_uuid: "53f5fa8b7be0489f95b79116c362a917" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 36893 } } peers { permanent_uuid: "12454def3fb346618c4cd3bd6943dbd7" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37563 } } }
I20260207 20:52:43.850340 5619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [sys.catalog]: This master's current role is: LEADER
W20260207 20:52:43.852569 5735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:43.854837 2940 server_base.cc:1060] running on GCE node
W20260207 20:52:43.854707 5737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:43.856364 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:43.856626 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:43.856809 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497563856792 us; error 0 us; skew 500 ppm
I20260207 20:52:43.857487 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:43.862929 2940 webserver.cc:492] Webserver started at http://127.2.223.2:41757/ using document root <none> and password file <none>
I20260207 20:52:43.863509 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:43.863775 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:43.864090 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:43.865423 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "aa5c203e4fee483ebc615bbec35b09b4"
format_stamp: "Formatted at 2026-02-07 20:52:43 on dist-test-slave-kqw4"
I20260207 20:52:43.870144 5697 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:52:43.871721 5697 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:52:43.878125 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.012s user 0.006s sys 0.007s
I20260207 20:52:43.881377 5742 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:43.882120 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:52:43.882448 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "aa5c203e4fee483ebc615bbec35b09b4"
format_stamp: "Formatted at 2026-02-07 20:52:43 on dist-test-slave-kqw4"
I20260207 20:52:43.882766 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:43.905454 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:43.905879 5697 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7: Generated new TSK 0
I20260207 20:52:43.906571 5697 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:52:43.907052 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:43.908839 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:43.911966 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:43.912137 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:43.912384 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:43.912526 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:43.920049 5566 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38084
I20260207 20:52:43.932814 5722 heartbeater.cc:499] Master 127.2.223.60:37563 was elected leader, sending a full tablet report...
I20260207 20:52:43.958714 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:41929
I20260207 20:52:43.959357 5804 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:41929 every 8 connection(s)
I20260207 20:52:43.974217 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:43.985303 5805 heartbeater.cc:344] Connected to a master server at 127.2.223.60:37563
I20260207 20:52:43.985746 5805 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:43.986577 5805 heartbeater.cc:507] Master 127.2.223.60:37563 requested a full tablet report, sending...
W20260207 20:52:43.991642 5812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:43.993311 5566 ts_manager.cc:194] Registered new tserver with Master: aa5c203e4fee483ebc615bbec35b09b4 (127.2.223.2:41929)
I20260207 20:52:43.994524 5807 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43703
I20260207 20:52:43.994944 5807 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:43.995431 5566 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38090
I20260207 20:52:43.996186 5807 heartbeater.cc:507] Master 127.2.223.62:43703 requested a full tablet report, sending...
I20260207 20:52:44.002838 5436 ts_manager.cc:194] Registered new tserver with Master: aa5c203e4fee483ebc615bbec35b09b4 (127.2.223.2:41929)
I20260207 20:52:44.003523 5806 heartbeater.cc:344] Connected to a master server at 127.2.223.61:36893
I20260207 20:52:44.003927 5806 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:44.004556 5806 heartbeater.cc:507] Master 127.2.223.61:36893 requested a full tablet report, sending...
W20260207 20:52:44.006664 5816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:44.007201 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:44.007241 5501 ts_manager.cc:194] Registered new tserver with Master: aa5c203e4fee483ebc615bbec35b09b4 (127.2.223.2:41929)
I20260207 20:52:44.008394 5805 heartbeater.cc:499] Master 127.2.223.60:37563 was elected leader, sending a full tablet report...
W20260207 20:52:44.008016 5813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:44.010623 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:44.010922 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:44.011145 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497564011125 us; error 0 us; skew 500 ppm
I20260207 20:52:44.011750 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:44.013917 2940 webserver.cc:492] Webserver started at http://127.2.223.3:45185/ using document root <none> and password file <none>
I20260207 20:52:44.014328 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:44.014551 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:44.014892 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:44.016036 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "211b5679af244c77b750a5bb23172c86"
format_stamp: "Formatted at 2026-02-07 20:52:44 on dist-test-slave-kqw4"
I20260207 20:52:44.021934 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260207 20:52:44.025736 5820 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:44.026504 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:52:44.026904 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "211b5679af244c77b750a5bb23172c86"
format_stamp: "Formatted at 2026-02-07 20:52:44 on dist-test-slave-kqw4"
I20260207 20:52:44.027247 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:44.054111 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:44.055346 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:44.056654 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:44.059329 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:44.059623 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:44.059938 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:44.060171 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:44.124848 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:37625
I20260207 20:52:44.124940 5882 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:37625 every 8 connection(s)
I20260207 20:52:44.148406 5883 heartbeater.cc:344] Connected to a master server at 127.2.223.60:37563
I20260207 20:52:44.148778 5883 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:44.149580 5883 heartbeater.cc:507] Master 127.2.223.60:37563 requested a full tablet report, sending...
I20260207 20:52:44.149731 5884 heartbeater.cc:344] Connected to a master server at 127.2.223.61:36893
I20260207 20:52:44.150141 5884 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:44.150949 5884 heartbeater.cc:507] Master 127.2.223.61:36893 requested a full tablet report, sending...
I20260207 20:52:44.153486 5500 ts_manager.cc:194] Registered new tserver with Master: 211b5679af244c77b750a5bb23172c86 (127.2.223.3:37625)
I20260207 20:52:44.157296 5565 ts_manager.cc:194] Registered new tserver with Master: 211b5679af244c77b750a5bb23172c86 (127.2.223.3:37625)
I20260207 20:52:44.158860 5885 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43703
I20260207 20:52:44.158993 5565 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38098
I20260207 20:52:44.159266 5885 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:44.160079 5885 heartbeater.cc:507] Master 127.2.223.62:43703 requested a full tablet report, sending...
I20260207 20:52:44.161899 5436 ts_manager.cc:194] Registered new tserver with Master: 211b5679af244c77b750a5bb23172c86 (127.2.223.3:37625)
I20260207 20:52:44.162297 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.032456844s
I20260207 20:52:44.171124 5883 heartbeater.cc:499] Master 127.2.223.60:37563 was elected leader, sending a full tablet report...
I20260207 20:52:44.215948 5566 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38106:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:52:44.219117 5566 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:52:44.337160 5848 tablet_service.cc:1505] Processing CreateTablet for tablet e5695783a33b4cf598ee2c842b4a3a46 (DEFAULT_TABLE table=ksck-test-table [id=11adbb1e2bd243e9adb721780da903fd]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:44.338394 5848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5695783a33b4cf598ee2c842b4a3a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:44.336974 5847 tablet_service.cc:1505] Processing CreateTablet for tablet 925d1fab865045b9b7ebbc6417ea9b5e (DEFAULT_TABLE table=ksck-test-table [id=11adbb1e2bd243e9adb721780da903fd]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:44.339349 5846 tablet_service.cc:1505] Processing CreateTablet for tablet ea68b19ee8db4e4dad958c922e276707 (DEFAULT_TABLE table=ksck-test-table [id=11adbb1e2bd243e9adb721780da903fd]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:44.340505 5847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 925d1fab865045b9b7ebbc6417ea9b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:44.341171 5846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea68b19ee8db4e4dad958c922e276707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:44.343356 5680 tablet_service.cc:1505] Processing CreateTablet for tablet e5695783a33b4cf598ee2c842b4a3a46 (DEFAULT_TABLE table=ksck-test-table [id=11adbb1e2bd243e9adb721780da903fd]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:44.344563 5680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5695783a33b4cf598ee2c842b4a3a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:44.346422 5678 tablet_service.cc:1505] Processing CreateTablet for tablet ea68b19ee8db4e4dad958c922e276707 (DEFAULT_TABLE table=ksck-test-table [id=11adbb1e2bd243e9adb721780da903fd]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:44.346349 5679 tablet_service.cc:1505] Processing CreateTablet for tablet 925d1fab865045b9b7ebbc6417ea9b5e (DEFAULT_TABLE table=ksck-test-table [id=11adbb1e2bd243e9adb721780da903fd]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:44.348781 5679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 925d1fab865045b9b7ebbc6417ea9b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:44.351621 5678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea68b19ee8db4e4dad958c922e276707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:44.360442 5770 tablet_service.cc:1505] Processing CreateTablet for tablet e5695783a33b4cf598ee2c842b4a3a46 (DEFAULT_TABLE table=ksck-test-table [id=11adbb1e2bd243e9adb721780da903fd]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:44.361716 5770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5695783a33b4cf598ee2c842b4a3a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:44.388130 5769 tablet_service.cc:1505] Processing CreateTablet for tablet 925d1fab865045b9b7ebbc6417ea9b5e (DEFAULT_TABLE table=ksck-test-table [id=11adbb1e2bd243e9adb721780da903fd]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:44.389472 5769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 925d1fab865045b9b7ebbc6417ea9b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:44.391455 5768 tablet_service.cc:1505] Processing CreateTablet for tablet ea68b19ee8db4e4dad958c922e276707 (DEFAULT_TABLE table=ksck-test-table [id=11adbb1e2bd243e9adb721780da903fd]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:44.395941 5768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea68b19ee8db4e4dad958c922e276707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:44.410539 5905 tablet_bootstrap.cc:492] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4: Bootstrap starting.
I20260207 20:52:44.415858 5904 tablet_bootstrap.cc:492] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86: Bootstrap starting.
I20260207 20:52:44.430932 5904 tablet_bootstrap.cc:654] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:44.431591 5905 tablet_bootstrap.cc:654] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:44.440601 5904 tablet_bootstrap.cc:492] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86: No bootstrap required, opened a new log
I20260207 20:52:44.441468 5904 ts_tablet_manager.cc:1403] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86: Time spent bootstrapping tablet: real 0.026s user 0.012s sys 0.000s
I20260207 20:52:44.444475 5904 raft_consensus.cc:359] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.445449 5904 raft_consensus.cc:385] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:44.447263 5905 tablet_bootstrap.cc:492] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4: No bootstrap required, opened a new log
I20260207 20:52:44.447894 5905 ts_tablet_manager.cc:1403] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4: Time spent bootstrapping tablet: real 0.038s user 0.010s sys 0.002s
I20260207 20:52:44.450898 5905 raft_consensus.cc:359] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } } peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } }
I20260207 20:52:44.452078 5905 raft_consensus.cc:385] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:44.452435 5905 raft_consensus.cc:740] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa5c203e4fee483ebc615bbec35b09b4, State: Initialized, Role: FOLLOWER
I20260207 20:52:44.451670 5904 raft_consensus.cc:740] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 211b5679af244c77b750a5bb23172c86, State: Initialized, Role: FOLLOWER
I20260207 20:52:44.453821 5904 consensus_queue.cc:260] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.454900 5905 consensus_queue.cc:260] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } } peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } }
I20260207 20:52:44.466480 5905 ts_tablet_manager.cc:1434] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4: Time spent starting tablet: real 0.018s user 0.009s sys 0.001s
I20260207 20:52:44.469605 5904 ts_tablet_manager.cc:1434] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86: Time spent starting tablet: real 0.028s user 0.005s sys 0.004s
I20260207 20:52:44.472383 5904 tablet_bootstrap.cc:492] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86: Bootstrap starting.
I20260207 20:52:44.479351 5904 tablet_bootstrap.cc:654] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:44.491323 5904 tablet_bootstrap.cc:492] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86: No bootstrap required, opened a new log
I20260207 20:52:44.491969 5904 ts_tablet_manager.cc:1403] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.006s
I20260207 20:52:44.495213 5904 raft_consensus.cc:359] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.496070 5904 raft_consensus.cc:385] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:44.496461 5904 raft_consensus.cc:740] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 211b5679af244c77b750a5bb23172c86, State: Initialized, Role: FOLLOWER
I20260207 20:52:44.497357 5904 consensus_queue.cc:260] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.500831 5904 ts_tablet_manager.cc:1434] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86: Time spent starting tablet: real 0.008s user 0.004s sys 0.002s
I20260207 20:52:44.501930 5904 tablet_bootstrap.cc:492] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86: Bootstrap starting.
I20260207 20:52:44.507997 5904 tablet_bootstrap.cc:654] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:44.519526 5904 tablet_bootstrap.cc:492] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86: No bootstrap required, opened a new log
I20260207 20:52:44.520128 5904 ts_tablet_manager.cc:1403] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.008s
I20260207 20:52:44.523662 5909 raft_consensus.cc:493] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:44.524171 5909 raft_consensus.cc:515] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.530262 5909 leader_election.cc:290] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590e053be8704bc290376c3bf38bbc35 (127.2.223.1:36449), aa5c203e4fee483ebc615bbec35b09b4 (127.2.223.2:41929)
I20260207 20:52:44.523131 5904 raft_consensus.cc:359] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } } peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } }
I20260207 20:52:44.531787 5904 raft_consensus.cc:385] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:44.532119 5904 raft_consensus.cc:740] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 211b5679af244c77b750a5bb23172c86, State: Initialized, Role: FOLLOWER
I20260207 20:52:44.532840 5904 consensus_queue.cc:260] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } } peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } }
I20260207 20:52:44.535542 5904 ts_tablet_manager.cc:1434] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86: Time spent starting tablet: real 0.015s user 0.005s sys 0.001s
W20260207 20:52:44.544239 5823 leader_election.cc:343] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa5c203e4fee483ebc615bbec35b09b4 (127.2.223.2:41929): Not found: Tablet not found: ea68b19ee8db4e4dad958c922e276707
I20260207 20:52:44.546450 5691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea68b19ee8db4e4dad958c922e276707" candidate_uuid: "211b5679af244c77b750a5bb23172c86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590e053be8704bc290376c3bf38bbc35" is_pre_election: true
W20260207 20:52:44.547832 5822 leader_election.cc:343] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590e053be8704bc290376c3bf38bbc35 (127.2.223.1:36449): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:44.548310 5822 leader_election.cc:304] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 211b5679af244c77b750a5bb23172c86; no voters: 590e053be8704bc290376c3bf38bbc35, aa5c203e4fee483ebc615bbec35b09b4
I20260207 20:52:44.549261 5909 raft_consensus.cc:2749] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:52:44.554402 5905 tablet_bootstrap.cc:492] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4: Bootstrap starting.
I20260207 20:52:44.561316 5905 tablet_bootstrap.cc:654] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:44.571934 5906 tablet_bootstrap.cc:492] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35: Bootstrap starting.
I20260207 20:52:44.573850 5905 tablet_bootstrap.cc:492] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4: No bootstrap required, opened a new log
I20260207 20:52:44.574326 5905 ts_tablet_manager.cc:1403] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.006s
I20260207 20:52:44.578872 5906 tablet_bootstrap.cc:654] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:44.579552 5905 raft_consensus.cc:359] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.580320 5905 raft_consensus.cc:385] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:44.580659 5905 raft_consensus.cc:740] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa5c203e4fee483ebc615bbec35b09b4, State: Initialized, Role: FOLLOWER
I20260207 20:52:44.581444 5905 consensus_queue.cc:260] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.592832 5905 ts_tablet_manager.cc:1434] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260207 20:52:44.615607 5905 tablet_bootstrap.cc:492] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4: Bootstrap starting.
I20260207 20:52:44.616557 5617 catalog_manager.cc:1269] Loaded cluster ID: 3310320e3cf24f5ca531e71ae9da1ec1
I20260207 20:52:44.616858 5617 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917: loading cluster ID for follower catalog manager: success
I20260207 20:52:44.620883 5905 tablet_bootstrap.cc:654] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:44.622385 5617 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917: acquiring CA information for follower catalog manager: success
I20260207 20:52:44.628895 5906 tablet_bootstrap.cc:492] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35: No bootstrap required, opened a new log
I20260207 20:52:44.629498 5906 ts_tablet_manager.cc:1403] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35: Time spent bootstrapping tablet: real 0.058s user 0.024s sys 0.005s
I20260207 20:52:44.639839 5905 tablet_bootstrap.cc:492] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4: No bootstrap required, opened a new log
I20260207 20:52:44.639539 5906 raft_consensus.cc:359] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.640347 5906 raft_consensus.cc:385] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:44.640395 5905 ts_tablet_manager.cc:1403] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.014s
I20260207 20:52:44.641539 5906 raft_consensus.cc:740] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590e053be8704bc290376c3bf38bbc35, State: Initialized, Role: FOLLOWER
I20260207 20:52:44.641250 5617 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:52:44.642298 5906 consensus_queue.cc:260] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.644194 5905 raft_consensus.cc:359] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.646803 5905 raft_consensus.cc:385] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:44.650640 5905 raft_consensus.cc:740] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa5c203e4fee483ebc615bbec35b09b4, State: Initialized, Role: FOLLOWER
I20260207 20:52:44.653126 5905 consensus_queue.cc:260] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.655627 5905 ts_tablet_manager.cc:1434] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260207 20:52:44.659874 5906 ts_tablet_manager.cc:1434] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35: Time spent starting tablet: real 0.030s user 0.005s sys 0.003s
I20260207 20:52:44.662479 5906 tablet_bootstrap.cc:492] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35: Bootstrap starting.
I20260207 20:52:44.669920 5906 tablet_bootstrap.cc:654] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:44.672042 5643 catalog_manager.cc:1269] Loaded cluster ID: 3310320e3cf24f5ca531e71ae9da1ec1
I20260207 20:52:44.672371 5643 catalog_manager.cc:1562] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a: loading cluster ID for follower catalog manager: success
I20260207 20:52:44.681159 5643 catalog_manager.cc:1584] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a: acquiring CA information for follower catalog manager: success
I20260207 20:52:44.684572 5643 catalog_manager.cc:1612] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:52:44.686918 5906 tablet_bootstrap.cc:492] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35: No bootstrap required, opened a new log
I20260207 20:52:44.687343 5906 ts_tablet_manager.cc:1403] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.017s
I20260207 20:52:44.691273 5906 raft_consensus.cc:359] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.691983 5906 raft_consensus.cc:385] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:44.692363 5906 raft_consensus.cc:740] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590e053be8704bc290376c3bf38bbc35, State: Initialized, Role: FOLLOWER
I20260207 20:52:44.693071 5906 consensus_queue.cc:260] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.697252 5906 ts_tablet_manager.cc:1434] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260207 20:52:44.702301 5906 tablet_bootstrap.cc:492] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35: Bootstrap starting.
I20260207 20:52:44.713615 5906 tablet_bootstrap.cc:654] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:44.717757 5906 tablet_bootstrap.cc:492] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35: No bootstrap required, opened a new log
I20260207 20:52:44.718286 5906 ts_tablet_manager.cc:1403] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.003s
I20260207 20:52:44.721938 5906 raft_consensus.cc:359] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } } peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } }
I20260207 20:52:44.722676 5906 raft_consensus.cc:385] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:44.723013 5906 raft_consensus.cc:740] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590e053be8704bc290376c3bf38bbc35, State: Initialized, Role: FOLLOWER
I20260207 20:52:44.723730 5906 consensus_queue.cc:260] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } } peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } }
I20260207 20:52:44.727403 5906 ts_tablet_manager.cc:1434] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35: Time spent starting tablet: real 0.009s user 0.003s sys 0.002s
I20260207 20:52:44.791599 5916 raft_consensus.cc:493] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:44.792079 5916 raft_consensus.cc:515] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.794092 5916 leader_election.cc:290] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa5c203e4fee483ebc615bbec35b09b4 (127.2.223.2:41929), 211b5679af244c77b750a5bb23172c86 (127.2.223.3:37625)
I20260207 20:52:44.811050 5858 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "925d1fab865045b9b7ebbc6417ea9b5e" candidate_uuid: "590e053be8704bc290376c3bf38bbc35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "211b5679af244c77b750a5bb23172c86" is_pre_election: true
I20260207 20:52:44.811831 5858 raft_consensus.cc:2468] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590e053be8704bc290376c3bf38bbc35 in term 0.
I20260207 20:52:44.813032 5654 leader_election.cc:304] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 211b5679af244c77b750a5bb23172c86, 590e053be8704bc290376c3bf38bbc35; no voters:
I20260207 20:52:44.813287 5780 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "925d1fab865045b9b7ebbc6417ea9b5e" candidate_uuid: "590e053be8704bc290376c3bf38bbc35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa5c203e4fee483ebc615bbec35b09b4" is_pre_election: true
I20260207 20:52:44.813913 5780 raft_consensus.cc:2468] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590e053be8704bc290376c3bf38bbc35 in term 0.
I20260207 20:52:44.813918 5916 raft_consensus.cc:2804] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:44.814468 5916 raft_consensus.cc:493] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:44.814822 5916 raft_consensus.cc:3060] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:44.824373 5916 raft_consensus.cc:515] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.826455 5916 leader_election.cc:290] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [CANDIDATE]: Term 1 election: Requested vote from peers aa5c203e4fee483ebc615bbec35b09b4 (127.2.223.2:41929), 211b5679af244c77b750a5bb23172c86 (127.2.223.3:37625)
I20260207 20:52:44.827666 5858 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "925d1fab865045b9b7ebbc6417ea9b5e" candidate_uuid: "590e053be8704bc290376c3bf38bbc35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "211b5679af244c77b750a5bb23172c86"
I20260207 20:52:44.828233 5858 raft_consensus.cc:3060] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:44.827623 5780 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "925d1fab865045b9b7ebbc6417ea9b5e" candidate_uuid: "590e053be8704bc290376c3bf38bbc35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa5c203e4fee483ebc615bbec35b09b4"
I20260207 20:52:44.829908 5910 raft_consensus.cc:493] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:44.830032 5780 raft_consensus.cc:3060] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:44.830408 5910 raft_consensus.cc:515] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.832819 5910 leader_election.cc:290] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590e053be8704bc290376c3bf38bbc35 (127.2.223.1:36449), 211b5679af244c77b750a5bb23172c86 (127.2.223.3:37625)
I20260207 20:52:44.839134 5780 raft_consensus.cc:2468] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590e053be8704bc290376c3bf38bbc35 in term 1.
I20260207 20:52:44.841243 5858 raft_consensus.cc:2468] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590e053be8704bc290376c3bf38bbc35 in term 1.
I20260207 20:52:44.841590 5655 leader_election.cc:304] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590e053be8704bc290376c3bf38bbc35, aa5c203e4fee483ebc615bbec35b09b4; no voters:
I20260207 20:52:44.843562 5916 raft_consensus.cc:2804] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:44.844751 5909 raft_consensus.cc:493] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:44.845235 5909 raft_consensus.cc:515] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } } peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } }
I20260207 20:52:44.847050 5916 raft_consensus.cc:697] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [term 1 LEADER]: Becoming Leader. State: Replica: 590e053be8704bc290376c3bf38bbc35, State: Running, Role: LEADER
I20260207 20:52:44.847259 5909 leader_election.cc:290] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590e053be8704bc290376c3bf38bbc35 (127.2.223.1:36449), aa5c203e4fee483ebc615bbec35b09b4 (127.2.223.2:41929)
I20260207 20:52:44.848789 5780 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5695783a33b4cf598ee2c842b4a3a46" candidate_uuid: "211b5679af244c77b750a5bb23172c86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa5c203e4fee483ebc615bbec35b09b4" is_pre_election: true
I20260207 20:52:44.849393 5780 raft_consensus.cc:2468] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 211b5679af244c77b750a5bb23172c86 in term 0.
I20260207 20:52:44.850394 5823 leader_election.cc:304] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 211b5679af244c77b750a5bb23172c86, aa5c203e4fee483ebc615bbec35b09b4; no voters:
I20260207 20:52:44.851222 5909 raft_consensus.cc:2804] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:44.851553 5909 raft_consensus.cc:493] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:44.851854 5909 raft_consensus.cc:3060] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:44.853017 5916 consensus_queue.cc:237] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.857758 5909 raft_consensus.cc:515] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } } peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } }
I20260207 20:52:44.859634 5691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5695783a33b4cf598ee2c842b4a3a46" candidate_uuid: "211b5679af244c77b750a5bb23172c86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590e053be8704bc290376c3bf38bbc35" is_pre_election: true
I20260207 20:52:44.860252 5691 raft_consensus.cc:2468] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 211b5679af244c77b750a5bb23172c86 in term 0.
I20260207 20:52:44.871078 5691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea68b19ee8db4e4dad958c922e276707" candidate_uuid: "aa5c203e4fee483ebc615bbec35b09b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590e053be8704bc290376c3bf38bbc35" is_pre_election: true
I20260207 20:52:44.869697 5564 catalog_manager.cc:5654] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 590e053be8704bc290376c3bf38bbc35 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "590e053be8704bc290376c3bf38bbc35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:44.871752 5691 raft_consensus.cc:2468] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa5c203e4fee483ebc615bbec35b09b4 in term 0.
I20260207 20:52:44.873970 5744 leader_election.cc:304] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590e053be8704bc290376c3bf38bbc35, aa5c203e4fee483ebc615bbec35b09b4; no voters:
I20260207 20:52:44.875591 5910 raft_consensus.cc:2804] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:44.875998 5910 raft_consensus.cc:493] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:44.876336 5910 raft_consensus.cc:3060] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:44.883649 5858 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea68b19ee8db4e4dad958c922e276707" candidate_uuid: "aa5c203e4fee483ebc615bbec35b09b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "211b5679af244c77b750a5bb23172c86" is_pre_election: true
I20260207 20:52:44.884357 5858 raft_consensus.cc:2468] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa5c203e4fee483ebc615bbec35b09b4 in term 0.
I20260207 20:52:44.897478 5691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5695783a33b4cf598ee2c842b4a3a46" candidate_uuid: "211b5679af244c77b750a5bb23172c86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590e053be8704bc290376c3bf38bbc35"
I20260207 20:52:44.898103 5691 raft_consensus.cc:3060] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:44.907713 5910 raft_consensus.cc:515] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.909760 5910 leader_election.cc:290] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [CANDIDATE]: Term 1 election: Requested vote from peers 590e053be8704bc290376c3bf38bbc35 (127.2.223.1:36449), 211b5679af244c77b750a5bb23172c86 (127.2.223.3:37625)
I20260207 20:52:44.910864 5690 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea68b19ee8db4e4dad958c922e276707" candidate_uuid: "aa5c203e4fee483ebc615bbec35b09b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590e053be8704bc290376c3bf38bbc35"
I20260207 20:52:44.911494 5690 raft_consensus.cc:3060] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:44.912039 5780 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5695783a33b4cf598ee2c842b4a3a46" candidate_uuid: "211b5679af244c77b750a5bb23172c86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa5c203e4fee483ebc615bbec35b09b4"
I20260207 20:52:44.912619 5780 raft_consensus.cc:3060] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:44.917707 5690 raft_consensus.cc:2468] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa5c203e4fee483ebc615bbec35b09b4 in term 1.
I20260207 20:52:44.918931 5858 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea68b19ee8db4e4dad958c922e276707" candidate_uuid: "aa5c203e4fee483ebc615bbec35b09b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "211b5679af244c77b750a5bb23172c86"
I20260207 20:52:44.919135 5744 leader_election.cc:304] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590e053be8704bc290376c3bf38bbc35, aa5c203e4fee483ebc615bbec35b09b4; no voters:
I20260207 20:52:44.919517 5858 raft_consensus.cc:3060] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:44.925788 5858 raft_consensus.cc:2468] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa5c203e4fee483ebc615bbec35b09b4 in term 1.
I20260207 20:52:44.927834 5780 raft_consensus.cc:2468] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 211b5679af244c77b750a5bb23172c86 in term 1.
I20260207 20:52:44.929001 5823 leader_election.cc:304] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 211b5679af244c77b750a5bb23172c86, aa5c203e4fee483ebc615bbec35b09b4; no voters:
I20260207 20:52:44.934777 5691 raft_consensus.cc:2468] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 211b5679af244c77b750a5bb23172c86 in term 1.
I20260207 20:52:44.936723 5909 leader_election.cc:290] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [CANDIDATE]: Term 1 election: Requested vote from peers 590e053be8704bc290376c3bf38bbc35 (127.2.223.1:36449), aa5c203e4fee483ebc615bbec35b09b4 (127.2.223.2:41929)
I20260207 20:52:44.937292 5909 raft_consensus.cc:2804] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:44.937712 5909 raft_consensus.cc:697] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [term 1 LEADER]: Becoming Leader. State: Replica: 211b5679af244c77b750a5bb23172c86, State: Running, Role: LEADER
I20260207 20:52:44.938519 5909 consensus_queue.cc:237] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } } peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } }
I20260207 20:52:44.942831 5910 raft_consensus.cc:2804] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:44.954607 5910 raft_consensus.cc:697] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [term 1 LEADER]: Becoming Leader. State: Replica: aa5c203e4fee483ebc615bbec35b09b4, State: Running, Role: LEADER
I20260207 20:52:44.955623 5910 consensus_queue.cc:237] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } }
I20260207 20:52:44.958807 5563 catalog_manager.cc:5654] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 211b5679af244c77b750a5bb23172c86 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "211b5679af244c77b750a5bb23172c86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:44.975692 5564 catalog_manager.cc:5654] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa5c203e4fee483ebc615bbec35b09b4 (127.2.223.2). New cstate: current_term: 1 leader_uuid: "aa5c203e4fee483ebc615bbec35b09b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:45.093499 2940 ksck_remote-test.cc:376] Generating row writes...
I20260207 20:52:45.211284 5858 raft_consensus.cc:1275] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86 [term 1 FOLLOWER]: Refusing update from remote peer 590e053be8704bc290376c3bf38bbc35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:45.214033 5780 raft_consensus.cc:1275] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4 [term 1 FOLLOWER]: Refusing update from remote peer 590e053be8704bc290376c3bf38bbc35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:45.216297 5916 consensus_queue.cc:1048] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:45.220220 5780 raft_consensus.cc:1275] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4 [term 1 FOLLOWER]: Refusing update from remote peer 211b5679af244c77b750a5bb23172c86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:45.222410 5691 raft_consensus.cc:1275] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35 [term 1 FOLLOWER]: Refusing update from remote peer 211b5679af244c77b750a5bb23172c86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:45.223676 5931 consensus_queue.cc:1048] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa5c203e4fee483ebc615bbec35b09b4" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:45.223941 5916 consensus_queue.cc:1048] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:45.228427 5931 consensus_queue.cc:1048] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:45.251490 5690 raft_consensus.cc:1275] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35 [term 1 FOLLOWER]: Refusing update from remote peer aa5c203e4fee483ebc615bbec35b09b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:45.253010 5857 raft_consensus.cc:1275] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [term 1 FOLLOWER]: Refusing update from remote peer aa5c203e4fee483ebc615bbec35b09b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:45.253051 5932 consensus_queue.cc:1048] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590e053be8704bc290376c3bf38bbc35" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260207 20:52:45.256858 5932 consensus_queue.cc:1048] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "211b5679af244c77b750a5bb23172c86" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 37625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:45.284879 5946 mvcc.cc:204] Tried to move back new op lower bound from 7251958027079233536 to 7251958025647243264. Current Snapshot: MvccSnapshot[applied={T|T < 7251958027079233536}]
I20260207 20:52:46.124215 5848 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:52:46.157232 5678 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:52:46.174659 5769 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:52:46.613879 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:52:46.686542 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:46.687273 2940 tablet_replica.cc:333] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35: stopping tablet replica
I20260207 20:52:46.687909 2940 raft_consensus.cc:2243] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:46.688426 2940 raft_consensus.cc:2272] T e5695783a33b4cf598ee2c842b4a3a46 P 590e053be8704bc290376c3bf38bbc35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:46.690901 2940 tablet_replica.cc:333] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35: stopping tablet replica
I20260207 20:52:46.691457 2940 raft_consensus.cc:2243] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:46.692281 2940 raft_consensus.cc:2272] T 925d1fab865045b9b7ebbc6417ea9b5e P 590e053be8704bc290376c3bf38bbc35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:46.695993 2940 tablet_replica.cc:333] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35: stopping tablet replica
I20260207 20:52:46.696676 2940 raft_consensus.cc:2243] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:46.697239 2940 raft_consensus.cc:2272] T ea68b19ee8db4e4dad958c922e276707 P 590e053be8704bc290376c3bf38bbc35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:46.716045 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:52:46.732717 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:52:46.788303 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:46.790438 2940 tablet_replica.cc:333] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4: stopping tablet replica
I20260207 20:52:46.791004 2940 raft_consensus.cc:2243] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:46.791451 2940 raft_consensus.cc:2272] T 925d1fab865045b9b7ebbc6417ea9b5e P aa5c203e4fee483ebc615bbec35b09b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:46.793133 2940 tablet_replica.cc:333] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4: stopping tablet replica
I20260207 20:52:46.793664 2940 raft_consensus.cc:2243] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:46.794631 2940 raft_consensus.cc:2272] T ea68b19ee8db4e4dad958c922e276707 P aa5c203e4fee483ebc615bbec35b09b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:46.796847 2940 tablet_replica.cc:333] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4: stopping tablet replica
I20260207 20:52:46.797376 2940 raft_consensus.cc:2243] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:46.797791 2940 raft_consensus.cc:2272] T e5695783a33b4cf598ee2c842b4a3a46 P aa5c203e4fee483ebc615bbec35b09b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:46.809253 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:52:46.820739 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:52:46.854696 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:46.855307 2940 tablet_replica.cc:333] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86: stopping tablet replica
I20260207 20:52:46.855978 2940 raft_consensus.cc:2243] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:46.856714 2940 raft_consensus.cc:2272] T e5695783a33b4cf598ee2c842b4a3a46 P 211b5679af244c77b750a5bb23172c86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:46.858635 2940 tablet_replica.cc:333] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86: stopping tablet replica
I20260207 20:52:46.859253 2940 raft_consensus.cc:2243] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:46.859707 2940 raft_consensus.cc:2272] T ea68b19ee8db4e4dad958c922e276707 P 211b5679af244c77b750a5bb23172c86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:46.861374 2940 tablet_replica.cc:333] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86: stopping tablet replica
I20260207 20:52:46.861793 2940 raft_consensus.cc:2243] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:46.862185 2940 raft_consensus.cc:2272] T 925d1fab865045b9b7ebbc6417ea9b5e P 211b5679af244c77b750a5bb23172c86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:46.881999 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:52:46.893052 2940 master.cc:561] Master@127.2.223.62:43703 shutting down...
I20260207 20:52:46.915273 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:46.915818 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:46.916116 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P aa4b53a6888143b68e83577087fbe74a: stopping tablet replica
I20260207 20:52:46.935686 2940 master.cc:583] Master@127.2.223.62:43703 shutdown complete.
I20260207 20:52:46.949606 2940 master.cc:561] Master@127.2.223.61:36893 shutting down...
I20260207 20:52:46.968158 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:46.968791 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:46.969156 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 53f5fa8b7be0489f95b79116c362a917: stopping tablet replica
I20260207 20:52:46.988852 2940 master.cc:583] Master@127.2.223.61:36893 shutdown complete.
I20260207 20:52:47.000326 2940 master.cc:561] Master@127.2.223.60:37563 shutting down...
I20260207 20:52:47.017670 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:47.018456 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:47.018803 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 12454def3fb346618c4cd3bd6943dbd7: stopping tablet replica
I20260207 20:52:47.038683 2940 master.cc:583] Master@127.2.223.60:37563 shutdown complete.
[ OK ] RemoteKsckTest.TestChecksum (3755 ms)
[ RUN ] RemoteKsckTest.TestChecksumTimeout
I20260207 20:52:47.069461 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:44901,127.2.223.61:45939,127.2.223.60:41925
I20260207 20:52:47.070741 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:47.075572 6000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:47.076289 6001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:47.077203 6003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:47.078004 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:47.078955 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:47.079198 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:47.079382 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497567079365 us; error 0 us; skew 500 ppm
I20260207 20:52:47.080060 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:47.082966 2940 webserver.cc:492] Webserver started at http://127.2.223.62:38819/ using document root <none> and password file <none>
I20260207 20:52:47.083554 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:47.083783 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:47.084088 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:47.085409 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "5e4751a945e74ec6909c407ebcb3ebf9"
format_stamp: "Formatted at 2026-02-07 20:52:47 on dist-test-slave-kqw4"
I20260207 20:52:47.090832 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.001s sys 0.007s
I20260207 20:52:47.094792 6008 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:47.095542 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20260207 20:52:47.095845 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "5e4751a945e74ec6909c407ebcb3ebf9"
format_stamp: "Formatted at 2026-02-07 20:52:47 on dist-test-slave-kqw4"
I20260207 20:52:47.096128 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:47.114466 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:47.115492 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:47.156178 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:44901
I20260207 20:52:47.156275 6059 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:44901 every 8 connection(s)
I20260207 20:52:47.160113 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:47.160422 6060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260207 20:52:47.165094 6062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:47.166376 6063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:47.168915 6060 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:47.175976 2940 server_base.cc:1060] running on GCE node
W20260207 20:52:47.176151 6066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:47.177280 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:47.177562 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:47.177760 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497567177743 us; error 0 us; skew 500 ppm
I20260207 20:52:47.178450 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:47.181947 2940 webserver.cc:492] Webserver started at http://127.2.223.61:42723/ using document root <none> and password file <none>
I20260207 20:52:47.182555 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:47.182818 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:47.183115 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:47.184477 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "a599d439067d45dd84a2d6c82017207d"
format_stamp: "Formatted at 2026-02-07 20:52:47 on dist-test-slave-kqw4"
I20260207 20:52:47.187868 6060 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:47.190361 6010 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.223.61:45939: connect: Connection refused (error 111) [suppressed 20 similar messages]
I20260207 20:52:47.191676 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
W20260207 20:52:47.193753 6060 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:45939: Network error: Client connection negotiation failed: client connection to 127.2.223.61:45939: connect: Connection refused (error 111)
I20260207 20:52:47.195942 6073 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:47.196810 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260207 20:52:47.197156 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "a599d439067d45dd84a2d6c82017207d"
format_stamp: "Formatted at 2026-02-07 20:52:47 on dist-test-slave-kqw4"
I20260207 20:52:47.197497 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:47.232296 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:47.233588 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:47.250264 6060 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } attempt: 1
W20260207 20:52:47.255577 6060 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:45939: Network error: Client connection negotiation failed: client connection to 127.2.223.61:45939: connect: Connection refused (error 111)
I20260207 20:52:47.278028 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:45939
I20260207 20:52:47.278088 6124 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:45939 every 8 connection(s)
I20260207 20:52:47.282822 6125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:47.283000 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:47.289673 6125 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:47.289866 6128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:47.290568 6127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:47.295377 2940 server_base.cc:1060] running on GCE node
W20260207 20:52:47.296928 6130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:47.298029 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:47.298343 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:47.298627 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497567298575 us; error 0 us; skew 500 ppm
I20260207 20:52:47.299345 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:47.306006 6125 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:47.306988 2940 webserver.cc:492] Webserver started at http://127.2.223.60:37147/ using document root <none> and password file <none>
I20260207 20:52:47.307060 6060 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } attempt: 2
I20260207 20:52:47.307789 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:47.308087 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:47.308425 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:47.309816 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "48b172b8ce2e4d5bad345cd9fed49bd1"
format_stamp: "Formatted at 2026-02-07 20:52:47 on dist-test-slave-kqw4"
I20260207 20:52:47.321702 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.011s user 0.007s sys 0.003s
I20260207 20:52:47.332522 6138 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:47.333551 2940 fs_manager.cc:730] Time spent opening block manager: real 0.009s user 0.006s sys 0.003s
I20260207 20:52:47.333984 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "48b172b8ce2e4d5bad345cd9fed49bd1"
format_stamp: "Formatted at 2026-02-07 20:52:47 on dist-test-slave-kqw4"
I20260207 20:52:47.334486 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:47.337075 6125 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:47.338304 6060 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:47.345211 6060 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:41925: Network error: Client connection negotiation failed: client connection to 127.2.223.60:41925: connect: Connection refused (error 111)
W20260207 20:52:47.346513 6125 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:41925: Network error: Client connection negotiation failed: client connection to 127.2.223.60:41925: connect: Connection refused (error 111)
I20260207 20:52:47.364501 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:47.365841 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:47.369036 6125 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } attempt: 1
W20260207 20:52:47.372718 6125 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:41925: Network error: Client connection negotiation failed: client connection to 127.2.223.60:41925: connect: Connection refused (error 111)
I20260207 20:52:47.395673 6060 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } attempt: 1
W20260207 20:52:47.401022 6060 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:41925: Network error: Client connection negotiation failed: client connection to 127.2.223.60:41925: connect: Connection refused (error 111)
I20260207 20:52:47.411733 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:41925
I20260207 20:52:47.411847 6190 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:41925 every 8 connection(s)
I20260207 20:52:47.415666 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:52:47.416522 6191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:47.422406 6191 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:47.432880 6191 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:47.434522 6060 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } attempt: 2
I20260207 20:52:47.444694 6191 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:47.452244 6060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9: Bootstrap starting.
I20260207 20:52:47.454128 6125 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } attempt: 2
I20260207 20:52:47.459517 6060 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:47.465762 6060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9: No bootstrap required, opened a new log
I20260207 20:52:47.468458 6060 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } }
I20260207 20:52:47.469339 6060 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:47.469668 6060 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e4751a945e74ec6909c407ebcb3ebf9, State: Initialized, Role: FOLLOWER
I20260207 20:52:47.470537 6060 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } }
I20260207 20:52:47.472893 6191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1: Bootstrap starting.
I20260207 20:52:47.473363 6125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d: Bootstrap starting.
I20260207 20:52:47.479053 6191 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:47.478817 6197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } } }
I20260207 20:52:47.479518 6125 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:47.481138 6060 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:47.481422 6197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:47.484331 6191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1: No bootstrap required, opened a new log
I20260207 20:52:47.487222 6191 raft_consensus.cc:359] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } }
I20260207 20:52:47.488070 6191 raft_consensus.cc:385] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:47.488416 6191 raft_consensus.cc:740] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48b172b8ce2e4d5bad345cd9fed49bd1, State: Initialized, Role: FOLLOWER
I20260207 20:52:47.489295 6191 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } }
I20260207 20:52:47.492722 6201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } } }
I20260207 20:52:47.493474 6201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:47.494853 6191 sys_catalog.cc:565] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:47.495973 6125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d: No bootstrap required, opened a new log
I20260207 20:52:47.498982 6125 raft_consensus.cc:359] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } }
I20260207 20:52:47.499728 6125 raft_consensus.cc:385] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:47.500043 6125 raft_consensus.cc:740] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a599d439067d45dd84a2d6c82017207d, State: Initialized, Role: FOLLOWER
I20260207 20:52:47.500895 6125 consensus_queue.cc:260] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } }
I20260207 20:52:47.515451 6205 sys_catalog.cc:455] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } } }
I20260207 20:52:47.516237 6205 sys_catalog.cc:458] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:47.517174 6125 sys_catalog.cc:565] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:47.562640 6228 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260207 20:52:47.563800 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
W20260207 20:52:47.566536 6229 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:47.567004 6229 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:52:47.567821 6197 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:47.568260 6197 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } }
I20260207 20:52:47.570295 6197 leader_election.cc:290] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a599d439067d45dd84a2d6c82017207d (127.2.223.61:45939), 48b172b8ce2e4d5bad345cd9fed49bd1 (127.2.223.60:41925)
I20260207 20:52:47.571110 6100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a599d439067d45dd84a2d6c82017207d" is_pre_election: true
I20260207 20:52:47.571729 6166 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" is_pre_election: true
I20260207 20:52:47.571769 6100 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e4751a945e74ec6909c407ebcb3ebf9 in term 0.
I20260207 20:52:47.572368 6166 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e4751a945e74ec6909c407ebcb3ebf9 in term 0.
I20260207 20:52:47.573081 6010 leader_election.cc:304] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e4751a945e74ec6909c407ebcb3ebf9, a599d439067d45dd84a2d6c82017207d; no voters:
I20260207 20:52:47.574028 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:52:47.574297 6197 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:47.574684 6197 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:47.575001 6197 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:47.575778 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:47.578003 6234 catalog_manager.cc:1568] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:47.578356 6234 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:52:47.581101 6197 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } }
W20260207 20:52:47.583093 6235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:47.583801 6100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a599d439067d45dd84a2d6c82017207d"
I20260207 20:52:47.584271 6100 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:47.588048 6166 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1"
I20260207 20:52:47.588609 6166 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:47.589798 6100 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e4751a945e74ec6909c407ebcb3ebf9 in term 1.
I20260207 20:52:47.590914 6010 leader_election.cc:304] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e4751a945e74ec6909c407ebcb3ebf9, a599d439067d45dd84a2d6c82017207d; no voters:
I20260207 20:52:47.592646 6237 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:47.597543 6166 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e4751a945e74ec6909c407ebcb3ebf9 in term 1.
I20260207 20:52:47.599118 6197 leader_election.cc:290] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [CANDIDATE]: Term 1 election: Requested vote from peers a599d439067d45dd84a2d6c82017207d (127.2.223.61:45939), 48b172b8ce2e4d5bad345cd9fed49bd1 (127.2.223.60:41925)
I20260207 20:52:47.600628 6237 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [term 1 LEADER]: Becoming Leader. State: Replica: 5e4751a945e74ec6909c407ebcb3ebf9, State: Running, Role: LEADER
I20260207 20:52:47.601660 6237 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } }
W20260207 20:52:47.602613 6236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:47.612191 6240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:47.613125 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:47.613214 6197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e4751a945e74ec6909c407ebcb3ebf9. Latest consensus state: current_term: 1 leader_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } } }
I20260207 20:52:47.613955 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260207 20:52:47.614066 6197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [sys.catalog]: This master's current role is: LEADER
W20260207 20:52:47.614229 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:47.614497 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497567614480 us; error 0 us; skew 500 ppm
I20260207 20:52:47.615270 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:47.615537 6243 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:52:47.618145 2940 webserver.cc:492] Webserver started at http://127.2.223.1:42403/ using document root <none> and password file <none>
I20260207 20:52:47.618839 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:47.619130 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:47.619470 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:47.620850 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "687910bb7947442eb1444e5d54074978"
format_stamp: "Formatted at 2026-02-07 20:52:47 on dist-test-slave-kqw4"
I20260207 20:52:47.622679 6243 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:52:47.626693 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260207 20:52:47.630518 6248 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:47.631482 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260207 20:52:47.631862 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "687910bb7947442eb1444e5d54074978"
format_stamp: "Formatted at 2026-02-07 20:52:47 on dist-test-slave-kqw4"
I20260207 20:52:47.632635 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:47.633606 6166 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [term 1 FOLLOWER]: Refusing update from remote peer 5e4751a945e74ec6909c407ebcb3ebf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:47.633667 6100 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [term 1 FOLLOWER]: Refusing update from remote peer 5e4751a945e74ec6909c407ebcb3ebf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:47.635391 6237 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:47.636056 6197 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:47.645713 6201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e4751a945e74ec6909c407ebcb3ebf9. Latest consensus state: current_term: 1 leader_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } } }
I20260207 20:52:47.646410 6201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:47.650233 6205 sys_catalog.cc:455] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e4751a945e74ec6909c407ebcb3ebf9. Latest consensus state: current_term: 1 leader_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } } }
I20260207 20:52:47.650954 6205 sys_catalog.cc:458] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:47.666360 6197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } } }
I20260207 20:52:47.667344 6197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:47.667717 6205 sys_catalog.cc:455] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } } }
I20260207 20:52:47.668401 6205 sys_catalog.cc:458] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:47.668162 6197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } } }
I20260207 20:52:47.668814 6197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:47.670831 6201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4751a945e74ec6909c407ebcb3ebf9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44901 } } peers { permanent_uuid: "a599d439067d45dd84a2d6c82017207d" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45939 } } peers { permanent_uuid: "48b172b8ce2e4d5bad345cd9fed49bd1" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 41925 } } }
I20260207 20:52:47.671535 6201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:47.672537 6243 catalog_manager.cc:1357] Generated new cluster ID: c9436c052eea4a809607c20fcb04d174
I20260207 20:52:47.672887 6243 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:52:47.681713 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:47.683108 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:47.684937 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:47.687911 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:47.688148 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:47.688401 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:47.688588 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:47.712404 6243 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:52:47.713742 6243 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:52:47.738315 6243 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9: Generated new TSK 0
I20260207 20:52:47.739104 6243 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:52:47.773360 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:35831
I20260207 20:52:47.773427 6317 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:35831 every 8 connection(s)
I20260207 20:52:47.791793 6318 heartbeater.cc:344] Connected to a master server at 127.2.223.60:41925
I20260207 20:52:47.792253 6318 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:47.793166 6318 heartbeater.cc:507] Master 127.2.223.60:41925 requested a full tablet report, sending...
I20260207 20:52:47.796150 6156 ts_manager.cc:194] Registered new tserver with Master: 687910bb7947442eb1444e5d54074978 (127.2.223.1:35831)
I20260207 20:52:47.810459 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:47.816068 6319 heartbeater.cc:344] Connected to a master server at 127.2.223.61:45939
I20260207 20:52:47.816505 6319 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:47.817317 6319 heartbeater.cc:507] Master 127.2.223.61:45939 requested a full tablet report, sending...
I20260207 20:52:47.819929 6090 ts_manager.cc:194] Registered new tserver with Master: 687910bb7947442eb1444e5d54074978 (127.2.223.1:35831)
I20260207 20:52:47.822110 6321 heartbeater.cc:344] Connected to a master server at 127.2.223.62:44901
I20260207 20:52:47.822548 6321 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:47.823531 6321 heartbeater.cc:507] Master 127.2.223.62:44901 requested a full tablet report, sending...
W20260207 20:52:47.824638 6324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:47.826023 6025 ts_manager.cc:194] Registered new tserver with Master: 687910bb7947442eb1444e5d54074978 (127.2.223.1:35831)
I20260207 20:52:47.828835 6025 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39182
W20260207 20:52:47.826719 6325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:47.835340 6327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:47.838980 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:47.839874 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:47.840080 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:47.840237 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497567840225 us; error 0 us; skew 500 ppm
I20260207 20:52:47.840752 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:47.842036 6321 heartbeater.cc:499] Master 127.2.223.62:44901 was elected leader, sending a full tablet report...
I20260207 20:52:47.846621 2940 webserver.cc:492] Webserver started at http://127.2.223.2:38867/ using document root <none> and password file <none>
I20260207 20:52:47.847266 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:47.847465 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:47.847720 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:47.848940 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "d704a417007542bc94fc002473aa2fdf"
format_stamp: "Formatted at 2026-02-07 20:52:47 on dist-test-slave-kqw4"
I20260207 20:52:47.853274 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:52:47.856606 6332 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:47.857437 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:52:47.857784 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "d704a417007542bc94fc002473aa2fdf"
format_stamp: "Formatted at 2026-02-07 20:52:47 on dist-test-slave-kqw4"
I20260207 20:52:47.858120 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:47.887912 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:47.889396 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:47.891081 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:47.894526 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:47.894840 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260207 20:52:47.895177 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:47.895457 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:47.962049 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:34387
I20260207 20:52:47.963878 6394 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:34387 every 8 connection(s)
I20260207 20:52:47.994536 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:48.003613 6395 heartbeater.cc:344] Connected to a master server at 127.2.223.60:41925
I20260207 20:52:48.004129 6395 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:48.005018 6395 heartbeater.cc:507] Master 127.2.223.60:41925 requested a full tablet report, sending...
I20260207 20:52:48.008318 6397 heartbeater.cc:344] Connected to a master server at 127.2.223.62:44901
I20260207 20:52:48.008693 6397 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:48.009479 6397 heartbeater.cc:507] Master 127.2.223.62:44901 requested a full tablet report, sending...
I20260207 20:52:48.010779 6155 ts_manager.cc:194] Registered new tserver with Master: d704a417007542bc94fc002473aa2fdf (127.2.223.2:34387)
I20260207 20:52:48.011860 6025 ts_manager.cc:194] Registered new tserver with Master: d704a417007542bc94fc002473aa2fdf (127.2.223.2:34387)
I20260207 20:52:48.013700 6025 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39186
I20260207 20:52:48.017880 6396 heartbeater.cc:344] Connected to a master server at 127.2.223.61:45939
I20260207 20:52:48.018302 6396 heartbeater.cc:461] Registering TS with master...
W20260207 20:52:48.019263 6402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:48.020722 6396 heartbeater.cc:507] Master 127.2.223.61:45939 requested a full tablet report, sending...
W20260207 20:52:48.022935 6403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:48.023699 6089 ts_manager.cc:194] Registered new tserver with Master: d704a417007542bc94fc002473aa2fdf (127.2.223.2:34387)
I20260207 20:52:48.027519 6397 heartbeater.cc:499] Master 127.2.223.62:44901 was elected leader, sending a full tablet report...
W20260207 20:52:48.036815 6406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:48.036787 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:48.039001 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:48.039270 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:48.039494 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497568039476 us; error 0 us; skew 500 ppm
I20260207 20:52:48.040220 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:48.050029 2940 webserver.cc:492] Webserver started at http://127.2.223.3:43431/ using document root <none> and password file <none>
I20260207 20:52:48.050498 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:48.050716 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:48.050962 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:48.051978 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe"
format_stamp: "Formatted at 2026-02-07 20:52:48 on dist-test-slave-kqw4"
I20260207 20:52:48.064031 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.011s user 0.003s sys 0.007s
I20260207 20:52:48.069850 6410 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:48.070974 2940 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260207 20:52:48.071321 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe"
format_stamp: "Formatted at 2026-02-07 20:52:48 on dist-test-slave-kqw4"
I20260207 20:52:48.071651 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:48.095355 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:48.096261 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:48.097607 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:48.100025 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:48.100203 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:48.100427 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:48.100613 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:48.243073 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:46169
I20260207 20:52:48.243163 6472 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:46169 every 8 connection(s)
I20260207 20:52:48.287611 6473 heartbeater.cc:344] Connected to a master server at 127.2.223.60:41925
I20260207 20:52:48.288113 6473 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:48.289055 6473 heartbeater.cc:507] Master 127.2.223.60:41925 requested a full tablet report, sending...
I20260207 20:52:48.293128 6474 heartbeater.cc:344] Connected to a master server at 127.2.223.61:45939
I20260207 20:52:48.293591 6474 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:48.294437 6474 heartbeater.cc:507] Master 127.2.223.61:45939 requested a full tablet report, sending...
I20260207 20:52:48.299088 6090 ts_manager.cc:194] Registered new tserver with Master: a7e924d2633e4d8ca6f7c6a352c0cbfe (127.2.223.3:46169)
I20260207 20:52:48.294499 6156 ts_manager.cc:194] Registered new tserver with Master: a7e924d2633e4d8ca6f7c6a352c0cbfe (127.2.223.3:46169)
I20260207 20:52:48.344964 6477 heartbeater.cc:344] Connected to a master server at 127.2.223.62:44901
I20260207 20:52:48.345376 6477 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:48.346184 6477 heartbeater.cc:507] Master 127.2.223.62:44901 requested a full tablet report, sending...
I20260207 20:52:48.350399 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019837379s
I20260207 20:52:48.349494 6025 ts_manager.cc:194] Registered new tserver with Master: a7e924d2633e4d8ca6f7c6a352c0cbfe (127.2.223.3:46169)
I20260207 20:52:48.354740 6025 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39200
I20260207 20:52:48.367729 6477 heartbeater.cc:499] Master 127.2.223.62:44901 was elected leader, sending a full tablet report...
I20260207 20:52:48.466542 6024 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39206:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:52:48.469096 6024 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:52:48.576050 6228 catalog_manager.cc:1269] Loaded cluster ID: c9436c052eea4a809607c20fcb04d174
I20260207 20:52:48.579164 6228 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1: loading cluster ID for follower catalog manager: success
I20260207 20:52:48.594988 6234 catalog_manager.cc:1269] Loaded cluster ID: c9436c052eea4a809607c20fcb04d174
I20260207 20:52:48.595404 6234 catalog_manager.cc:1562] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d: loading cluster ID for follower catalog manager: success
I20260207 20:52:48.602420 6228 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1: acquiring CA information for follower catalog manager: success
I20260207 20:52:48.610004 6234 catalog_manager.cc:1584] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d: acquiring CA information for follower catalog manager: success
I20260207 20:52:48.618502 6228 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:52:48.619864 6234 catalog_manager.cc:1612] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:52:48.680807 6281 tablet_service.cc:1505] Processing CreateTablet for tablet 1075d452080b43eabe4628bf840f3df0 (DEFAULT_TABLE table=ksck-test-table [id=59006f83d6084377a1d901b30a244be7]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:48.683894 6282 tablet_service.cc:1505] Processing CreateTablet for tablet eccfde807f124649808ef0934306db2b (DEFAULT_TABLE table=ksck-test-table [id=59006f83d6084377a1d901b30a244be7]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:48.685889 6282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eccfde807f124649808ef0934306db2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:48.686691 6436 tablet_service.cc:1505] Processing CreateTablet for tablet 1075d452080b43eabe4628bf840f3df0 (DEFAULT_TABLE table=ksck-test-table [id=59006f83d6084377a1d901b30a244be7]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:48.687727 6283 tablet_service.cc:1505] Processing CreateTablet for tablet 7be85bf0da084231922e3ff3eacbf9a4 (DEFAULT_TABLE table=ksck-test-table [id=59006f83d6084377a1d901b30a244be7]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:48.687918 6438 tablet_service.cc:1505] Processing CreateTablet for tablet 7be85bf0da084231922e3ff3eacbf9a4 (DEFAULT_TABLE table=ksck-test-table [id=59006f83d6084377a1d901b30a244be7]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:48.689205 6283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be85bf0da084231922e3ff3eacbf9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:48.691375 6281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1075d452080b43eabe4628bf840f3df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:48.691710 6437 tablet_service.cc:1505] Processing CreateTablet for tablet eccfde807f124649808ef0934306db2b (DEFAULT_TABLE table=ksck-test-table [id=59006f83d6084377a1d901b30a244be7]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:48.712275 6438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be85bf0da084231922e3ff3eacbf9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:48.715801 6437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eccfde807f124649808ef0934306db2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:48.733572 6436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1075d452080b43eabe4628bf840f3df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:48.749928 6502 tablet_bootstrap.cc:492] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978: Bootstrap starting.
I20260207 20:52:48.814860 6502 tablet_bootstrap.cc:654] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:48.843894 6503 tablet_bootstrap.cc:492] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe: Bootstrap starting.
I20260207 20:52:48.847533 6360 tablet_service.cc:1505] Processing CreateTablet for tablet 7be85bf0da084231922e3ff3eacbf9a4 (DEFAULT_TABLE table=ksck-test-table [id=59006f83d6084377a1d901b30a244be7]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:48.849071 6360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be85bf0da084231922e3ff3eacbf9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:48.851662 6359 tablet_service.cc:1505] Processing CreateTablet for tablet eccfde807f124649808ef0934306db2b (DEFAULT_TABLE table=ksck-test-table [id=59006f83d6084377a1d901b30a244be7]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:48.853019 6359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eccfde807f124649808ef0934306db2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:48.855728 6358 tablet_service.cc:1505] Processing CreateTablet for tablet 1075d452080b43eabe4628bf840f3df0 (DEFAULT_TABLE table=ksck-test-table [id=59006f83d6084377a1d901b30a244be7]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:48.856359 6503 tablet_bootstrap.cc:654] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:48.857044 6358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1075d452080b43eabe4628bf840f3df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:48.907461 6502 tablet_bootstrap.cc:492] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978: No bootstrap required, opened a new log
I20260207 20:52:48.908100 6502 ts_tablet_manager.cc:1403] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978: Time spent bootstrapping tablet: real 0.159s user 0.009s sys 0.035s
I20260207 20:52:48.911550 6502 raft_consensus.cc:359] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } } peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } }
I20260207 20:52:48.912499 6502 raft_consensus.cc:385] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:48.912899 6502 raft_consensus.cc:740] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687910bb7947442eb1444e5d54074978, State: Initialized, Role: FOLLOWER
I20260207 20:52:48.913779 6502 consensus_queue.cc:260] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } } peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } }
I20260207 20:52:48.932116 6506 tablet_bootstrap.cc:492] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf: Bootstrap starting.
I20260207 20:52:48.942413 6503 tablet_bootstrap.cc:492] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe: No bootstrap required, opened a new log
I20260207 20:52:48.942962 6503 ts_tablet_manager.cc:1403] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe: Time spent bootstrapping tablet: real 0.099s user 0.024s sys 0.032s
I20260207 20:52:48.945853 6503 raft_consensus.cc:359] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } } peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } }
I20260207 20:52:48.950402 6502 ts_tablet_manager.cc:1434] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978: Time spent starting tablet: real 0.042s user 0.005s sys 0.010s
I20260207 20:52:48.955354 6506 tablet_bootstrap.cc:654] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:48.968605 6502 tablet_bootstrap.cc:492] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978: Bootstrap starting.
I20260207 20:52:48.973222 6503 raft_consensus.cc:385] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:48.973652 6503 raft_consensus.cc:740] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e924d2633e4d8ca6f7c6a352c0cbfe, State: Initialized, Role: FOLLOWER
I20260207 20:52:48.974337 6503 consensus_queue.cc:260] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } } peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } }
I20260207 20:52:48.986876 6506 tablet_bootstrap.cc:492] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf: No bootstrap required, opened a new log
I20260207 20:52:48.987468 6506 ts_tablet_manager.cc:1403] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf: Time spent bootstrapping tablet: real 0.056s user 0.012s sys 0.010s
I20260207 20:52:48.988554 6502 tablet_bootstrap.cc:654] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:48.990712 6506 raft_consensus.cc:359] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } } peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } }
I20260207 20:52:48.991398 6506 raft_consensus.cc:385] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:48.991681 6506 raft_consensus.cc:740] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d704a417007542bc94fc002473aa2fdf, State: Initialized, Role: FOLLOWER
I20260207 20:52:48.996856 6503 ts_tablet_manager.cc:1434] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe: Time spent starting tablet: real 0.054s user 0.007s sys 0.000s
I20260207 20:52:48.997026 6506 consensus_queue.cc:260] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } } peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } }
I20260207 20:52:49.003625 6503 tablet_bootstrap.cc:492] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe: Bootstrap starting.
I20260207 20:52:49.017498 6502 tablet_bootstrap.cc:492] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978: No bootstrap required, opened a new log
I20260207 20:52:49.031774 6502 ts_tablet_manager.cc:1403] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978: Time spent bootstrapping tablet: real 0.063s user 0.013s sys 0.008s
I20260207 20:52:49.031176 6506 ts_tablet_manager.cc:1434] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf: Time spent starting tablet: real 0.043s user 0.007s sys 0.003s
I20260207 20:52:49.036780 6506 tablet_bootstrap.cc:492] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf: Bootstrap starting.
I20260207 20:52:49.047394 6502 raft_consensus.cc:359] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.048288 6502 raft_consensus.cc:385] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:49.048658 6502 raft_consensus.cc:740] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687910bb7947442eb1444e5d54074978, State: Initialized, Role: FOLLOWER
I20260207 20:52:49.049551 6502 consensus_queue.cc:260] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.050724 6506 tablet_bootstrap.cc:654] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:49.056094 6502 ts_tablet_manager.cc:1434] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978: Time spent starting tablet: real 0.024s user 0.004s sys 0.001s
I20260207 20:52:49.034226 6503 tablet_bootstrap.cc:654] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe: Neither blocks nor log segments found. Creating new log.
W20260207 20:52:49.060459 6323 tablet.cc:2378] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260207 20:52:49.066566 6502 tablet_bootstrap.cc:492] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978: Bootstrap starting.
I20260207 20:52:49.086891 6506 tablet_bootstrap.cc:492] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf: No bootstrap required, opened a new log
I20260207 20:52:49.087606 6506 ts_tablet_manager.cc:1403] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf: Time spent bootstrapping tablet: real 0.051s user 0.015s sys 0.001s
I20260207 20:52:49.093142 6506 raft_consensus.cc:359] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.093955 6506 raft_consensus.cc:385] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:49.094295 6506 raft_consensus.cc:740] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d704a417007542bc94fc002473aa2fdf, State: Initialized, Role: FOLLOWER
I20260207 20:52:49.095057 6506 consensus_queue.cc:260] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.099447 6506 ts_tablet_manager.cc:1434] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20260207 20:52:49.100664 6506 tablet_bootstrap.cc:492] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf: Bootstrap starting.
I20260207 20:52:49.114027 6506 tablet_bootstrap.cc:654] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:49.128176 6506 tablet_bootstrap.cc:492] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf: No bootstrap required, opened a new log
I20260207 20:52:49.128748 6506 ts_tablet_manager.cc:1403] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.005s
I20260207 20:52:49.131757 6506 raft_consensus.cc:359] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.132508 6506 raft_consensus.cc:385] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:49.132854 6506 raft_consensus.cc:740] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d704a417007542bc94fc002473aa2fdf, State: Initialized, Role: FOLLOWER
I20260207 20:52:49.133577 6506 consensus_queue.cc:260] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.128859 6502 tablet_bootstrap.cc:654] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:49.142841 6506 ts_tablet_manager.cc:1434] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf: Time spent starting tablet: real 0.014s user 0.002s sys 0.004s
I20260207 20:52:49.142969 6507 raft_consensus.cc:493] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:49.143479 6507 raft_consensus.cc:515] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } } peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } }
I20260207 20:52:49.161242 6502 tablet_bootstrap.cc:492] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978: No bootstrap required, opened a new log
I20260207 20:52:49.161787 6502 ts_tablet_manager.cc:1403] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978: Time spent bootstrapping tablet: real 0.095s user 0.013s sys 0.009s
I20260207 20:52:49.161996 6507 leader_election.cc:290] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e924d2633e4d8ca6f7c6a352c0cbfe (127.2.223.3:46169), d704a417007542bc94fc002473aa2fdf (127.2.223.2:34387)
I20260207 20:52:49.177249 6502 raft_consensus.cc:359] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.178156 6502 raft_consensus.cc:385] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:49.178517 6502 raft_consensus.cc:740] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687910bb7947442eb1444e5d54074978, State: Initialized, Role: FOLLOWER
I20260207 20:52:49.179320 6502 consensus_queue.cc:260] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.181977 6502 ts_tablet_manager.cc:1434] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260207 20:52:49.203204 6448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7be85bf0da084231922e3ff3eacbf9a4" candidate_uuid: "687910bb7947442eb1444e5d54074978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" is_pre_election: true
I20260207 20:52:49.204110 6448 raft_consensus.cc:2468] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687910bb7947442eb1444e5d54074978 in term 0.
I20260207 20:52:49.207016 6254 leader_election.cc:304] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687910bb7947442eb1444e5d54074978, a7e924d2633e4d8ca6f7c6a352c0cbfe; no voters:
I20260207 20:52:49.207095 6370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7be85bf0da084231922e3ff3eacbf9a4" candidate_uuid: "687910bb7947442eb1444e5d54074978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d704a417007542bc94fc002473aa2fdf" is_pre_election: true
I20260207 20:52:49.207909 6370 raft_consensus.cc:2468] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687910bb7947442eb1444e5d54074978 in term 0.
I20260207 20:52:49.209367 6507 raft_consensus.cc:2804] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:49.209746 6507 raft_consensus.cc:493] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:49.210070 6507 raft_consensus.cc:3060] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:49.217303 6507 raft_consensus.cc:515] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } } peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } }
I20260207 20:52:49.224853 6507 leader_election.cc:290] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [CANDIDATE]: Term 1 election: Requested vote from peers a7e924d2633e4d8ca6f7c6a352c0cbfe (127.2.223.3:46169), d704a417007542bc94fc002473aa2fdf (127.2.223.2:34387)
I20260207 20:52:49.225509 6503 tablet_bootstrap.cc:492] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe: No bootstrap required, opened a new log
I20260207 20:52:49.226037 6503 ts_tablet_manager.cc:1403] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe: Time spent bootstrapping tablet: real 0.223s user 0.011s sys 0.003s
I20260207 20:52:49.228859 6503 raft_consensus.cc:359] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.229581 6503 raft_consensus.cc:385] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:49.230096 6503 raft_consensus.cc:740] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e924d2633e4d8ca6f7c6a352c0cbfe, State: Initialized, Role: FOLLOWER
I20260207 20:52:49.232034 6503 consensus_queue.cc:260] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.234791 6448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7be85bf0da084231922e3ff3eacbf9a4" candidate_uuid: "687910bb7947442eb1444e5d54074978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe"
I20260207 20:52:49.240787 6448 raft_consensus.cc:3060] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:49.235921 6370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7be85bf0da084231922e3ff3eacbf9a4" candidate_uuid: "687910bb7947442eb1444e5d54074978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d704a417007542bc94fc002473aa2fdf"
I20260207 20:52:49.242906 6370 raft_consensus.cc:3060] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:49.255657 6370 raft_consensus.cc:2468] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687910bb7947442eb1444e5d54074978 in term 1.
I20260207 20:52:49.256964 6254 leader_election.cc:304] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687910bb7947442eb1444e5d54074978, d704a417007542bc94fc002473aa2fdf; no voters:
I20260207 20:52:49.257900 6507 raft_consensus.cc:2804] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:49.259070 6507 raft_consensus.cc:697] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [term 1 LEADER]: Becoming Leader. State: Replica: 687910bb7947442eb1444e5d54074978, State: Running, Role: LEADER
I20260207 20:52:49.260083 6507 consensus_queue.cc:237] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } } peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } }
I20260207 20:52:49.258308 6448 raft_consensus.cc:2468] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687910bb7947442eb1444e5d54074978 in term 1.
I20260207 20:52:49.267386 6503 ts_tablet_manager.cc:1434] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe: Time spent starting tablet: real 0.041s user 0.003s sys 0.004s
I20260207 20:52:49.268496 6503 tablet_bootstrap.cc:492] T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe: Bootstrap starting.
I20260207 20:52:49.276893 6503 tablet_bootstrap.cc:654] T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:49.281098 6507 raft_consensus.cc:493] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:49.281721 6507 raft_consensus.cc:515] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.284703 6370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1075d452080b43eabe4628bf840f3df0" candidate_uuid: "687910bb7947442eb1444e5d54074978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d704a417007542bc94fc002473aa2fdf" is_pre_election: true
I20260207 20:52:49.285348 6370 raft_consensus.cc:2468] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687910bb7947442eb1444e5d54074978 in term 0.
I20260207 20:52:49.286639 6254 leader_election.cc:304] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687910bb7947442eb1444e5d54074978, d704a417007542bc94fc002473aa2fdf; no voters:
I20260207 20:52:49.282241 6511 raft_consensus.cc:493] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:49.295774 6511 raft_consensus.cc:515] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.299161 6507 leader_election.cc:290] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d704a417007542bc94fc002473aa2fdf (127.2.223.2:34387), a7e924d2633e4d8ca6f7c6a352c0cbfe (127.2.223.3:46169)
I20260207 20:52:49.299855 6507 raft_consensus.cc:2804] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:49.300320 6507 raft_consensus.cc:493] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:49.301872 6507 raft_consensus.cc:3060] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:49.302706 6511 leader_election.cc:290] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687910bb7947442eb1444e5d54074978 (127.2.223.1:35831), a7e924d2633e4d8ca6f7c6a352c0cbfe (127.2.223.3:46169)
I20260207 20:52:49.299973 6448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1075d452080b43eabe4628bf840f3df0" candidate_uuid: "687910bb7947442eb1444e5d54074978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" is_pre_election: true
I20260207 20:52:49.315336 6021 catalog_manager.cc:5654] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 reported cstate change: term changed from 0 to 1, leader changed from <none> to 687910bb7947442eb1444e5d54074978 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "687910bb7947442eb1444e5d54074978" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:49.317603 6503 tablet_bootstrap.cc:492] T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe: No bootstrap required, opened a new log
I20260207 20:52:49.318158 6503 ts_tablet_manager.cc:1403] T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe: Time spent bootstrapping tablet: real 0.050s user 0.014s sys 0.004s
I20260207 20:52:49.320915 6507 raft_consensus.cc:515] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.321219 6503 raft_consensus.cc:359] T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.322114 6503 raft_consensus.cc:385] T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:49.322486 6503 raft_consensus.cc:740] T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e924d2633e4d8ca6f7c6a352c0cbfe, State: Initialized, Role: FOLLOWER
I20260207 20:52:49.323058 6507 leader_election.cc:290] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [CANDIDATE]: Term 1 election: Requested vote from peers d704a417007542bc94fc002473aa2fdf (127.2.223.2:34387), a7e924d2633e4d8ca6f7c6a352c0cbfe (127.2.223.3:46169)
I20260207 20:52:49.323693 6503 consensus_queue.cc:260] T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.341874 6509 raft_consensus.cc:493] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:49.342401 6509 raft_consensus.cc:515] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.344017 6519 raft_consensus.cc:493] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:49.344512 6519 raft_consensus.cc:515] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.356081 6509 leader_election.cc:290] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 687910bb7947442eb1444e5d54074978 (127.2.223.1:35831), d704a417007542bc94fc002473aa2fdf (127.2.223.2:34387)
I20260207 20:52:49.381832 6370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1075d452080b43eabe4628bf840f3df0" candidate_uuid: "687910bb7947442eb1444e5d54074978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d704a417007542bc94fc002473aa2fdf"
I20260207 20:52:49.382504 6370 raft_consensus.cc:3060] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Advancing to term 1
W20260207 20:52:49.355193 6254 leader_election.cc:343] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e924d2633e4d8ca6f7c6a352c0cbfe (127.2.223.3:46169): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:52:49.380940 6519 leader_election.cc:290] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d704a417007542bc94fc002473aa2fdf (127.2.223.2:34387), a7e924d2633e4d8ca6f7c6a352c0cbfe (127.2.223.3:46169)
I20260207 20:52:49.396770 6448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1075d452080b43eabe4628bf840f3df0" candidate_uuid: "687910bb7947442eb1444e5d54074978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe"
I20260207 20:52:49.397406 6448 raft_consensus.cc:3060] T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:49.409092 6369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eccfde807f124649808ef0934306db2b" candidate_uuid: "687910bb7947442eb1444e5d54074978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d704a417007542bc94fc002473aa2fdf" is_pre_election: true
I20260207 20:52:49.409878 6369 raft_consensus.cc:2468] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 687910bb7947442eb1444e5d54074978 in term 0.
I20260207 20:52:49.411878 6370 raft_consensus.cc:2468] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687910bb7947442eb1444e5d54074978 in term 1.
I20260207 20:52:49.416347 6448 raft_consensus.cc:2468] T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687910bb7947442eb1444e5d54074978 in term 1.
I20260207 20:52:49.417064 6293 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eccfde807f124649808ef0934306db2b" candidate_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687910bb7947442eb1444e5d54074978" is_pre_election: true
I20260207 20:52:49.418462 6293 raft_consensus.cc:2468] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e924d2633e4d8ca6f7c6a352c0cbfe in term 0.
W20260207 20:52:49.403759 6254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.223.3:46169, user_credentials={real_user=slave}} blocked reactor thread for 48625.4us
I20260207 20:52:49.420244 6254 leader_election.cc:304] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687910bb7947442eb1444e5d54074978, d704a417007542bc94fc002473aa2fdf; no voters:
I20260207 20:52:49.421969 6503 ts_tablet_manager.cc:1434] T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe: Time spent starting tablet: real 0.103s user 0.003s sys 0.004s
I20260207 20:52:49.422685 6414 leader_election.cc:304] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687910bb7947442eb1444e5d54074978, a7e924d2633e4d8ca6f7c6a352c0cbfe; no voters:
I20260207 20:52:49.426621 6519 raft_consensus.cc:2804] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:49.427030 6519 raft_consensus.cc:493] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:49.427105 6509 raft_consensus.cc:2804] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:49.427534 6509 raft_consensus.cc:493] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:49.427929 6509 raft_consensus.cc:3060] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:49.424819 6448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eccfde807f124649808ef0934306db2b" candidate_uuid: "687910bb7947442eb1444e5d54074978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" is_pre_election: true
I20260207 20:52:49.437011 6509 raft_consensus.cc:515] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.438349 6448 raft_consensus.cc:2393] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 687910bb7947442eb1444e5d54074978 in current term 1: Already voted for candidate a7e924d2633e4d8ca6f7c6a352c0cbfe in this term.
I20260207 20:52:49.427416 6519 raft_consensus.cc:3060] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:49.441129 6293 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eccfde807f124649808ef0934306db2b" candidate_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687910bb7947442eb1444e5d54074978"
I20260207 20:52:49.427421 6254 leader_election.cc:304] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 687910bb7947442eb1444e5d54074978, d704a417007542bc94fc002473aa2fdf; no voters:
I20260207 20:52:49.451943 6509 leader_election.cc:290] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [CANDIDATE]: Term 1 election: Requested vote from peers 687910bb7947442eb1444e5d54074978 (127.2.223.1:35831), d704a417007542bc94fc002473aa2fdf (127.2.223.2:34387)
I20260207 20:52:49.452313 6507 raft_consensus.cc:2804] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:49.455937 6507 raft_consensus.cc:697] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [term 1 LEADER]: Becoming Leader. State: Replica: 687910bb7947442eb1444e5d54074978, State: Running, Role: LEADER
I20260207 20:52:49.457237 6507 consensus_queue.cc:237] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.465071 6370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eccfde807f124649808ef0934306db2b" candidate_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d704a417007542bc94fc002473aa2fdf" is_pre_election: true
I20260207 20:52:49.466723 6369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eccfde807f124649808ef0934306db2b" candidate_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d704a417007542bc94fc002473aa2fdf"
I20260207 20:52:49.466965 6370 raft_consensus.cc:2468] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e924d2633e4d8ca6f7c6a352c0cbfe in term 0.
I20260207 20:52:49.454718 6519 raft_consensus.cc:515] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.478156 6447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eccfde807f124649808ef0934306db2b" candidate_uuid: "d704a417007542bc94fc002473aa2fdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" is_pre_election: true
I20260207 20:52:49.485224 6447 raft_consensus.cc:2393] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d704a417007542bc94fc002473aa2fdf in current term 1: Already voted for candidate a7e924d2633e4d8ca6f7c6a352c0cbfe in this term.
I20260207 20:52:49.485255 6293 raft_consensus.cc:2393] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e924d2633e4d8ca6f7c6a352c0cbfe in current term 1: Already voted for candidate 687910bb7947442eb1444e5d54074978 in this term.
I20260207 20:52:49.486331 6519 leader_election.cc:290] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [CANDIDATE]: Term 1 election: Requested vote from peers d704a417007542bc94fc002473aa2fdf (127.2.223.2:34387), a7e924d2633e4d8ca6f7c6a352c0cbfe (127.2.223.3:46169)
I20260207 20:52:49.488088 6414 leader_election.cc:304] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e924d2633e4d8ca6f7c6a352c0cbfe; no voters: 687910bb7947442eb1444e5d54074978, d704a417007542bc94fc002473aa2fdf
I20260207 20:52:49.489184 6509 raft_consensus.cc:2749] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260207 20:52:49.489801 6447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eccfde807f124649808ef0934306db2b" candidate_uuid: "687910bb7947442eb1444e5d54074978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe"
I20260207 20:52:49.490833 6447 raft_consensus.cc:2393] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 687910bb7947442eb1444e5d54074978 in current term 1: Already voted for candidate a7e924d2633e4d8ca6f7c6a352c0cbfe in this term.
I20260207 20:52:49.491816 6369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eccfde807f124649808ef0934306db2b" candidate_uuid: "687910bb7947442eb1444e5d54074978" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d704a417007542bc94fc002473aa2fdf"
I20260207 20:52:49.492355 6369 raft_consensus.cc:3060] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:49.513718 6369 raft_consensus.cc:2468] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 687910bb7947442eb1444e5d54074978 in term 1.
I20260207 20:52:49.516139 6254 leader_election.cc:304] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 687910bb7947442eb1444e5d54074978, d704a417007542bc94fc002473aa2fdf; no voters: a7e924d2633e4d8ca6f7c6a352c0cbfe
I20260207 20:52:49.517177 6519 raft_consensus.cc:2804] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:49.517668 6519 raft_consensus.cc:697] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 1 LEADER]: Becoming Leader. State: Replica: 687910bb7947442eb1444e5d54074978, State: Running, Role: LEADER
I20260207 20:52:49.518950 6519 consensus_queue.cc:237] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } }
I20260207 20:52:49.525712 6293 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eccfde807f124649808ef0934306db2b" candidate_uuid: "d704a417007542bc94fc002473aa2fdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "687910bb7947442eb1444e5d54074978" is_pre_election: true
I20260207 20:52:49.527354 6336 leader_election.cc:304] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d704a417007542bc94fc002473aa2fdf; no voters: 687910bb7947442eb1444e5d54074978, a7e924d2633e4d8ca6f7c6a352c0cbfe
I20260207 20:52:49.528469 6511 raft_consensus.cc:2749] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:52:49.561641 6023 catalog_manager.cc:5654] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 reported cstate change: term changed from 0 to 1, leader changed from <none> to 687910bb7947442eb1444e5d54074978 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "687910bb7947442eb1444e5d54074978" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:49.563623 6023 catalog_manager.cc:5654] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 reported cstate change: term changed from 0 to 1, leader changed from <none> to 687910bb7947442eb1444e5d54074978 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "687910bb7947442eb1444e5d54074978" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "687910bb7947442eb1444e5d54074978" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:49.735046 6519 consensus_queue.cc:1048] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:49.770381 6519 consensus_queue.cc:1048] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:49.801255 2940 ksck_remote-test.cc:410] Generating row writes...
I20260207 20:52:49.930804 6519 consensus_queue.cc:1048] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:49.960501 6519 consensus_queue.cc:1048] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e924d2633e4d8ca6f7c6a352c0cbfe" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260207 20:52:49.992944 6532 consensus_queue.cc:1048] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:49.994211 6532 consensus_queue.cc:1048] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d704a417007542bc94fc002473aa2fdf" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 34387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260207 20:52:51.501472 6573 log.cc:927] Time spent T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf: Append to log took a long time: real 0.060s user 0.012s sys 0.000s
W20260207 20:52:51.520272 6572 log.cc:927] Time spent T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe: Append to log took a long time: real 0.059s user 0.011s sys 0.000s
I20260207 20:52:52.611114 6563 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49542 (ReqId={client: 9b540707b99f4397bff542fb477589fa, seq_no=0, attempt_no=0}) took 1630 ms. Trace:
I20260207 20:52:52.611650 6563 rpcz_store.cc:276] 0207 20:52:50.980015 (+ 0us) service_pool.cc:168] Inserting onto call queue
0207 20:52:50.980614 (+ 599us) service_pool.cc:225] Handling call
0207 20:52:52.610346 (+1629732us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0207 20:52:51.009287 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 1075d452080b43eabe4628bf840f3df0
0207 20:52:51.009709 (+ 422us) write_op.cc:432] Acquiring schema lock in shared mode
0207 20:52:51.009737 (+ 28us) write_op.cc:435] Acquired schema lock
0207 20:52:51.009750 (+ 13us) tablet.cc:660] Decoding operations
0207 20:52:51.247870 (+238120us) write_op.cc:620] Acquiring the partition lock for write op
0207 20:52:51.247934 (+ 64us) write_op.cc:641] Partition lock acquired for write op
0207 20:52:51.247960 (+ 26us) tablet.cc:683] Acquiring locks for 3495 operations
0207 20:52:51.357957 (+109997us) tablet.cc:699] Row locks acquired
0207 20:52:51.357975 (+ 18us) write_op.cc:260] PREPARE: finished
0207 20:52:51.358136 (+ 161us) write_op.cc:270] Start()
0207 20:52:51.358241 (+ 105us) write_op.cc:276] Timestamp: P: 1770497571358096 usec, L: 0
0207 20:52:51.358260 (+ 19us) op_driver.cc:348] REPLICATION: starting
0207 20:52:51.359070 (+ 810us) log.cc:844] Serialized 35237 byte log entry
0207 20:52:51.523517 (+164447us) op_driver.cc:464] REPLICATION: finished
0207 20:52:51.523953 (+ 436us) write_op.cc:301] APPLY: starting
0207 20:52:51.524057 (+ 104us) tablet.cc:1365] starting BulkCheckPresence
0207 20:52:51.742089 (+218032us) tablet.cc:1368] finished BulkCheckPresence
0207 20:52:51.742202 (+ 113us) tablet.cc:1370] starting ApplyRowOperation cycle
0207 20:52:52.137868 (+395666us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b5c00209b8c. stack: 00007effe1adc423 00007effe1adc320 00007effe142c574 00007effeb66c6b4 00007effeb66c649 00007effeb1a74f1 00007effeb1a73e1 00007effeb1a212c 00007effe84fd96b 00007effe84fd633 00007effe85fbdb4 00007effe85e78cc 00007effe85ebcb1 00007effe85ebc69 00007effe85ebbf9 00007effe85ebbc1
0207 20:52:52.425200 (+287332us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b5c00209b8c. stack: 00007effe1adc423 00007effe1adc320 00007effe142c574 00007effeb66c6b4 00007effeb66c649 00007effeb1a74f1 00007effeb1a73e1 00007effeb1a212c 00007effe84fd96b 00007effe84fd633 00007effe85fbdb4 00007effe85e78cc 00007effe85ebcb1 00007effe85ebc69 00007effe85ebbf9 00007effe85ebbc1
0207 20:52:52.555377 (+130177us) tablet.cc:1381] finished ApplyRowOperation cycle
0207 20:52:52.569988 (+ 14611us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0207 20:52:52.570028 (+ 40us) write_op.cc:312] APPLY: finished
0207 20:52:52.593436 (+ 23408us) log.cc:844] Serialized 20992 byte log entry
0207 20:52:52.596069 (+ 2633us) write_op.cc:489] Releasing partition, row and schema locks
0207 20:52:52.608221 (+ 12152us) write_op.cc:454] Released schema lock
0207 20:52:52.610086 (+ 1865us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":204,"num_ops":3495,"prepare.queue_time_us":26918,"prepare.run_cpu_time_us":220352,"prepare.run_wall_time_us":369829,"raft.queue_time_us":186,"raft.run_cpu_time_us":2319,"raft.run_wall_time_us":2318,"replication_time_us":165119,"spinlock_wait_cycles":37876224,"thread_start_us":46670,"threads_started":2,"wal-append.queue_time_us":16070,"wal-append.run_cpu_time_us":12216,"wal-append.run_wall_time_us":1012871}]]}
W20260207 20:52:52.653421 6583 log.cc:927] Time spent T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf: Append to log took a long time: real 0.054s user 0.007s sys 0.000s
W20260207 20:52:52.863447 6484 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.2.223.1:35831, user_credentials={real_user=slave}} blocked reactor thread for 244870us
I20260207 20:52:53.233639 6563 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49542 (ReqId={client: 9b540707b99f4397bff542fb477589fa, seq_no=3, attempt_no=0}) took 1123 ms. Trace:
I20260207 20:52:53.234139 6563 rpcz_store.cc:276] 0207 20:52:52.110395 (+ 0us) service_pool.cc:168] Inserting onto call queue
0207 20:52:52.110554 (+ 159us) service_pool.cc:225] Handling call
0207 20:52:53.233579 (+1123025us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0207 20:52:52.127841 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 1075d452080b43eabe4628bf840f3df0
0207 20:52:52.128338 (+ 497us) write_op.cc:432] Acquiring schema lock in shared mode
0207 20:52:52.128381 (+ 43us) write_op.cc:435] Acquired schema lock
0207 20:52:52.128394 (+ 13us) tablet.cc:660] Decoding operations
0207 20:52:52.349294 (+220900us) write_op.cc:620] Acquiring the partition lock for write op
0207 20:52:52.349358 (+ 64us) write_op.cc:641] Partition lock acquired for write op
0207 20:52:52.349382 (+ 24us) tablet.cc:683] Acquiring locks for 3288 operations
0207 20:52:52.478252 (+128870us) tablet.cc:699] Row locks acquired
0207 20:52:52.478270 (+ 18us) write_op.cc:260] PREPARE: finished
0207 20:52:52.478456 (+ 186us) write_op.cc:270] Start()
0207 20:52:52.478557 (+ 101us) write_op.cc:276] Timestamp: P: 1770497572478416 usec, L: 0
0207 20:52:52.478575 (+ 18us) op_driver.cc:348] REPLICATION: starting
0207 20:52:52.479330 (+ 755us) log.cc:844] Serialized 33176 byte log entry
0207 20:52:52.621111 (+141781us) op_driver.cc:464] REPLICATION: finished
0207 20:52:52.667476 (+ 46365us) write_op.cc:301] APPLY: starting
0207 20:52:52.667548 (+ 72us) tablet.cc:1365] starting BulkCheckPresence
0207 20:52:52.871281 (+203733us) tablet.cc:1368] finished BulkCheckPresence
0207 20:52:52.871361 (+ 80us) tablet.cc:1370] starting ApplyRowOperation cycle
0207 20:52:53.186430 (+315069us) tablet.cc:1381] finished ApplyRowOperation cycle
0207 20:52:53.198848 (+ 12418us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0207 20:52:53.198890 (+ 42us) write_op.cc:312] APPLY: finished
0207 20:52:53.220124 (+ 21234us) log.cc:844] Serialized 19750 byte log entry
0207 20:52:53.220306 (+ 182us) write_op.cc:489] Releasing partition, row and schema locks
0207 20:52:53.231505 (+ 11199us) write_op.cc:454] Released schema lock
0207 20:52:53.233265 (+ 1760us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":46148,"mutex_wait_us":16522,"num_ops":3288,"prepare.queue_time_us":15321,"prepare.run_cpu_time_us":226812,"prepare.run_wall_time_us":394850,"raft.queue_time_us":18613,"raft.run_cpu_time_us":1827,"raft.run_wall_time_us":1827,"replication_time_us":142375,"spinlock_wait_cycles":175360,"thread_start_us":155545,"threads_started":3,"wal-append.queue_time_us":39566}]]}
W20260207 20:52:53.371625 6484 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.2.223.1:35831, user_credentials={real_user=slave}} blocked reactor thread for 133812us
W20260207 20:52:54.822986 6484 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.2.223.1:35831, user_credentials={real_user=slave}} blocked reactor thread for 123882us
I20260207 20:52:55.228483 6282 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260207 20:52:55.256619 6438 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:52:55.273527 6358 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:52:55.611961 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
W20260207 20:52:55.638739 6546 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down.
W20260207 20:52:55.646178 6546 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down.
W20260207 20:52:55.646972 6546 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down.
W20260207 20:52:55.654610 6540 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down.
W20260207 20:52:55.660418 6540 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down.
W20260207 20:52:55.666088 6540 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down.
W20260207 20:52:55.673841 6540 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down.
I20260207 20:52:55.761399 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:55.762322 2940 tablet_replica.cc:333] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978: stopping tablet replica
I20260207 20:52:55.763166 2940 raft_consensus.cc:2243] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:55.764153 2940 raft_consensus.cc:2272] T eccfde807f124649808ef0934306db2b P 687910bb7947442eb1444e5d54074978 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:55.767062 2940 tablet_replica.cc:333] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978: stopping tablet replica
I20260207 20:52:55.767832 2940 raft_consensus.cc:2243] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:55.768800 2940 raft_consensus.cc:2272] T 1075d452080b43eabe4628bf840f3df0 P 687910bb7947442eb1444e5d54074978 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:55.806955 2940 tablet_replica.cc:333] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978: stopping tablet replica
I20260207 20:52:55.807704 2940 raft_consensus.cc:2243] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:55.808676 2940 raft_consensus.cc:2272] T 7be85bf0da084231922e3ff3eacbf9a4 P 687910bb7947442eb1444e5d54074978 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:55.835947 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:52:55.864579 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
W20260207 20:52:55.885229 6540 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down.
W20260207 20:52:55.928728 6540 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down.
I20260207 20:52:55.936651 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:55.937343 2940 tablet_replica.cc:333] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf: stopping tablet replica
I20260207 20:52:55.937889 2940 raft_consensus.cc:2243] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:55.938316 2940 raft_consensus.cc:2272] T eccfde807f124649808ef0934306db2b P d704a417007542bc94fc002473aa2fdf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:55.940026 2940 tablet_replica.cc:333] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf: stopping tablet replica
I20260207 20:52:55.940619 2940 raft_consensus.cc:2243] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:55.941138 2940 raft_consensus.cc:2272] T 1075d452080b43eabe4628bf840f3df0 P d704a417007542bc94fc002473aa2fdf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:55.953924 2940 tablet_replica.cc:333] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf: stopping tablet replica
I20260207 20:52:55.954427 2940 raft_consensus.cc:2243] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:55.954885 2940 raft_consensus.cc:2272] T 7be85bf0da084231922e3ff3eacbf9a4 P d704a417007542bc94fc002473aa2fdf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:55.976689 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:52:55.989282 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:52:56.017295 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:52:56.017946 2940 tablet_replica.cc:333] T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe: stopping tablet replica
I20260207 20:52:56.018551 2940 raft_consensus.cc:2243] T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:56.019104 2940 raft_consensus.cc:2272] T 1075d452080b43eabe4628bf840f3df0 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:56.029388 2940 tablet_replica.cc:333] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe: stopping tablet replica
I20260207 20:52:56.029894 2940 raft_consensus.cc:2243] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:56.030334 2940 raft_consensus.cc:2272] T eccfde807f124649808ef0934306db2b P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:56.032244 2940 tablet_replica.cc:333] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe: stopping tablet replica
I20260207 20:52:56.032689 2940 raft_consensus.cc:2243] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:56.033115 2940 raft_consensus.cc:2272] T 7be85bf0da084231922e3ff3eacbf9a4 P a7e924d2633e4d8ca6f7c6a352c0cbfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:56.053710 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:52:56.065158 2940 master.cc:561] Master@127.2.223.62:44901 shutting down...
I20260207 20:52:56.085477 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:52:56.086275 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:56.086689 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5e4751a945e74ec6909c407ebcb3ebf9: stopping tablet replica
I20260207 20:52:56.106218 2940 master.cc:583] Master@127.2.223.62:44901 shutdown complete.
I20260207 20:52:56.121137 2940 master.cc:561] Master@127.2.223.61:45939 shutting down...
I20260207 20:52:56.136399 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:56.136905 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:56.137207 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P a599d439067d45dd84a2d6c82017207d: stopping tablet replica
I20260207 20:52:56.155364 2940 master.cc:583] Master@127.2.223.61:45939 shutdown complete.
I20260207 20:52:56.168289 2940 master.cc:561] Master@127.2.223.60:41925 shutting down...
I20260207 20:52:56.183869 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:52:56.184340 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:52:56.184614 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 48b172b8ce2e4d5bad345cd9fed49bd1: stopping tablet replica
I20260207 20:52:56.203554 2940 master.cc:583] Master@127.2.223.60:41925 shutdown complete.
[ OK ] RemoteKsckTest.TestChecksumTimeout (9166 ms)
[ RUN ] RemoteKsckTest.TestChecksumSnapshot
I20260207 20:52:56.236033 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:43177,127.2.223.61:35943,127.2.223.60:45599
I20260207 20:52:56.237325 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:56.242245 6625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:56.242681 6626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:56.243383 6628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:56.243825 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:56.244699 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:56.244863 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:56.244997 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497576244980 us; error 0 us; skew 500 ppm
I20260207 20:52:56.245452 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:56.247510 2940 webserver.cc:492] Webserver started at http://127.2.223.62:33435/ using document root <none> and password file <none>
I20260207 20:52:56.247928 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:56.248082 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:56.248302 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:56.249261 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "9c8e329088da4ed8ab16c252f63c50b5"
format_stamp: "Formatted at 2026-02-07 20:52:56 on dist-test-slave-kqw4"
I20260207 20:52:56.253281 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260207 20:52:56.256187 6633 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:56.256835 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260207 20:52:56.257076 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "9c8e329088da4ed8ab16c252f63c50b5"
format_stamp: "Formatted at 2026-02-07 20:52:56 on dist-test-slave-kqw4"
I20260207 20:52:56.257308 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:56.281759 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:56.282928 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:56.317533 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:43177
I20260207 20:52:56.317665 6684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:43177 every 8 connection(s)
I20260207 20:52:56.321094 6685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:56.321244 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:56.326159 6687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:56.328586 6685 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:56.328725 6688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:56.329492 6690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:56.329806 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:56.331019 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:56.331298 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:56.331452 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497576331438 us; error 0 us; skew 500 ppm
I20260207 20:52:56.331951 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:56.334487 2940 webserver.cc:492] Webserver started at http://127.2.223.61:42333/ using document root <none> and password file <none>
I20260207 20:52:56.335026 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:56.335197 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:56.335439 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:56.336423 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "3e90bcbbeae343cf9a9ca7f16fd92426"
format_stamp: "Formatted at 2026-02-07 20:52:56 on dist-test-slave-kqw4"
I20260207 20:52:56.341528 6685 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:56.341881 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
W20260207 20:52:56.343852 6635 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.223.61:35943: connect: Connection refused (error 111) [suppressed 5 similar messages]
I20260207 20:52:56.345974 6698 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:56.346730 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:52:56.346975 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "3e90bcbbeae343cf9a9ca7f16fd92426"
format_stamp: "Formatted at 2026-02-07 20:52:56 on dist-test-slave-kqw4"
W20260207 20:52:56.347153 6685 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:35943: Network error: Client connection negotiation failed: client connection to 127.2.223.61:35943: connect: Connection refused (error 111)
I20260207 20:52:56.347301 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:56.359263 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:56.360289 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:56.370669 6685 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } attempt: 1
W20260207 20:52:56.375041 6685 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:35943: Network error: Client connection negotiation failed: client connection to 127.2.223.61:35943: connect: Connection refused (error 111)
I20260207 20:52:56.397332 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:35943
I20260207 20:52:56.397431 6749 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:35943 every 8 connection(s)
I20260207 20:52:56.400947 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:56.401042 6750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260207 20:52:56.406124 6752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:56.407840 6753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:56.408843 6750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:56.408950 2940 server_base.cc:1060] running on GCE node
W20260207 20:52:56.409646 6755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:56.411957 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:56.412166 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:56.412318 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497576412303 us; error 0 us; skew 500 ppm
I20260207 20:52:56.412987 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:56.415655 2940 webserver.cc:492] Webserver started at http://127.2.223.60:37745/ using document root <none> and password file <none>
I20260207 20:52:56.416092 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:56.416249 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:56.416477 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:56.417681 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "d04158a4b10c44368aab5d4e1591e026"
format_stamp: "Formatted at 2026-02-07 20:52:56 on dist-test-slave-kqw4"
I20260207 20:52:56.419986 6750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:56.422816 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260207 20:52:56.426611 6762 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:56.427474 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20260207 20:52:56.427816 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "d04158a4b10c44368aab5d4e1591e026"
format_stamp: "Formatted at 2026-02-07 20:52:56 on dist-test-slave-kqw4"
I20260207 20:52:56.428145 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:56.432149 6750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:56.437559 6750 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:45599: Network error: Client connection negotiation failed: client connection to 127.2.223.60:45599: connect: Connection refused (error 111)
I20260207 20:52:56.441478 6685 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } attempt: 2
I20260207 20:52:56.442404 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:56.443903 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:56.451032 6685 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:52:56.458279 6685 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:45599: Network error: Client connection negotiation failed: client connection to 127.2.223.60:45599: connect: Connection refused (error 111)
I20260207 20:52:56.483356 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:45599
I20260207 20:52:56.483451 6814 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:45599 every 8 connection(s)
I20260207 20:52:56.486205 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:52:56.486974 6815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:56.492604 6815 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:56.494009 6750 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } attempt: 1
I20260207 20:52:56.504604 6815 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:56.511709 6750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426: Bootstrap starting.
I20260207 20:52:56.514163 6815 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:52:56.517830 6750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:56.518818 6685 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } attempt: 1
I20260207 20:52:56.523667 6750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426: No bootstrap required, opened a new log
I20260207 20:52:56.526360 6750 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } }
I20260207 20:52:56.527065 6750 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:56.527314 6750 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e90bcbbeae343cf9a9ca7f16fd92426, State: Initialized, Role: FOLLOWER
I20260207 20:52:56.528046 6750 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } }
I20260207 20:52:56.530474 6815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026: Bootstrap starting.
I20260207 20:52:56.530211 6821 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } } }
I20260207 20:52:56.531060 6821 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:56.531759 6750 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:56.535372 6815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:56.538829 6685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5: Bootstrap starting.
I20260207 20:52:56.540079 6815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026: No bootstrap required, opened a new log
I20260207 20:52:56.542300 6815 raft_consensus.cc:359] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } }
I20260207 20:52:56.542999 6815 raft_consensus.cc:385] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:56.543285 6815 raft_consensus.cc:740] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04158a4b10c44368aab5d4e1591e026, State: Initialized, Role: FOLLOWER
I20260207 20:52:56.543968 6815 consensus_queue.cc:260] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } }
I20260207 20:52:56.545320 6685 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:56.545790 6832 sys_catalog.cc:455] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } } }
I20260207 20:52:56.546563 6832 sys_catalog.cc:458] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:56.547224 6815 sys_catalog.cc:565] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:52:56.550823 6685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5: No bootstrap required, opened a new log
I20260207 20:52:56.553618 6685 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } }
I20260207 20:52:56.554296 6685 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:56.554577 6685 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8e329088da4ed8ab16c252f63c50b5, State: Initialized, Role: FOLLOWER
I20260207 20:52:56.555403 6685 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } }
I20260207 20:52:56.557688 6842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } } }
I20260207 20:52:56.558521 6842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:56.559561 6685 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [sys.catalog]: configured and running, proceeding with master startup.
W20260207 20:52:56.563922 6844 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:56.564232 6844 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:52:56.566900 6847 catalog_manager.cc:1568] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:56.567220 6847 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:52:56.571465 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:52:56.571720 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:52:56.572954 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:52:56.574218 6858 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:52:56.574465 6858 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:52:56.578675 6859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:56.579429 6860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:56.580950 2940 server_base.cc:1060] running on GCE node
W20260207 20:52:56.581702 6862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:56.582422 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:56.582656 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:56.582814 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497576582801 us; error 0 us; skew 500 ppm
I20260207 20:52:56.583279 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:56.585444 2940 webserver.cc:492] Webserver started at http://127.2.223.1:45681/ using document root <none> and password file <none>
I20260207 20:52:56.585875 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:56.586045 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:56.586278 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:56.587307 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "574fc8ec77664efb807ca7580876332c"
format_stamp: "Formatted at 2026-02-07 20:52:56 on dist-test-slave-kqw4"
I20260207 20:52:56.591513 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260207 20:52:56.594619 6867 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:56.595332 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260207 20:52:56.595625 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "574fc8ec77664efb807ca7580876332c"
format_stamp: "Formatted at 2026-02-07 20:52:56 on dist-test-slave-kqw4"
I20260207 20:52:56.595886 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:56.606901 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:56.608021 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:56.609341 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:56.611486 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:56.611678 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:56.611892 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:56.612038 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:56.648451 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:43787
I20260207 20:52:56.648592 6929 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:43787 every 8 connection(s)
I20260207 20:52:56.657318 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:56.668912 6930 heartbeater.cc:344] Connected to a master server at 127.2.223.60:45599
I20260207 20:52:56.669304 6930 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:56.669854 6931 heartbeater.cc:344] Connected to a master server at 127.2.223.61:35943
I20260207 20:52:56.670131 6930 heartbeater.cc:507] Master 127.2.223.60:45599 requested a full tablet report, sending...
I20260207 20:52:56.670279 6931 heartbeater.cc:461] Registering TS with master...
W20260207 20:52:56.671013 6937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:56.673274 6780 ts_manager.cc:194] Registered new tserver with Master: 574fc8ec77664efb807ca7580876332c (127.2.223.1:43787)
W20260207 20:52:56.673856 6938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:56.674688 6931 heartbeater.cc:507] Master 127.2.223.61:35943 requested a full tablet report, sending...
I20260207 20:52:56.677610 6715 ts_manager.cc:194] Registered new tserver with Master: 574fc8ec77664efb807ca7580876332c (127.2.223.1:43787)
I20260207 20:52:56.680271 6932 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43177
I20260207 20:52:56.680629 6932 heartbeater.cc:461] Registering TS with master...
W20260207 20:52:56.681212 6940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:56.681313 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:56.681407 6932 heartbeater.cc:507] Master 127.2.223.62:43177 requested a full tablet report, sending...
I20260207 20:52:56.682381 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:52:56.682624 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:56.682806 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497576682788 us; error 0 us; skew 500 ppm
I20260207 20:52:56.683355 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:56.683825 6650 ts_manager.cc:194] Registered new tserver with Master: 574fc8ec77664efb807ca7580876332c (127.2.223.1:43787)
I20260207 20:52:56.685882 2940 webserver.cc:492] Webserver started at http://127.2.223.2:35233/ using document root <none> and password file <none>
I20260207 20:52:56.686350 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:56.686574 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:56.686923 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:56.688158 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "f2dd21ebdcdf4d659142e9cb30a71e57"
format_stamp: "Formatted at 2026-02-07 20:52:56 on dist-test-slave-kqw4"
I20260207 20:52:56.692752 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:52:56.695830 6945 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:56.696632 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:52:56.696977 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "f2dd21ebdcdf4d659142e9cb30a71e57"
format_stamp: "Formatted at 2026-02-07 20:52:56 on dist-test-slave-kqw4"
I20260207 20:52:56.697289 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:56.717952 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:56.718968 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:56.720218 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:56.722508 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:56.722792 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:56.723067 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:56.723280 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:56.723825 6842 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:56.724313 6842 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } }
I20260207 20:52:56.726282 6842 leader_election.cc:290] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e90bcbbeae343cf9a9ca7f16fd92426 (127.2.223.61:35943), d04158a4b10c44368aab5d4e1591e026 (127.2.223.60:45599)
I20260207 20:52:56.726835 6725 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c8e329088da4ed8ab16c252f63c50b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" is_pre_election: true
I20260207 20:52:56.727435 6725 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8e329088da4ed8ab16c252f63c50b5 in term 0.
I20260207 20:52:56.727767 6790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c8e329088da4ed8ab16c252f63c50b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04158a4b10c44368aab5d4e1591e026" is_pre_election: true
I20260207 20:52:56.728389 6790 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8e329088da4ed8ab16c252f63c50b5 in term 0.
I20260207 20:52:56.728523 6635 leader_election.cc:304] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e90bcbbeae343cf9a9ca7f16fd92426, 9c8e329088da4ed8ab16c252f63c50b5; no voters:
I20260207 20:52:56.729125 6842 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:56.729471 6842 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:56.729780 6842 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:56.736267 6842 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } }
I20260207 20:52:56.738438 6842 leader_election.cc:290] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [CANDIDATE]: Term 1 election: Requested vote from peers 3e90bcbbeae343cf9a9ca7f16fd92426 (127.2.223.61:35943), d04158a4b10c44368aab5d4e1591e026 (127.2.223.60:45599)
I20260207 20:52:56.739147 6790 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c8e329088da4ed8ab16c252f63c50b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04158a4b10c44368aab5d4e1591e026"
I20260207 20:52:56.739787 6790 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:56.740552 6725 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c8e329088da4ed8ab16c252f63c50b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426"
I20260207 20:52:56.741080 6725 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:56.746790 6725 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8e329088da4ed8ab16c252f63c50b5 in term 1.
I20260207 20:52:56.747804 6790 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8e329088da4ed8ab16c252f63c50b5 in term 1.
I20260207 20:52:56.747911 6635 leader_election.cc:304] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e90bcbbeae343cf9a9ca7f16fd92426, 9c8e329088da4ed8ab16c252f63c50b5; no voters:
I20260207 20:52:56.749207 6842 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:56.751394 6842 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [term 1 LEADER]: Becoming Leader. State: Replica: 9c8e329088da4ed8ab16c252f63c50b5, State: Running, Role: LEADER
I20260207 20:52:56.752362 6842 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } }
I20260207 20:52:56.758934 6965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c8e329088da4ed8ab16c252f63c50b5. Latest consensus state: current_term: 1 leader_uuid: "9c8e329088da4ed8ab16c252f63c50b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } } }
I20260207 20:52:56.759707 6965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:56.762750 6975 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:52:56.769973 6975 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:52:56.780440 6790 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [term 1 FOLLOWER]: Refusing update from remote peer 9c8e329088da4ed8ab16c252f63c50b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:56.781553 6725 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [term 1 FOLLOWER]: Refusing update from remote peer 9c8e329088da4ed8ab16c252f63c50b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:56.782006 6965 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:56.783166 6842 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:56.798418 6832 sys_catalog.cc:455] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c8e329088da4ed8ab16c252f63c50b5. Latest consensus state: current_term: 1 leader_uuid: "9c8e329088da4ed8ab16c252f63c50b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } } }
I20260207 20:52:56.799208 6832 sys_catalog.cc:458] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:56.804263 6821 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c8e329088da4ed8ab16c252f63c50b5. Latest consensus state: current_term: 1 leader_uuid: "9c8e329088da4ed8ab16c252f63c50b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } } }
I20260207 20:52:56.804968 6821 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:56.808614 6842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9c8e329088da4ed8ab16c252f63c50b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } } }
I20260207 20:52:56.809352 6842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:56.810180 6975 catalog_manager.cc:1357] Generated new cluster ID: a9348dfb49ee48359c8060b90525924f
I20260207 20:52:56.810513 6975 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:52:56.827788 6832 sys_catalog.cc:455] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9c8e329088da4ed8ab16c252f63c50b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } } }
I20260207 20:52:56.828563 6832 sys_catalog.cc:458] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:56.834640 6965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9c8e329088da4ed8ab16c252f63c50b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } } }
I20260207 20:52:56.835453 6965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [sys.catalog]: This master's current role is: LEADER
I20260207 20:52:56.837745 6821 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9c8e329088da4ed8ab16c252f63c50b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8e329088da4ed8ab16c252f63c50b5" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43177 } } peers { permanent_uuid: "3e90bcbbeae343cf9a9ca7f16fd92426" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35943 } } peers { permanent_uuid: "d04158a4b10c44368aab5d4e1591e026" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45599 } } }
I20260207 20:52:56.838435 6821 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:52:56.845451 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:36703
I20260207 20:52:56.845544 7019 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:36703 every 8 connection(s)
I20260207 20:52:56.855957 6975 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:52:56.862221 6975 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:52:56.897333 7020 heartbeater.cc:344] Connected to a master server at 127.2.223.60:45599
I20260207 20:52:56.897723 7020 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:56.898548 7020 heartbeater.cc:507] Master 127.2.223.60:45599 requested a full tablet report, sending...
I20260207 20:52:56.903470 6780 ts_manager.cc:194] Registered new tserver with Master: f2dd21ebdcdf4d659142e9cb30a71e57 (127.2.223.2:36703)
I20260207 20:52:56.909403 6975 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5: Generated new TSK 0
I20260207 20:52:56.910075 6975 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:52:56.913928 7022 heartbeater.cc:344] Connected to a master server at 127.2.223.61:35943
I20260207 20:52:56.914346 7022 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:56.915251 7022 heartbeater.cc:507] Master 127.2.223.61:35943 requested a full tablet report, sending...
I20260207 20:52:56.916180 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:52:56.914369 7023 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43177
I20260207 20:52:56.916939 7023 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:56.917585 7023 heartbeater.cc:507] Master 127.2.223.62:43177 requested a full tablet report, sending...
I20260207 20:52:56.917649 6715 ts_manager.cc:194] Registered new tserver with Master: f2dd21ebdcdf4d659142e9cb30a71e57 (127.2.223.2:36703)
I20260207 20:52:56.920738 6650 ts_manager.cc:194] Registered new tserver with Master: f2dd21ebdcdf4d659142e9cb30a71e57 (127.2.223.2:36703)
I20260207 20:52:56.923025 6650 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41926
W20260207 20:52:56.924454 7027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:56.925799 6649 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41912
W20260207 20:52:56.936036 7028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:52:56.936884 7030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:52:56.937309 2940 server_base.cc:1060] running on GCE node
I20260207 20:52:56.938223 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260207 20:52:56.938297 6932 heartbeater.cc:499] Master 127.2.223.62:43177 was elected leader, sending a full tablet report...
W20260207 20:52:56.938546 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:52:56.938823 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497576938802 us; error 0 us; skew 500 ppm
I20260207 20:52:56.939463 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:52:56.940367 7023 heartbeater.cc:499] Master 127.2.223.62:43177 was elected leader, sending a full tablet report...
I20260207 20:52:56.945762 2940 webserver.cc:492] Webserver started at http://127.2.223.3:38517/ using document root <none> and password file <none>
I20260207 20:52:56.946449 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:52:56.946729 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:52:56.947050 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:52:56.948073 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "87eeac2a791c4da0be44e3cfbc59797f"
format_stamp: "Formatted at 2026-02-07 20:52:56 on dist-test-slave-kqw4"
I20260207 20:52:56.952522 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260207 20:52:56.960322 7035 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:56.961292 2940 fs_manager.cc:730] Time spent opening block manager: real 0.007s user 0.003s sys 0.004s
I20260207 20:52:56.961709 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "87eeac2a791c4da0be44e3cfbc59797f"
format_stamp: "Formatted at 2026-02-07 20:52:56 on dist-test-slave-kqw4"
I20260207 20:52:56.961982 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:52:56.971335 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:52:56.972905 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:52:56.974902 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:52:56.977807 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:52:56.978080 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:56.978325 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:52:56.978478 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:52:57.039235 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:44403
I20260207 20:52:57.039700 7097 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:44403 every 8 connection(s)
I20260207 20:52:57.079622 7098 heartbeater.cc:344] Connected to a master server at 127.2.223.60:45599
I20260207 20:52:57.080071 7098 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:57.080924 7098 heartbeater.cc:507] Master 127.2.223.60:45599 requested a full tablet report, sending...
I20260207 20:52:57.083334 6780 ts_manager.cc:194] Registered new tserver with Master: 87eeac2a791c4da0be44e3cfbc59797f (127.2.223.3:44403)
I20260207 20:52:57.085943 7099 heartbeater.cc:344] Connected to a master server at 127.2.223.61:35943
I20260207 20:52:57.086159 7100 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43177
I20260207 20:52:57.086349 7099 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:57.086737 7100 heartbeater.cc:461] Registering TS with master...
I20260207 20:52:57.087162 7099 heartbeater.cc:507] Master 127.2.223.61:35943 requested a full tablet report, sending...
I20260207 20:52:57.087561 7100 heartbeater.cc:507] Master 127.2.223.62:43177 requested a full tablet report, sending...
I20260207 20:52:57.089356 6714 ts_manager.cc:194] Registered new tserver with Master: 87eeac2a791c4da0be44e3cfbc59797f (127.2.223.3:44403)
I20260207 20:52:57.089514 6649 ts_manager.cc:194] Registered new tserver with Master: 87eeac2a791c4da0be44e3cfbc59797f (127.2.223.3:44403)
I20260207 20:52:57.090099 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015494685s
I20260207 20:52:57.091259 6649 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41934
I20260207 20:52:57.104123 7100 heartbeater.cc:499] Master 127.2.223.62:43177 was elected leader, sending a full tablet report...
I20260207 20:52:57.139271 6650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41942:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:52:57.142107 6650 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:52:57.252678 6976 tablet_service.cc:1505] Processing CreateTablet for tablet b5e6e3f9f87d403b9342abc37cffcac8 (DEFAULT_TABLE table=ksck-test-table [id=69ebde07981b41e28ac6b1475ecca73b]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:57.254526 6974 tablet_service.cc:1505] Processing CreateTablet for tablet 91da2a33584f4a43a3a0533ba245ad45 (DEFAULT_TABLE table=ksck-test-table [id=69ebde07981b41e28ac6b1475ecca73b]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:57.255915 6974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91da2a33584f4a43a3a0533ba245ad45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:57.263525 6895 tablet_service.cc:1505] Processing CreateTablet for tablet b5e6e3f9f87d403b9342abc37cffcac8 (DEFAULT_TABLE table=ksck-test-table [id=69ebde07981b41e28ac6b1475ecca73b]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:57.264528 6894 tablet_service.cc:1505] Processing CreateTablet for tablet 91da2a33584f4a43a3a0533ba245ad45 (DEFAULT_TABLE table=ksck-test-table [id=69ebde07981b41e28ac6b1475ecca73b]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:57.264899 6895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e6e3f9f87d403b9342abc37cffcac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:57.263515 6893 tablet_service.cc:1505] Processing CreateTablet for tablet 6c3fe064d21b4c25a576a448451eb78b (DEFAULT_TABLE table=ksck-test-table [id=69ebde07981b41e28ac6b1475ecca73b]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:57.268205 6893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3fe064d21b4c25a576a448451eb78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:57.271095 6894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91da2a33584f4a43a3a0533ba245ad45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:57.262449 6976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e6e3f9f87d403b9342abc37cffcac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:57.274118 6973 tablet_service.cc:1505] Processing CreateTablet for tablet 6c3fe064d21b4c25a576a448451eb78b (DEFAULT_TABLE table=ksck-test-table [id=69ebde07981b41e28ac6b1475ecca73b]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:57.275530 6973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3fe064d21b4c25a576a448451eb78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:57.285109 7063 tablet_service.cc:1505] Processing CreateTablet for tablet b5e6e3f9f87d403b9342abc37cffcac8 (DEFAULT_TABLE table=ksck-test-table [id=69ebde07981b41e28ac6b1475ecca73b]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:52:57.286455 7063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e6e3f9f87d403b9342abc37cffcac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:57.291491 7062 tablet_service.cc:1505] Processing CreateTablet for tablet 91da2a33584f4a43a3a0533ba245ad45 (DEFAULT_TABLE table=ksck-test-table [id=69ebde07981b41e28ac6b1475ecca73b]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:52:57.292824 7062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91da2a33584f4a43a3a0533ba245ad45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:57.295825 7061 tablet_service.cc:1505] Processing CreateTablet for tablet 6c3fe064d21b4c25a576a448451eb78b (DEFAULT_TABLE table=ksck-test-table [id=69ebde07981b41e28ac6b1475ecca73b]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:52:57.297104 7061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3fe064d21b4c25a576a448451eb78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:52:57.331276 7119 tablet_bootstrap.cc:492] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57: Bootstrap starting.
I20260207 20:52:57.338332 7120 tablet_bootstrap.cc:492] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c: Bootstrap starting.
I20260207 20:52:57.342154 7119 tablet_bootstrap.cc:654] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:57.357543 7119 tablet_bootstrap.cc:492] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57: No bootstrap required, opened a new log
I20260207 20:52:57.358141 7119 ts_tablet_manager.cc:1403] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.013s
I20260207 20:52:57.360158 7120 tablet_bootstrap.cc:654] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:57.361074 7122 tablet_bootstrap.cc:492] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f: Bootstrap starting.
I20260207 20:52:57.373042 7119 raft_consensus.cc:359] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.373788 7119 raft_consensus.cc:385] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:57.374075 7119 raft_consensus.cc:740] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2dd21ebdcdf4d659142e9cb30a71e57, State: Initialized, Role: FOLLOWER
I20260207 20:52:57.374755 7119 consensus_queue.cc:260] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.376278 7122 tablet_bootstrap.cc:654] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:57.381945 7122 tablet_bootstrap.cc:492] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f: No bootstrap required, opened a new log
I20260207 20:52:57.382395 7122 ts_tablet_manager.cc:1403] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.000s
I20260207 20:52:57.385128 7122 raft_consensus.cc:359] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } } peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } }
I20260207 20:52:57.385840 7122 raft_consensus.cc:385] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:57.386116 7122 raft_consensus.cc:740] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87eeac2a791c4da0be44e3cfbc59797f, State: Initialized, Role: FOLLOWER
I20260207 20:52:57.387176 7119 ts_tablet_manager.cc:1434] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57: Time spent starting tablet: real 0.029s user 0.008s sys 0.004s
I20260207 20:52:57.388334 7119 tablet_bootstrap.cc:492] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57: Bootstrap starting.
I20260207 20:52:57.389519 7120 tablet_bootstrap.cc:492] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c: No bootstrap required, opened a new log
I20260207 20:52:57.389983 7120 ts_tablet_manager.cc:1403] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c: Time spent bootstrapping tablet: real 0.052s user 0.000s sys 0.013s
I20260207 20:52:57.392874 7120 raft_consensus.cc:359] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.393570 7120 raft_consensus.cc:385] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:57.393854 7120 raft_consensus.cc:740] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574fc8ec77664efb807ca7580876332c, State: Initialized, Role: FOLLOWER
I20260207 20:52:57.394483 7120 consensus_queue.cc:260] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.386818 7122 consensus_queue.cc:260] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } } peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } }
I20260207 20:52:57.398268 7119 tablet_bootstrap.cc:654] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:57.442480 7120 ts_tablet_manager.cc:1434] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c: Time spent starting tablet: real 0.052s user 0.021s sys 0.030s
I20260207 20:52:57.443583 7120 tablet_bootstrap.cc:492] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c: Bootstrap starting.
I20260207 20:52:57.449792 7120 tablet_bootstrap.cc:654] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:57.481150 7119 tablet_bootstrap.cc:492] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57: No bootstrap required, opened a new log
I20260207 20:52:57.481720 7119 ts_tablet_manager.cc:1403] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57: Time spent bootstrapping tablet: real 0.094s user 0.029s sys 0.036s
I20260207 20:52:57.484400 7119 raft_consensus.cc:359] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.485080 7119 raft_consensus.cc:385] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:57.485355 7119 raft_consensus.cc:740] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2dd21ebdcdf4d659142e9cb30a71e57, State: Initialized, Role: FOLLOWER
I20260207 20:52:57.486099 7119 consensus_queue.cc:260] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.488659 7119 ts_tablet_manager.cc:1434] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260207 20:52:57.489614 7119 tablet_bootstrap.cc:492] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57: Bootstrap starting.
I20260207 20:52:57.500761 7119 tablet_bootstrap.cc:654] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:57.481151 7122 ts_tablet_manager.cc:1434] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f: Time spent starting tablet: real 0.098s user 0.010s sys 0.006s
I20260207 20:52:57.507324 7119 tablet_bootstrap.cc:492] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57: No bootstrap required, opened a new log
I20260207 20:52:57.507844 7119 ts_tablet_manager.cc:1403] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.000s
I20260207 20:52:57.510370 7119 raft_consensus.cc:359] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } } peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } }
I20260207 20:52:57.511080 7119 raft_consensus.cc:385] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:57.511371 7119 raft_consensus.cc:740] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2dd21ebdcdf4d659142e9cb30a71e57, State: Initialized, Role: FOLLOWER
I20260207 20:52:57.512018 7119 consensus_queue.cc:260] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } } peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } }
I20260207 20:52:57.514243 7119 ts_tablet_manager.cc:1434] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260207 20:52:57.514424 7120 tablet_bootstrap.cc:492] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c: No bootstrap required, opened a new log
I20260207 20:52:57.514993 7120 ts_tablet_manager.cc:1403] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c: Time spent bootstrapping tablet: real 0.072s user 0.038s sys 0.025s
I20260207 20:52:57.517611 7120 raft_consensus.cc:359] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } } peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } }
I20260207 20:52:57.518260 7120 raft_consensus.cc:385] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:57.518551 7120 raft_consensus.cc:740] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574fc8ec77664efb807ca7580876332c, State: Initialized, Role: FOLLOWER
I20260207 20:52:57.519201 7120 consensus_queue.cc:260] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } } peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } }
I20260207 20:52:57.521673 7120 ts_tablet_manager.cc:1434] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260207 20:52:57.521982 7122 tablet_bootstrap.cc:492] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f: Bootstrap starting.
I20260207 20:52:57.525988 7120 tablet_bootstrap.cc:492] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c: Bootstrap starting.
I20260207 20:52:57.527612 7122 tablet_bootstrap.cc:654] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:57.531817 7120 tablet_bootstrap.cc:654] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:57.547547 7122 tablet_bootstrap.cc:492] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f: No bootstrap required, opened a new log
I20260207 20:52:57.548081 7122 ts_tablet_manager.cc:1403] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.008s
I20260207 20:52:57.549363 7120 tablet_bootstrap.cc:492] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c: No bootstrap required, opened a new log
I20260207 20:52:57.549947 7120 ts_tablet_manager.cc:1403] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c: Time spent bootstrapping tablet: real 0.024s user 0.017s sys 0.004s
I20260207 20:52:57.550913 7122 raft_consensus.cc:359] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.552703 7120 raft_consensus.cc:359] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.551648 7122 raft_consensus.cc:385] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:57.553560 7120 raft_consensus.cc:385] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:57.553573 7122 raft_consensus.cc:740] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87eeac2a791c4da0be44e3cfbc59797f, State: Initialized, Role: FOLLOWER
I20260207 20:52:57.554145 7120 raft_consensus.cc:740] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574fc8ec77664efb807ca7580876332c, State: Initialized, Role: FOLLOWER
I20260207 20:52:57.554533 7122 consensus_queue.cc:260] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.557396 7122 ts_tablet_manager.cc:1434] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260207 20:52:57.555032 7120 consensus_queue.cc:260] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.560535 7120 ts_tablet_manager.cc:1434] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260207 20:52:57.561107 7122 tablet_bootstrap.cc:492] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f: Bootstrap starting.
I20260207 20:52:57.569795 6844 catalog_manager.cc:1269] Loaded cluster ID: a9348dfb49ee48359c8060b90525924f
I20260207 20:52:57.572964 6847 catalog_manager.cc:1269] Loaded cluster ID: a9348dfb49ee48359c8060b90525924f
I20260207 20:52:57.573297 6847 catalog_manager.cc:1562] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026: loading cluster ID for follower catalog manager: success
I20260207 20:52:57.570116 6844 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426: loading cluster ID for follower catalog manager: success
I20260207 20:52:57.580696 6847 catalog_manager.cc:1584] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026: acquiring CA information for follower catalog manager: success
I20260207 20:52:57.582376 7127 raft_consensus.cc:493] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:57.582886 7127 raft_consensus.cc:515] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.585240 7127 leader_election.cc:290] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 574fc8ec77664efb807ca7580876332c (127.2.223.1:43787), f2dd21ebdcdf4d659142e9cb30a71e57 (127.2.223.2:36703)
I20260207 20:52:57.581460 7122 tablet_bootstrap.cc:654] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f: Neither blocks nor log segments found. Creating new log.
I20260207 20:52:57.587154 6847 catalog_manager.cc:1612] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:52:57.606760 7124 raft_consensus.cc:493] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:57.607247 7124 raft_consensus.cc:515] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.609282 6986 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c3fe064d21b4c25a576a448451eb78b" candidate_uuid: "87eeac2a791c4da0be44e3cfbc59797f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" is_pre_election: true
I20260207 20:52:57.609715 7124 leader_election.cc:290] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 574fc8ec77664efb807ca7580876332c (127.2.223.1:43787), 87eeac2a791c4da0be44e3cfbc59797f (127.2.223.3:44403)
I20260207 20:52:57.609982 6986 raft_consensus.cc:2468] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87eeac2a791c4da0be44e3cfbc59797f in term 0.
I20260207 20:52:57.610265 7122 tablet_bootstrap.cc:492] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f: No bootstrap required, opened a new log
I20260207 20:52:57.610797 7122 ts_tablet_manager.cc:1403] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f: Time spent bootstrapping tablet: real 0.050s user 0.008s sys 0.014s
I20260207 20:52:57.619505 7122 raft_consensus.cc:359] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.620424 7122 raft_consensus.cc:385] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:52:57.620782 7122 raft_consensus.cc:740] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87eeac2a791c4da0be44e3cfbc59797f, State: Initialized, Role: FOLLOWER
I20260207 20:52:57.621623 7122 consensus_queue.cc:260] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.624274 7122 ts_tablet_manager.cc:1434] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260207 20:52:57.631692 6844 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426: acquiring CA information for follower catalog manager: success
I20260207 20:52:57.639796 6905 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c3fe064d21b4c25a576a448451eb78b" candidate_uuid: "87eeac2a791c4da0be44e3cfbc59797f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574fc8ec77664efb807ca7580876332c" is_pre_election: true
I20260207 20:52:57.636118 7036 leader_election.cc:304] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87eeac2a791c4da0be44e3cfbc59797f, f2dd21ebdcdf4d659142e9cb30a71e57; no voters:
I20260207 20:52:57.640539 6905 raft_consensus.cc:2468] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87eeac2a791c4da0be44e3cfbc59797f in term 0.
I20260207 20:52:57.641299 7127 raft_consensus.cc:2804] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:57.641688 7127 raft_consensus.cc:493] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:57.642028 7127 raft_consensus.cc:3060] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:57.646847 6844 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:52:57.649168 7127 raft_consensus.cc:515] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.652169 7127 leader_election.cc:290] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [CANDIDATE]: Term 1 election: Requested vote from peers 574fc8ec77664efb807ca7580876332c (127.2.223.1:43787), f2dd21ebdcdf4d659142e9cb30a71e57 (127.2.223.2:36703)
I20260207 20:52:57.657186 6905 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c3fe064d21b4c25a576a448451eb78b" candidate_uuid: "87eeac2a791c4da0be44e3cfbc59797f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574fc8ec77664efb807ca7580876332c"
I20260207 20:52:57.657788 6905 raft_consensus.cc:3060] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:57.658790 6986 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c3fe064d21b4c25a576a448451eb78b" candidate_uuid: "87eeac2a791c4da0be44e3cfbc59797f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57"
I20260207 20:52:57.659375 6986 raft_consensus.cc:3060] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:57.664197 7127 raft_consensus.cc:493] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:52:57.664706 7127 raft_consensus.cc:515] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } } peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } }
I20260207 20:52:57.665083 6905 raft_consensus.cc:2468] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87eeac2a791c4da0be44e3cfbc59797f in term 1.
I20260207 20:52:57.670341 7037 leader_election.cc:304] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574fc8ec77664efb807ca7580876332c, 87eeac2a791c4da0be44e3cfbc59797f; no voters:
I20260207 20:52:57.671244 6986 raft_consensus.cc:2468] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87eeac2a791c4da0be44e3cfbc59797f in term 1.
I20260207 20:52:57.673491 6905 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91da2a33584f4a43a3a0533ba245ad45" candidate_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574fc8ec77664efb807ca7580876332c" is_pre_election: true
I20260207 20:52:57.674466 6905 raft_consensus.cc:2468] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2dd21ebdcdf4d659142e9cb30a71e57 in term 0.
I20260207 20:52:57.675794 7127 leader_election.cc:290] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2dd21ebdcdf4d659142e9cb30a71e57 (127.2.223.2:36703), 574fc8ec77664efb807ca7580876332c (127.2.223.1:43787)
I20260207 20:52:57.675740 6947 leader_election.cc:304] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574fc8ec77664efb807ca7580876332c, f2dd21ebdcdf4d659142e9cb30a71e57; no voters:
I20260207 20:52:57.673868 6986 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5e6e3f9f87d403b9342abc37cffcac8" candidate_uuid: "87eeac2a791c4da0be44e3cfbc59797f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" is_pre_election: true
I20260207 20:52:57.676420 7127 raft_consensus.cc:2804] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:57.677531 7127 raft_consensus.cc:697] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [term 1 LEADER]: Becoming Leader. State: Replica: 87eeac2a791c4da0be44e3cfbc59797f, State: Running, Role: LEADER
I20260207 20:52:57.678354 7127 consensus_queue.cc:237] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.678691 6905 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5e6e3f9f87d403b9342abc37cffcac8" candidate_uuid: "87eeac2a791c4da0be44e3cfbc59797f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574fc8ec77664efb807ca7580876332c" is_pre_election: true
I20260207 20:52:57.679323 6905 raft_consensus.cc:2468] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87eeac2a791c4da0be44e3cfbc59797f in term 0.
I20260207 20:52:57.676932 6986 raft_consensus.cc:2468] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87eeac2a791c4da0be44e3cfbc59797f in term 0.
I20260207 20:52:57.683220 7124 raft_consensus.cc:2804] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:57.687161 7124 raft_consensus.cc:493] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:57.683593 7037 leader_election.cc:304] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574fc8ec77664efb807ca7580876332c, 87eeac2a791c4da0be44e3cfbc59797f; no voters:
I20260207 20:52:57.687588 7124 raft_consensus.cc:3060] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:57.688182 7127 raft_consensus.cc:2804] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:52:57.688583 7127 raft_consensus.cc:493] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:52:57.688918 7127 raft_consensus.cc:3060] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:57.683727 7073 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91da2a33584f4a43a3a0533ba245ad45" candidate_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87eeac2a791c4da0be44e3cfbc59797f" is_pre_election: true
I20260207 20:52:57.691740 7073 raft_consensus.cc:2468] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2dd21ebdcdf4d659142e9cb30a71e57 in term 0.
I20260207 20:52:57.693166 7124 raft_consensus.cc:515] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.695276 7124 leader_election.cc:290] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [CANDIDATE]: Term 1 election: Requested vote from peers 574fc8ec77664efb807ca7580876332c (127.2.223.1:43787), 87eeac2a791c4da0be44e3cfbc59797f (127.2.223.3:44403)
I20260207 20:52:57.698350 6905 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91da2a33584f4a43a3a0533ba245ad45" candidate_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574fc8ec77664efb807ca7580876332c"
I20260207 20:52:57.699071 6905 raft_consensus.cc:3060] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:57.701220 6647 catalog_manager.cc:5654] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f reported cstate change: term changed from 0 to 1, leader changed from <none> to 87eeac2a791c4da0be44e3cfbc59797f (127.2.223.3). New cstate: current_term: 1 leader_uuid: "87eeac2a791c4da0be44e3cfbc59797f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } health_report { overall_health: HEALTHY } } }
I20260207 20:52:57.702910 7127 raft_consensus.cc:515] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } } peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } }
I20260207 20:52:57.705519 7127 leader_election.cc:290] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [CANDIDATE]: Term 1 election: Requested vote from peers f2dd21ebdcdf4d659142e9cb30a71e57 (127.2.223.2:36703), 574fc8ec77664efb807ca7580876332c (127.2.223.1:43787)
I20260207 20:52:57.706521 6986 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5e6e3f9f87d403b9342abc37cffcac8" candidate_uuid: "87eeac2a791c4da0be44e3cfbc59797f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57"
I20260207 20:52:57.708065 6904 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5e6e3f9f87d403b9342abc37cffcac8" candidate_uuid: "87eeac2a791c4da0be44e3cfbc59797f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574fc8ec77664efb807ca7580876332c"
I20260207 20:52:57.708730 6904 raft_consensus.cc:3060] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:57.710520 7073 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91da2a33584f4a43a3a0533ba245ad45" candidate_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87eeac2a791c4da0be44e3cfbc59797f"
I20260207 20:52:57.711093 7073 raft_consensus.cc:3060] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:57.711601 6905 raft_consensus.cc:2468] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2dd21ebdcdf4d659142e9cb30a71e57 in term 1.
I20260207 20:52:57.712786 6947 leader_election.cc:304] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574fc8ec77664efb807ca7580876332c, f2dd21ebdcdf4d659142e9cb30a71e57; no voters:
I20260207 20:52:57.713527 6986 raft_consensus.cc:3060] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:52:57.714273 7124 raft_consensus.cc:2804] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:57.730942 7124 raft_consensus.cc:697] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 1 LEADER]: Becoming Leader. State: Replica: f2dd21ebdcdf4d659142e9cb30a71e57, State: Running, Role: LEADER
I20260207 20:52:57.731948 7124 consensus_queue.cc:237] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } }
I20260207 20:52:57.734429 6904 raft_consensus.cc:2468] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87eeac2a791c4da0be44e3cfbc59797f in term 1.
I20260207 20:52:57.735890 7037 leader_election.cc:304] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574fc8ec77664efb807ca7580876332c, 87eeac2a791c4da0be44e3cfbc59797f; no voters:
I20260207 20:52:57.736865 7127 raft_consensus.cc:2804] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:52:57.737389 7127 raft_consensus.cc:697] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [term 1 LEADER]: Becoming Leader. State: Replica: 87eeac2a791c4da0be44e3cfbc59797f, State: Running, Role: LEADER
I20260207 20:52:57.738150 7127 consensus_queue.cc:237] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } } peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } }
I20260207 20:52:57.742959 7073 raft_consensus.cc:2468] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2dd21ebdcdf4d659142e9cb30a71e57 in term 1.
I20260207 20:52:57.747215 6986 raft_consensus.cc:2468] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87eeac2a791c4da0be44e3cfbc59797f in term 1.
I20260207 20:52:57.755851 6648 catalog_manager.cc:5654] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2dd21ebdcdf4d659142e9cb30a71e57 (127.2.223.2). New cstate: current_term: 1 leader_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:57.807827 6649 catalog_manager.cc:5654] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f reported cstate change: term changed from 0 to 1, leader changed from <none> to 87eeac2a791c4da0be44e3cfbc59797f (127.2.223.3). New cstate: current_term: 1 leader_uuid: "87eeac2a791c4da0be44e3cfbc59797f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 } health_report { overall_health: UNKNOWN } } }
I20260207 20:52:57.953373 6904 raft_consensus.cc:1275] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c [term 1 FOLLOWER]: Refusing update from remote peer 87eeac2a791c4da0be44e3cfbc59797f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:57.954916 6986 raft_consensus.cc:1275] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 1 FOLLOWER]: Refusing update from remote peer 87eeac2a791c4da0be44e3cfbc59797f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:52:57.954865 7127 consensus_queue.cc:1048] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [LEADER]: Connected to new peer: Peer: permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:57.956316 7139 consensus_queue.cc:1048] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:58.120375 7124 consensus_queue.cc:1048] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:58.138836 7124 consensus_queue.cc:1048] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87eeac2a791c4da0be44e3cfbc59797f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:58.221498 7139 consensus_queue.cc:1048] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [LEADER]: Connected to new peer: Peer: permanent_uuid: "574fc8ec77664efb807ca7580876332c" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:52:58.267637 7127 consensus_queue.cc:1048] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2dd21ebdcdf4d659142e9cb30a71e57" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:01.748396 6894 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:53:01.802289 6974 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:53:01.813576 7062 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260207 20:53:02.367547 7153 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down.
I20260207 20:53:02.374416 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:53:02.425367 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:02.426249 2940 tablet_replica.cc:333] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c: stopping tablet replica
I20260207 20:53:02.427101 2940 raft_consensus.cc:2243] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:02.427649 2940 raft_consensus.cc:2272] T 6c3fe064d21b4c25a576a448451eb78b P 574fc8ec77664efb807ca7580876332c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:02.430039 2940 tablet_replica.cc:333] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c: stopping tablet replica
I20260207 20:53:02.430567 2940 raft_consensus.cc:2243] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:02.431092 2940 raft_consensus.cc:2272] T b5e6e3f9f87d403b9342abc37cffcac8 P 574fc8ec77664efb807ca7580876332c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:02.433321 2940 tablet_replica.cc:333] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c: stopping tablet replica
I20260207 20:53:02.433920 2940 raft_consensus.cc:2243] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:02.434428 2940 raft_consensus.cc:2272] T 91da2a33584f4a43a3a0533ba245ad45 P 574fc8ec77664efb807ca7580876332c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260207 20:53:02.456056 7037 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.223.1:43787: connect: Connection refused (error 111) [suppressed 3 similar messages]
I20260207 20:53:02.461962 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
W20260207 20:53:02.464767 7037 consensus_peers.cc:597] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f -> Peer 574fc8ec77664efb807ca7580876332c (127.2.223.1:43787): Couldn't send request to peer 574fc8ec77664efb807ca7580876332c. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:02.482438 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
W20260207 20:53:02.493571 6947 consensus_peers.cc:597] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 -> Peer 574fc8ec77664efb807ca7580876332c (127.2.223.1:43787): Couldn't send request to peer 574fc8ec77664efb807ca7580876332c. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:43787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:02.531971 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:02.532624 2940 tablet_replica.cc:333] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57: stopping tablet replica
I20260207 20:53:02.533179 2940 raft_consensus.cc:2243] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:02.533706 2940 raft_consensus.cc:2272] T b5e6e3f9f87d403b9342abc37cffcac8 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:02.535609 2940 tablet_replica.cc:333] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57: stopping tablet replica
I20260207 20:53:02.536114 2940 raft_consensus.cc:2243] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:02.536511 2940 raft_consensus.cc:2272] T 6c3fe064d21b4c25a576a448451eb78b P f2dd21ebdcdf4d659142e9cb30a71e57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:02.538791 2940 tablet_replica.cc:333] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57: stopping tablet replica
I20260207 20:53:02.539243 2940 raft_consensus.cc:2243] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:02.539978 2940 raft_consensus.cc:2272] T 91da2a33584f4a43a3a0533ba245ad45 P f2dd21ebdcdf4d659142e9cb30a71e57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:02.555996 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:53:02.572973 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:53:02.608227 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:02.608882 2940 tablet_replica.cc:333] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f: stopping tablet replica
I20260207 20:53:02.609413 2940 raft_consensus.cc:2243] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:02.609885 2940 raft_consensus.cc:2272] T 91da2a33584f4a43a3a0533ba245ad45 P 87eeac2a791c4da0be44e3cfbc59797f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:02.611760 2940 tablet_replica.cc:333] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f: stopping tablet replica
I20260207 20:53:02.612226 2940 raft_consensus.cc:2243] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:02.612927 2940 raft_consensus.cc:2272] T 6c3fe064d21b4c25a576a448451eb78b P 87eeac2a791c4da0be44e3cfbc59797f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:02.615067 2940 tablet_replica.cc:333] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f: stopping tablet replica
I20260207 20:53:02.615522 2940 raft_consensus.cc:2243] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:02.616242 2940 raft_consensus.cc:2272] T b5e6e3f9f87d403b9342abc37cffcac8 P 87eeac2a791c4da0be44e3cfbc59797f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:02.639526 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:53:02.652985 2940 master.cc:561] Master@127.2.223.62:43177 shutting down...
I20260207 20:53:02.677532 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:02.678418 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:02.678813 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9c8e329088da4ed8ab16c252f63c50b5: stopping tablet replica
I20260207 20:53:02.698637 2940 master.cc:583] Master@127.2.223.62:43177 shutdown complete.
I20260207 20:53:02.712575 2940 master.cc:561] Master@127.2.223.61:35943 shutting down...
I20260207 20:53:02.731659 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:02.732247 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:02.732606 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3e90bcbbeae343cf9a9ca7f16fd92426: stopping tablet replica
I20260207 20:53:02.751770 2940 master.cc:583] Master@127.2.223.61:35943 shutdown complete.
I20260207 20:53:02.767277 2940 master.cc:561] Master@127.2.223.60:45599 shutting down...
I20260207 20:53:02.784474 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:02.784968 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:02.785239 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P d04158a4b10c44368aab5d4e1591e026: stopping tablet replica
I20260207 20:53:02.803920 2940 master.cc:583] Master@127.2.223.60:45599 shutdown complete.
[ OK ] RemoteKsckTest.TestChecksumSnapshot (6602 ms)
[ RUN ] RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp
I20260207 20:53:02.838853 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:33057,127.2.223.61:45441,127.2.223.60:35245
I20260207 20:53:02.840199 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:02.845117 7226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:02.846796 7227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:02.847229 7229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:02.847729 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:02.849442 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:02.849653 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:02.849797 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497582849780 us; error 0 us; skew 500 ppm
I20260207 20:53:02.850262 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:02.852391 2940 webserver.cc:492] Webserver started at http://127.2.223.62:35787/ using document root <none> and password file <none>
I20260207 20:53:02.852828 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:02.852993 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:02.853217 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:02.854265 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "e13d433e29994262a98dd959630e2286"
format_stamp: "Formatted at 2026-02-07 20:53:02 on dist-test-slave-kqw4"
I20260207 20:53:02.858311 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260207 20:53:02.861351 7234 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:02.862067 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:53:02.862367 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "e13d433e29994262a98dd959630e2286"
format_stamp: "Formatted at 2026-02-07 20:53:02 on dist-test-slave-kqw4"
I20260207 20:53:02.862859 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:02.877869 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:02.879099 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:02.914606 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:33057
I20260207 20:53:02.914711 7285 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:33057 every 8 connection(s)
I20260207 20:53:02.918247 7286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:02.918359 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:02.923352 7288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:02.923969 7289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:02.926458 7291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:02.929023 7286 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:02.932770 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:02.933758 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:02.933964 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:02.934130 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497582934112 us; error 0 us; skew 500 ppm
I20260207 20:53:02.934649 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:02.937227 2940 webserver.cc:492] Webserver started at http://127.2.223.61:35579/ using document root <none> and password file <none>
I20260207 20:53:02.937654 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:02.937822 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:02.938055 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:02.939404 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "589d4308b1f04363a46aeda6eaa59854"
format_stamp: "Formatted at 2026-02-07 20:53:02 on dist-test-slave-kqw4"
I20260207 20:53:02.943359 7286 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:02.944723 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
W20260207 20:53:02.948202 7286 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:45441: Network error: Client connection negotiation failed: client connection to 127.2.223.61:45441: connect: Connection refused (error 111)
I20260207 20:53:02.948722 7299 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:02.949378 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:53:02.949666 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "589d4308b1f04363a46aeda6eaa59854"
format_stamp: "Formatted at 2026-02-07 20:53:02 on dist-test-slave-kqw4"
I20260207 20:53:02.949908 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:02.967823 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:02.968914 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:02.980758 7286 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } attempt: 1
W20260207 20:53:02.985735 7286 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:45441: Network error: Client connection negotiation failed: client connection to 127.2.223.61:45441: connect: Connection refused (error 111)
I20260207 20:53:03.005121 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:45441
I20260207 20:53:03.005255 7350 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:45441 every 8 connection(s)
I20260207 20:53:03.008968 7351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:03.009086 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:03.014330 7353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:03.014761 7354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:03.016888 7351 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:03.017606 7356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:03.017889 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:03.018909 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:03.019104 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:03.019255 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497583019238 us; error 0 us; skew 500 ppm
I20260207 20:53:03.019748 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:03.022325 2940 webserver.cc:492] Webserver started at http://127.2.223.60:43283/ using document root <none> and password file <none>
I20260207 20:53:03.022946 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:03.023169 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:03.023468 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:03.024570 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "630bc1e72410475d9f57f34d3056e149"
format_stamp: "Formatted at 2026-02-07 20:53:03 on dist-test-slave-kqw4"
I20260207 20:53:03.028357 7351 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:03.029841 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260207 20:53:03.034101 7363 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:03.034909 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:53:03.035246 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "630bc1e72410475d9f57f34d3056e149"
format_stamp: "Formatted at 2026-02-07 20:53:03 on dist-test-slave-kqw4"
I20260207 20:53:03.035602 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:03.040759 7351 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:03.045583 7351 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:35245: Network error: Client connection negotiation failed: client connection to 127.2.223.60:35245: connect: Connection refused (error 111)
I20260207 20:53:03.049844 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:03.051038 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:03.067243 7286 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } attempt: 2
I20260207 20:53:03.068008 7351 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } attempt: 1
W20260207 20:53:03.073623 7351 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:35245: Network error: Client connection negotiation failed: client connection to 127.2.223.60:35245: connect: Connection refused (error 111)
I20260207 20:53:03.077811 7286 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:03.082203 7286 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:35245: Network error: Client connection negotiation failed: client connection to 127.2.223.60:35245: connect: Connection refused (error 111)
I20260207 20:53:03.093881 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:35245
I20260207 20:53:03.093973 7415 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:35245 every 8 connection(s)
I20260207 20:53:03.096706 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:53:03.097628 7416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:03.103693 7416 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:03.114110 7416 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:03.123790 7416 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:03.126231 7351 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } attempt: 2
I20260207 20:53:03.132035 7286 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } attempt: 1
I20260207 20:53:03.144740 7416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149: Bootstrap starting.
I20260207 20:53:03.144958 7351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854: Bootstrap starting.
I20260207 20:53:03.148401 7286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286: Bootstrap starting.
I20260207 20:53:03.151435 7351 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:03.151427 7416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:03.153448 7286 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:03.157235 7351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854: No bootstrap required, opened a new log
I20260207 20:53:03.157465 7416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149: No bootstrap required, opened a new log
I20260207 20:53:03.158236 7286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286: No bootstrap required, opened a new log
I20260207 20:53:03.160121 7351 raft_consensus.cc:359] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } }
I20260207 20:53:03.160308 7286 raft_consensus.cc:359] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } }
I20260207 20:53:03.160259 7416 raft_consensus.cc:359] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } }
I20260207 20:53:03.160874 7351 raft_consensus.cc:385] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:03.161079 7286 raft_consensus.cc:385] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:03.161136 7416 raft_consensus.cc:385] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:03.161235 7351 raft_consensus.cc:740] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 589d4308b1f04363a46aeda6eaa59854, State: Initialized, Role: FOLLOWER
I20260207 20:53:03.161532 7286 raft_consensus.cc:740] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13d433e29994262a98dd959630e2286, State: Initialized, Role: FOLLOWER
I20260207 20:53:03.161669 7416 raft_consensus.cc:740] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630bc1e72410475d9f57f34d3056e149, State: Initialized, Role: FOLLOWER
I20260207 20:53:03.162142 7351 consensus_queue.cc:260] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } }
I20260207 20:53:03.162371 7286 consensus_queue.cc:260] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } }
I20260207 20:53:03.162370 7416 consensus_queue.cc:260] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } }
I20260207 20:53:03.164219 7424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } } }
I20260207 20:53:03.164948 7424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:03.166193 7351 sys_catalog.cc:565] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:03.166124 7425 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } } }
I20260207 20:53:03.167474 7286 sys_catalog.cc:565] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:03.168493 7425 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:03.167757 7426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } } }
I20260207 20:53:03.169071 7416 sys_catalog.cc:565] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:03.169097 7426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:03.188704 7426 raft_consensus.cc:493] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:03.188915 7443 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260207 20:53:03.189319 7426 raft_consensus.cc:515] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } }
I20260207 20:53:03.191146 7426 leader_election.cc:290] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e13d433e29994262a98dd959630e2286 (127.2.223.62:33057), 589d4308b1f04363a46aeda6eaa59854 (127.2.223.61:45441)
I20260207 20:53:03.192054 7261 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "630bc1e72410475d9f57f34d3056e149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e13d433e29994262a98dd959630e2286" is_pre_election: true
I20260207 20:53:03.192870 7261 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630bc1e72410475d9f57f34d3056e149 in term 0.
I20260207 20:53:03.192821 7326 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "630bc1e72410475d9f57f34d3056e149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "589d4308b1f04363a46aeda6eaa59854" is_pre_election: true
I20260207 20:53:03.194134 7326 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630bc1e72410475d9f57f34d3056e149 in term 0.
I20260207 20:53:03.194916 7366 leader_election.cc:304] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630bc1e72410475d9f57f34d3056e149, e13d433e29994262a98dd959630e2286; no voters:
I20260207 20:53:03.196352 7426 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:03.196852 7426 raft_consensus.cc:493] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:03.197184 7426 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:03.199859 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:53:03.200191 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
W20260207 20:53:03.203052 7454 catalog_manager.cc:1568] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:03.203385 7454 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:03.205724 7426 raft_consensus.cc:515] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } }
I20260207 20:53:03.207540 7426 leader_election.cc:290] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [CANDIDATE]: Term 1 election: Requested vote from peers e13d433e29994262a98dd959630e2286 (127.2.223.62:33057), 589d4308b1f04363a46aeda6eaa59854 (127.2.223.61:45441)
I20260207 20:53:03.208348 7261 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "630bc1e72410475d9f57f34d3056e149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e13d433e29994262a98dd959630e2286"
I20260207 20:53:03.208592 7326 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "630bc1e72410475d9f57f34d3056e149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "589d4308b1f04363a46aeda6eaa59854"
I20260207 20:53:03.208825 7261 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:03.209242 7326 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:03.210961 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:03.213517 7459 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:03.213838 7459 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:03.216351 7261 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630bc1e72410475d9f57f34d3056e149 in term 1.
I20260207 20:53:03.216351 7326 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630bc1e72410475d9f57f34d3056e149 in term 1.
I20260207 20:53:03.217844 7366 leader_election.cc:304] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630bc1e72410475d9f57f34d3056e149, e13d433e29994262a98dd959630e2286; no voters:
I20260207 20:53:03.218685 7426 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [term 1 FOLLOWER]: Leader election won for term 1
W20260207 20:53:03.219252 7461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:03.219606 7460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:03.220202 7426 raft_consensus.cc:697] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [term 1 LEADER]: Becoming Leader. State: Replica: 630bc1e72410475d9f57f34d3056e149, State: Running, Role: LEADER
I20260207 20:53:03.221964 7426 consensus_queue.cc:237] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } }
I20260207 20:53:03.226178 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:03.227862 7465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:03.231750 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:03.232036 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:03.232230 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497583232212 us; error 0 us; skew 500 ppm
I20260207 20:53:03.232784 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:03.233438 7463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 630bc1e72410475d9f57f34d3056e149. Latest consensus state: current_term: 1 leader_uuid: "630bc1e72410475d9f57f34d3056e149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } } }
I20260207 20:53:03.234217 7463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:03.235677 7468 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:53:03.235780 2940 webserver.cc:492] Webserver started at http://127.2.223.1:45475/ using document root <none> and password file <none>
I20260207 20:53:03.236471 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:03.236660 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:03.236943 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:03.238112 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "aa33bbb6cd814c7989d86a793eb3bbf0"
format_stamp: "Formatted at 2026-02-07 20:53:03 on dist-test-slave-kqw4"
I20260207 20:53:03.240384 7468 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:53:03.242813 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260207 20:53:03.246621 7472 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:03.247539 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260207 20:53:03.247921 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "aa33bbb6cd814c7989d86a793eb3bbf0"
format_stamp: "Formatted at 2026-02-07 20:53:03 on dist-test-slave-kqw4"
I20260207 20:53:03.248298 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:03.249246 7326 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [term 1 FOLLOWER]: Refusing update from remote peer 630bc1e72410475d9f57f34d3056e149: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:03.249286 7261 raft_consensus.cc:1275] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [term 1 FOLLOWER]: Refusing update from remote peer 630bc1e72410475d9f57f34d3056e149: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:03.250917 7463 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:03.252218 7426 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:03.259720 7425 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 630bc1e72410475d9f57f34d3056e149. Latest consensus state: current_term: 1 leader_uuid: "630bc1e72410475d9f57f34d3056e149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } } }
I20260207 20:53:03.260439 7425 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:03.266276 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:03.268262 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:03.268401 7425 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "630bc1e72410475d9f57f34d3056e149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } } }
I20260207 20:53:03.269297 7425 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:03.271517 7468 catalog_manager.cc:1357] Generated new cluster ID: c515f65fc8164aea9d06c61f2ab9be1d
I20260207 20:53:03.271853 7468 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:53:03.271318 7426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "630bc1e72410475d9f57f34d3056e149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } } }
I20260207 20:53:03.272236 7426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:03.275138 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:03.275633 7424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 630bc1e72410475d9f57f34d3056e149. Latest consensus state: current_term: 1 leader_uuid: "630bc1e72410475d9f57f34d3056e149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } } }
I20260207 20:53:03.276352 7424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:03.278105 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:03.278369 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:03.278649 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:03.278877 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:03.279201 7463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "630bc1e72410475d9f57f34d3056e149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } } }
I20260207 20:53:03.279889 7463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:03.294884 7424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "630bc1e72410475d9f57f34d3056e149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } } }
I20260207 20:53:03.295625 7424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:03.308393 7468 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:53:03.310127 7468 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:53:03.333807 7468 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149: Generated new TSK 0
I20260207 20:53:03.334372 7468 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:53:03.354985 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:41347
I20260207 20:53:03.355069 7542 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:41347 every 8 connection(s)
I20260207 20:53:03.369366 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:03.383419 7550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:03.384860 7543 heartbeater.cc:344] Connected to a master server at 127.2.223.60:35245
I20260207 20:53:03.385305 7543 heartbeater.cc:461] Registering TS with master...
W20260207 20:53:03.386246 7551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:03.386189 7543 heartbeater.cc:507] Master 127.2.223.60:35245 requested a full tablet report, sending...
I20260207 20:53:03.387781 7544 heartbeater.cc:344] Connected to a master server at 127.2.223.61:45441
I20260207 20:53:03.388170 7544 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:03.388988 7544 heartbeater.cc:507] Master 127.2.223.61:45441 requested a full tablet report, sending...
I20260207 20:53:03.389055 7545 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33057
I20260207 20:53:03.389231 7381 ts_manager.cc:194] Registered new tserver with Master: aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347)
I20260207 20:53:03.389740 7545 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:03.390684 7545 heartbeater.cc:507] Master 127.2.223.62:33057 requested a full tablet report, sending...
I20260207 20:53:03.391646 7381 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59392
I20260207 20:53:03.391978 7316 ts_manager.cc:194] Registered new tserver with Master: aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347)
I20260207 20:53:03.393816 7251 ts_manager.cc:194] Registered new tserver with Master: aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347)
W20260207 20:53:03.396561 7553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:03.396826 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:03.397583 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:03.397795 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:03.397956 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497583397940 us; error 0 us; skew 500 ppm
I20260207 20:53:03.398437 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:03.400540 2940 webserver.cc:492] Webserver started at http://127.2.223.2:37489/ using document root <none> and password file <none>
I20260207 20:53:03.400971 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:03.401145 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:03.401377 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:03.402348 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "80209d228a454da1b95e7f3fc700d755"
format_stamp: "Formatted at 2026-02-07 20:53:03 on dist-test-slave-kqw4"
I20260207 20:53:03.404534 7543 heartbeater.cc:499] Master 127.2.223.60:35245 was elected leader, sending a full tablet report...
I20260207 20:53:03.407397 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260207 20:53:03.410626 7558 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:03.411454 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260207 20:53:03.411702 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "80209d228a454da1b95e7f3fc700d755"
format_stamp: "Formatted at 2026-02-07 20:53:03 on dist-test-slave-kqw4"
I20260207 20:53:03.411922 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:03.423800 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:03.424932 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:03.426348 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:03.428592 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:03.428776 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:03.428999 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:03.429134 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:03.478749 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:39491
I20260207 20:53:03.478837 7620 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:39491 every 8 connection(s)
I20260207 20:53:03.513312 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:03.517724 7621 heartbeater.cc:344] Connected to a master server at 127.2.223.60:35245
I20260207 20:53:03.518164 7621 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:03.519079 7621 heartbeater.cc:507] Master 127.2.223.60:35245 requested a full tablet report, sending...
I20260207 20:53:03.518265 7622 heartbeater.cc:344] Connected to a master server at 127.2.223.61:45441
I20260207 20:53:03.520866 7622 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:03.521757 7622 heartbeater.cc:507] Master 127.2.223.61:45441 requested a full tablet report, sending...
I20260207 20:53:03.522457 7380 ts_manager.cc:194] Registered new tserver with Master: 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491)
I20260207 20:53:03.522832 7623 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33057
I20260207 20:53:03.523259 7623 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:03.524138 7623 heartbeater.cc:507] Master 127.2.223.62:33057 requested a full tablet report, sending...
I20260207 20:53:03.524415 7380 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59402
W20260207 20:53:03.526130 7628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:03.526757 7316 ts_manager.cc:194] Registered new tserver with Master: 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491)
I20260207 20:53:03.526882 7251 ts_manager.cc:194] Registered new tserver with Master: 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491)
W20260207 20:53:03.529452 7629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:03.531973 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:03.532948 7631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:03.534399 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:03.534703 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:03.534935 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497583534916 us; error 0 us; skew 500 ppm
I20260207 20:53:03.535699 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:03.537310 7621 heartbeater.cc:499] Master 127.2.223.60:35245 was elected leader, sending a full tablet report...
I20260207 20:53:03.538085 2940 webserver.cc:492] Webserver started at http://127.2.223.3:35781/ using document root <none> and password file <none>
I20260207 20:53:03.538671 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:03.538920 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:03.539227 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:03.540674 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa"
format_stamp: "Formatted at 2026-02-07 20:53:03 on dist-test-slave-kqw4"
I20260207 20:53:03.547742 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260207 20:53:03.551005 7636 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:03.551903 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260207 20:53:03.552270 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa"
format_stamp: "Formatted at 2026-02-07 20:53:03 on dist-test-slave-kqw4"
I20260207 20:53:03.552662 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:03.572130 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:03.573750 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:03.575035 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:03.577217 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:03.577415 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:03.577637 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:03.577792 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:03.638279 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:44717
I20260207 20:53:03.638391 7698 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:44717 every 8 connection(s)
I20260207 20:53:03.677285 7700 heartbeater.cc:344] Connected to a master server at 127.2.223.61:45441
I20260207 20:53:03.677750 7700 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:03.678403 7700 heartbeater.cc:507] Master 127.2.223.61:45441 requested a full tablet report, sending...
I20260207 20:53:03.681824 7315 ts_manager.cc:194] Registered new tserver with Master: e0fa2f3fe3d54375bd59d9fc382f74fa (127.2.223.3:44717)
I20260207 20:53:03.684595 7699 heartbeater.cc:344] Connected to a master server at 127.2.223.60:35245
I20260207 20:53:03.685001 7699 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:03.685811 7699 heartbeater.cc:507] Master 127.2.223.60:35245 requested a full tablet report, sending...
I20260207 20:53:03.687852 7381 ts_manager.cc:194] Registered new tserver with Master: e0fa2f3fe3d54375bd59d9fc382f74fa (127.2.223.3:44717)
I20260207 20:53:03.689576 7381 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59404
I20260207 20:53:03.690114 7701 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33057
I20260207 20:53:03.690502 7701 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:03.691326 7701 heartbeater.cc:507] Master 127.2.223.62:33057 requested a full tablet report, sending...
I20260207 20:53:03.693368 7251 ts_manager.cc:194] Registered new tserver with Master: e0fa2f3fe3d54375bd59d9fc382f74fa (127.2.223.3:44717)
I20260207 20:53:03.693472 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014727204s
I20260207 20:53:03.704325 7699 heartbeater.cc:499] Master 127.2.223.60:35245 was elected leader, sending a full tablet report...
I20260207 20:53:03.756381 7380 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59412:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:53:03.758697 7380 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:53:03.871225 7586 tablet_service.cc:1505] Processing CreateTablet for tablet 8a02598d57154c0c96769372773992a6 (DEFAULT_TABLE table=ksck-test-table [id=e53370f267a54e9096402d6f19c3c757]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:03.871734 7585 tablet_service.cc:1505] Processing CreateTablet for tablet 42b38a6285cd49dea713c7f02a3237be (DEFAULT_TABLE table=ksck-test-table [id=e53370f267a54e9096402d6f19c3c757]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:03.872701 7586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a02598d57154c0c96769372773992a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:03.873330 7585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b38a6285cd49dea713c7f02a3237be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:03.880168 7584 tablet_service.cc:1505] Processing CreateTablet for tablet 0e77c6295d324c82b4008f72b2b6ca8d (DEFAULT_TABLE table=ksck-test-table [id=e53370f267a54e9096402d6f19c3c757]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:03.882045 7584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e77c6295d324c82b4008f72b2b6ca8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:03.883432 7663 tablet_service.cc:1505] Processing CreateTablet for tablet 42b38a6285cd49dea713c7f02a3237be (DEFAULT_TABLE table=ksck-test-table [id=e53370f267a54e9096402d6f19c3c757]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:03.884384 7508 tablet_service.cc:1505] Processing CreateTablet for tablet 8a02598d57154c0c96769372773992a6 (DEFAULT_TABLE table=ksck-test-table [id=e53370f267a54e9096402d6f19c3c757]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:03.885725 7508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a02598d57154c0c96769372773992a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:03.886786 7664 tablet_service.cc:1505] Processing CreateTablet for tablet 8a02598d57154c0c96769372773992a6 (DEFAULT_TABLE table=ksck-test-table [id=e53370f267a54e9096402d6f19c3c757]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:03.884775 7663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b38a6285cd49dea713c7f02a3237be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:03.890944 7664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a02598d57154c0c96769372773992a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:03.891425 7507 tablet_service.cc:1505] Processing CreateTablet for tablet 42b38a6285cd49dea713c7f02a3237be (DEFAULT_TABLE table=ksck-test-table [id=e53370f267a54e9096402d6f19c3c757]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:03.892679 7507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b38a6285cd49dea713c7f02a3237be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:03.885670 7662 tablet_service.cc:1505] Processing CreateTablet for tablet 0e77c6295d324c82b4008f72b2b6ca8d (DEFAULT_TABLE table=ksck-test-table [id=e53370f267a54e9096402d6f19c3c757]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:03.896088 7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e77c6295d324c82b4008f72b2b6ca8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:03.897956 7506 tablet_service.cc:1505] Processing CreateTablet for tablet 0e77c6295d324c82b4008f72b2b6ca8d (DEFAULT_TABLE table=ksck-test-table [id=e53370f267a54e9096402d6f19c3c757]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:03.899180 7506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e77c6295d324c82b4008f72b2b6ca8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:03.952800 7722 tablet_bootstrap.cc:492] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0: Bootstrap starting.
I20260207 20:53:03.957614 7721 tablet_bootstrap.cc:492] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa: Bootstrap starting.
I20260207 20:53:03.958823 7722 tablet_bootstrap.cc:654] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:03.965973 7720 tablet_bootstrap.cc:492] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755: Bootstrap starting.
I20260207 20:53:03.974550 7720 tablet_bootstrap.cc:654] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:03.984961 7722 tablet_bootstrap.cc:492] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0: No bootstrap required, opened a new log
I20260207 20:53:03.984987 7721 tablet_bootstrap.cc:654] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:03.985453 7722 ts_tablet_manager.cc:1403] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0: Time spent bootstrapping tablet: real 0.033s user 0.019s sys 0.005s
I20260207 20:53:03.999284 7722 raft_consensus.cc:359] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.000005 7722 raft_consensus.cc:385] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:04.000301 7722 raft_consensus.cc:740] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa33bbb6cd814c7989d86a793eb3bbf0, State: Initialized, Role: FOLLOWER
I20260207 20:53:04.001502 7721 tablet_bootstrap.cc:492] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa: No bootstrap required, opened a new log
I20260207 20:53:04.001051 7722 consensus_queue.cc:260] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.001989 7721 ts_tablet_manager.cc:1403] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa: Time spent bootstrapping tablet: real 0.045s user 0.009s sys 0.002s
I20260207 20:53:04.004129 7720 tablet_bootstrap.cc:492] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755: No bootstrap required, opened a new log
I20260207 20:53:04.004608 7720 ts_tablet_manager.cc:1403] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.009s
I20260207 20:53:04.005018 7721 raft_consensus.cc:359] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.005779 7721 raft_consensus.cc:385] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:04.006052 7721 raft_consensus.cc:740] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0fa2f3fe3d54375bd59d9fc382f74fa, State: Initialized, Role: FOLLOWER
I20260207 20:53:04.006829 7721 consensus_queue.cc:260] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.007308 7720 raft_consensus.cc:359] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } }
I20260207 20:53:04.008009 7720 raft_consensus.cc:385] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:04.008283 7720 raft_consensus.cc:740] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80209d228a454da1b95e7f3fc700d755, State: Initialized, Role: FOLLOWER
I20260207 20:53:04.009095 7720 consensus_queue.cc:260] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } }
I20260207 20:53:04.020828 7721 ts_tablet_manager.cc:1434] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa: Time spent starting tablet: real 0.019s user 0.014s sys 0.004s
I20260207 20:53:04.025995 7721 tablet_bootstrap.cc:492] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa: Bootstrap starting.
I20260207 20:53:04.032137 7721 tablet_bootstrap.cc:654] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:04.049783 7721 tablet_bootstrap.cc:492] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa: No bootstrap required, opened a new log
I20260207 20:53:04.050371 7721 ts_tablet_manager.cc:1403] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.011s
I20260207 20:53:04.053409 7721 raft_consensus.cc:359] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.054175 7721 raft_consensus.cc:385] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:04.054493 7721 raft_consensus.cc:740] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0fa2f3fe3d54375bd59d9fc382f74fa, State: Initialized, Role: FOLLOWER
I20260207 20:53:04.055296 7721 consensus_queue.cc:260] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.057727 7721 ts_tablet_manager.cc:1434] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260207 20:53:04.059484 7721 tablet_bootstrap.cc:492] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa: Bootstrap starting.
I20260207 20:53:04.068564 7721 tablet_bootstrap.cc:654] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:04.085983 7720 ts_tablet_manager.cc:1434] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755: Time spent starting tablet: real 0.081s user 0.018s sys 0.019s
I20260207 20:53:04.089419 7722 ts_tablet_manager.cc:1434] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0: Time spent starting tablet: real 0.093s user 0.017s sys 0.022s
I20260207 20:53:04.092278 7722 tablet_bootstrap.cc:492] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0: Bootstrap starting.
I20260207 20:53:04.104358 7722 tablet_bootstrap.cc:654] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:04.113641 7720 tablet_bootstrap.cc:492] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755: Bootstrap starting.
I20260207 20:53:04.119679 7720 tablet_bootstrap.cc:654] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:04.120426 7721 tablet_bootstrap.cc:492] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa: No bootstrap required, opened a new log
I20260207 20:53:04.121013 7721 ts_tablet_manager.cc:1403] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa: Time spent bootstrapping tablet: real 0.062s user 0.012s sys 0.008s
I20260207 20:53:04.124104 7721 raft_consensus.cc:359] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } }
I20260207 20:53:04.124552 7722 tablet_bootstrap.cc:492] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0: No bootstrap required, opened a new log
I20260207 20:53:04.124815 7721 raft_consensus.cc:385] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:04.125136 7721 raft_consensus.cc:740] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0fa2f3fe3d54375bd59d9fc382f74fa, State: Initialized, Role: FOLLOWER
I20260207 20:53:04.133951 7722 ts_tablet_manager.cc:1403] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0: Time spent bootstrapping tablet: real 0.042s user 0.009s sys 0.008s
I20260207 20:53:04.137202 7722 raft_consensus.cc:359] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.138175 7722 raft_consensus.cc:385] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:04.138511 7722 raft_consensus.cc:740] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa33bbb6cd814c7989d86a793eb3bbf0, State: Initialized, Role: FOLLOWER
I20260207 20:53:04.139425 7722 consensus_queue.cc:260] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.125911 7721 consensus_queue.cc:260] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } }
I20260207 20:53:04.141741 7722 ts_tablet_manager.cc:1434] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0: Time spent starting tablet: real 0.007s user 0.003s sys 0.002s
I20260207 20:53:04.142760 7722 tablet_bootstrap.cc:492] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0: Bootstrap starting.
I20260207 20:53:04.148701 7722 tablet_bootstrap.cc:654] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:04.142787 7721 ts_tablet_manager.cc:1434] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa: Time spent starting tablet: real 0.021s user 0.004s sys 0.005s
I20260207 20:53:04.154618 7720 tablet_bootstrap.cc:492] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755: No bootstrap required, opened a new log
I20260207 20:53:04.155158 7720 ts_tablet_manager.cc:1403] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755: Time spent bootstrapping tablet: real 0.047s user 0.021s sys 0.007s
I20260207 20:53:04.157943 7720 raft_consensus.cc:359] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.158656 7720 raft_consensus.cc:385] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:04.158952 7720 raft_consensus.cc:740] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80209d228a454da1b95e7f3fc700d755, State: Initialized, Role: FOLLOWER
I20260207 20:53:04.160099 7722 tablet_bootstrap.cc:492] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0: No bootstrap required, opened a new log
I20260207 20:53:04.160590 7722 ts_tablet_manager.cc:1403] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.004s
I20260207 20:53:04.163337 7722 raft_consensus.cc:359] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } }
I20260207 20:53:04.164047 7722 raft_consensus.cc:385] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:04.164330 7722 raft_consensus.cc:740] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa33bbb6cd814c7989d86a793eb3bbf0, State: Initialized, Role: FOLLOWER
I20260207 20:53:04.165128 7720 consensus_queue.cc:260] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.165143 7722 consensus_queue.cc:260] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } }
I20260207 20:53:04.167802 7720 ts_tablet_manager.cc:1434] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260207 20:53:04.168902 7720 tablet_bootstrap.cc:492] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755: Bootstrap starting.
I20260207 20:53:04.172832 7722 ts_tablet_manager.cc:1434] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0: Time spent starting tablet: real 0.012s user 0.006s sys 0.001s
I20260207 20:53:04.176867 7720 tablet_bootstrap.cc:654] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:04.194552 7720 tablet_bootstrap.cc:492] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755: No bootstrap required, opened a new log
I20260207 20:53:04.195062 7720 ts_tablet_manager.cc:1403] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755: Time spent bootstrapping tablet: real 0.026s user 0.012s sys 0.008s
I20260207 20:53:04.194422 7443 catalog_manager.cc:1269] Loaded cluster ID: c515f65fc8164aea9d06c61f2ab9be1d
I20260207 20:53:04.196970 7728 raft_consensus.cc:493] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:04.197239 7443 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854: loading cluster ID for follower catalog manager: success
I20260207 20:53:04.198730 7728 raft_consensus.cc:515] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.200158 7720 raft_consensus.cc:359] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.200954 7720 raft_consensus.cc:385] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:04.201289 7720 raft_consensus.cc:740] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80209d228a454da1b95e7f3fc700d755, State: Initialized, Role: FOLLOWER
I20260207 20:53:04.202102 7720 consensus_queue.cc:260] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.201225 7728 leader_election.cc:290] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347), e0fa2f3fe3d54375bd59d9fc382f74fa (127.2.223.3:44717)
I20260207 20:53:04.208320 7727 raft_consensus.cc:493] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:04.208842 7727 raft_consensus.cc:515] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.211800 7727 leader_election.cc:290] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347), 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491)
I20260207 20:53:04.213533 7454 catalog_manager.cc:1269] Loaded cluster ID: c515f65fc8164aea9d06c61f2ab9be1d
I20260207 20:53:04.213827 7726 raft_consensus.cc:493] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:04.214417 7726 raft_consensus.cc:515] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } }
I20260207 20:53:04.216953 7726 leader_election.cc:290] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491), e0fa2f3fe3d54375bd59d9fc382f74fa (127.2.223.3:44717)
I20260207 20:53:04.214406 7728 raft_consensus.cc:493] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:04.219113 7728 raft_consensus.cc:515] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } }
I20260207 20:53:04.221001 7728 leader_election.cc:290] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0fa2f3fe3d54375bd59d9fc382f74fa (127.2.223.3:44717), aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347)
I20260207 20:53:04.221551 7726 raft_consensus.cc:493] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:04.222000 7726 raft_consensus.cc:515] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.213855 7454 catalog_manager.cc:1562] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286: loading cluster ID for follower catalog manager: success
I20260207 20:53:04.224311 7726 leader_election.cc:290] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491), e0fa2f3fe3d54375bd59d9fc382f74fa (127.2.223.3:44717)
I20260207 20:53:04.253131 7443 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854: acquiring CA information for follower catalog manager: success
I20260207 20:53:04.254351 7720 ts_tablet_manager.cc:1434] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755: Time spent starting tablet: real 0.059s user 0.023s sys 0.024s
I20260207 20:53:04.260421 7454 catalog_manager.cc:1584] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286: acquiring CA information for follower catalog manager: success
I20260207 20:53:04.265136 7454 catalog_manager.cc:1612] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:04.276214 7596 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a02598d57154c0c96769372773992a6" candidate_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80209d228a454da1b95e7f3fc700d755" is_pre_election: true
I20260207 20:53:04.276378 7595 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42b38a6285cd49dea713c7f02a3237be" candidate_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80209d228a454da1b95e7f3fc700d755" is_pre_election: true
I20260207 20:53:04.277031 7596 raft_consensus.cc:2468] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa33bbb6cd814c7989d86a793eb3bbf0 in term 0.
I20260207 20:53:04.277079 7595 raft_consensus.cc:2468] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa33bbb6cd814c7989d86a793eb3bbf0 in term 0.
I20260207 20:53:04.277837 7674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a02598d57154c0c96769372773992a6" candidate_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" is_pre_election: true
I20260207 20:53:04.278491 7674 raft_consensus.cc:2468] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa33bbb6cd814c7989d86a793eb3bbf0 in term 0.
I20260207 20:53:04.278429 7673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42b38a6285cd49dea713c7f02a3237be" candidate_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" is_pre_election: true
I20260207 20:53:04.279125 7518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42b38a6285cd49dea713c7f02a3237be" candidate_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" is_pre_election: true
I20260207 20:53:04.279726 7518 raft_consensus.cc:2468] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0fa2f3fe3d54375bd59d9fc382f74fa in term 0.
I20260207 20:53:04.280494 7474 leader_election.cc:304] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa33bbb6cd814c7989d86a793eb3bbf0, e0fa2f3fe3d54375bd59d9fc382f74fa; no voters:
I20260207 20:53:04.281028 7639 leader_election.cc:304] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa33bbb6cd814c7989d86a793eb3bbf0, e0fa2f3fe3d54375bd59d9fc382f74fa; no voters:
I20260207 20:53:04.281427 7726 raft_consensus.cc:2804] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:04.281791 7726 raft_consensus.cc:493] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:04.282126 7726 raft_consensus.cc:3060] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:04.279256 7673 raft_consensus.cc:2468] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa33bbb6cd814c7989d86a793eb3bbf0 in term 0.
I20260207 20:53:04.295868 7727 raft_consensus.cc:2804] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:04.296280 7474 leader_election.cc:304] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa33bbb6cd814c7989d86a793eb3bbf0, e0fa2f3fe3d54375bd59d9fc382f74fa; no voters:
I20260207 20:53:04.297856 7744 raft_consensus.cc:2804] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:04.298259 7744 raft_consensus.cc:493] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:04.298633 7744 raft_consensus.cc:3060] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:04.300047 7443 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:04.298028 7727 raft_consensus.cc:493] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:04.302937 7727 raft_consensus.cc:3060] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:04.309468 7596 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42b38a6285cd49dea713c7f02a3237be" candidate_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80209d228a454da1b95e7f3fc700d755" is_pre_election: true
I20260207 20:53:04.310096 7596 raft_consensus.cc:2468] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0fa2f3fe3d54375bd59d9fc382f74fa in term 0.
I20260207 20:53:04.311398 7744 raft_consensus.cc:515] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.315846 7518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42b38a6285cd49dea713c7f02a3237be" candidate_uuid: "80209d228a454da1b95e7f3fc700d755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" is_pre_election: true
I20260207 20:53:04.316308 7744 leader_election.cc:290] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [CANDIDATE]: Term 1 election: Requested vote from peers 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491), e0fa2f3fe3d54375bd59d9fc382f74fa (127.2.223.3:44717)
I20260207 20:53:04.316198 7517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a02598d57154c0c96769372773992a6" candidate_uuid: "80209d228a454da1b95e7f3fc700d755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" is_pre_election: true
I20260207 20:53:04.316646 7518 raft_consensus.cc:2393] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80209d228a454da1b95e7f3fc700d755 in current term 1: Already voted for candidate aa33bbb6cd814c7989d86a793eb3bbf0 in this term.
I20260207 20:53:04.318470 7673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42b38a6285cd49dea713c7f02a3237be" candidate_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa"
I20260207 20:53:04.324195 7726 raft_consensus.cc:515] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } }
I20260207 20:53:04.325358 7517 raft_consensus.cc:2393] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80209d228a454da1b95e7f3fc700d755 in current term 1: Already voted for candidate aa33bbb6cd814c7989d86a793eb3bbf0 in this term.
I20260207 20:53:04.327943 7726 leader_election.cc:290] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [CANDIDATE]: Term 1 election: Requested vote from peers 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491), e0fa2f3fe3d54375bd59d9fc382f74fa (127.2.223.3:44717)
I20260207 20:53:04.329203 7674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a02598d57154c0c96769372773992a6" candidate_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa"
I20260207 20:53:04.329794 7674 raft_consensus.cc:3060] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:04.332801 7596 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42b38a6285cd49dea713c7f02a3237be" candidate_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80209d228a454da1b95e7f3fc700d755"
I20260207 20:53:04.333371 7596 raft_consensus.cc:3060] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:04.334098 7595 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a02598d57154c0c96769372773992a6" candidate_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80209d228a454da1b95e7f3fc700d755"
I20260207 20:53:04.334707 7595 raft_consensus.cc:3060] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:04.335428 7671 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a02598d57154c0c96769372773992a6" candidate_uuid: "80209d228a454da1b95e7f3fc700d755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" is_pre_election: true
I20260207 20:53:04.335548 7727 raft_consensus.cc:515] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.337725 7727 leader_election.cc:290] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 1 election: Requested vote from peers aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347), 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491)
I20260207 20:53:04.337780 7672 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42b38a6285cd49dea713c7f02a3237be" candidate_uuid: "80209d228a454da1b95e7f3fc700d755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" is_pre_election: true
I20260207 20:53:04.342049 7673 raft_consensus.cc:2393] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aa33bbb6cd814c7989d86a793eb3bbf0 in current term 1: Already voted for candidate e0fa2f3fe3d54375bd59d9fc382f74fa in this term.
I20260207 20:53:04.343885 7596 raft_consensus.cc:2468] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa33bbb6cd814c7989d86a793eb3bbf0 in term 1.
I20260207 20:53:04.344339 7517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42b38a6285cd49dea713c7f02a3237be" candidate_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0"
I20260207 20:53:04.345069 7517 raft_consensus.cc:2393] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e0fa2f3fe3d54375bd59d9fc382f74fa in current term 1: Already voted for candidate aa33bbb6cd814c7989d86a793eb3bbf0 in this term.
I20260207 20:53:04.343983 7595 raft_consensus.cc:2468] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa33bbb6cd814c7989d86a793eb3bbf0 in term 1.
I20260207 20:53:04.345502 7473 leader_election.cc:304] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80209d228a454da1b95e7f3fc700d755, aa33bbb6cd814c7989d86a793eb3bbf0; no voters:
I20260207 20:53:04.346372 7726 raft_consensus.cc:2804] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:04.346853 7726 raft_consensus.cc:697] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 LEADER]: Becoming Leader. State: Replica: aa33bbb6cd814c7989d86a793eb3bbf0, State: Running, Role: LEADER
I20260207 20:53:04.346949 7595 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42b38a6285cd49dea713c7f02a3237be" candidate_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80209d228a454da1b95e7f3fc700d755"
I20260207 20:53:04.347689 7595 raft_consensus.cc:2393] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e0fa2f3fe3d54375bd59d9fc382f74fa in current term 1: Already voted for candidate aa33bbb6cd814c7989d86a793eb3bbf0 in this term.
I20260207 20:53:04.347711 7726 consensus_queue.cc:237] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.350117 7639 leader_election.cc:304] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0fa2f3fe3d54375bd59d9fc382f74fa; no voters: 80209d228a454da1b95e7f3fc700d755, aa33bbb6cd814c7989d86a793eb3bbf0
I20260207 20:53:04.350528 7473 leader_election.cc:304] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80209d228a454da1b95e7f3fc700d755, aa33bbb6cd814c7989d86a793eb3bbf0; no voters:
I20260207 20:53:04.350790 7560 leader_election.cc:304] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80209d228a454da1b95e7f3fc700d755; no voters: aa33bbb6cd814c7989d86a793eb3bbf0, e0fa2f3fe3d54375bd59d9fc382f74fa
I20260207 20:53:04.351743 7674 raft_consensus.cc:2468] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa33bbb6cd814c7989d86a793eb3bbf0 in term 1.
I20260207 20:53:04.352103 7560 leader_election.cc:304] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80209d228a454da1b95e7f3fc700d755; no voters: aa33bbb6cd814c7989d86a793eb3bbf0, e0fa2f3fe3d54375bd59d9fc382f74fa
I20260207 20:53:04.352799 7744 raft_consensus.cc:2804] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:04.353260 7744 raft_consensus.cc:697] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 LEADER]: Becoming Leader. State: Replica: aa33bbb6cd814c7989d86a793eb3bbf0, State: Running, Role: LEADER
I20260207 20:53:04.353367 7728 raft_consensus.cc:2749] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:53:04.354411 7737 raft_consensus.cc:2749] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:53:04.357429 7727 raft_consensus.cc:2749] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260207 20:53:04.364447 7744 consensus_queue.cc:237] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } }
I20260207 20:53:04.368023 7379 catalog_manager.cc:5654] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } health_report { overall_health: UNKNOWN } } }
I20260207 20:53:04.416808 7379 catalog_manager.cc:5654] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:04.539228 7727 raft_consensus.cc:493] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:04.539646 7727 raft_consensus.cc:515] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.541086 7727 leader_election.cc:290] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347), 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491)
I20260207 20:53:04.541903 7517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e77c6295d324c82b4008f72b2b6ca8d" candidate_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" is_pre_election: true
I20260207 20:53:04.542047 7596 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e77c6295d324c82b4008f72b2b6ca8d" candidate_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80209d228a454da1b95e7f3fc700d755" is_pre_election: true
I20260207 20:53:04.542619 7517 raft_consensus.cc:2468] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0fa2f3fe3d54375bd59d9fc382f74fa in term 0.
I20260207 20:53:04.542755 7596 raft_consensus.cc:2468] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0fa2f3fe3d54375bd59d9fc382f74fa in term 0.
I20260207 20:53:04.543814 7639 leader_election.cc:304] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa33bbb6cd814c7989d86a793eb3bbf0, e0fa2f3fe3d54375bd59d9fc382f74fa; no voters:
I20260207 20:53:04.544663 7727 raft_consensus.cc:2804] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:04.545011 7727 raft_consensus.cc:493] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:04.545320 7727 raft_consensus.cc:3060] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:04.555399 7727 raft_consensus.cc:515] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.557548 7727 leader_election.cc:290] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 1 election: Requested vote from peers aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347), 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491)
I20260207 20:53:04.558353 7517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e77c6295d324c82b4008f72b2b6ca8d" candidate_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0"
I20260207 20:53:04.557776 7596 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e77c6295d324c82b4008f72b2b6ca8d" candidate_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80209d228a454da1b95e7f3fc700d755"
I20260207 20:53:04.558984 7517 raft_consensus.cc:3060] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:04.559198 7596 raft_consensus.cc:3060] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:04.568845 7517 raft_consensus.cc:2468] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0fa2f3fe3d54375bd59d9fc382f74fa in term 1.
I20260207 20:53:04.569949 7639 leader_election.cc:304] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa33bbb6cd814c7989d86a793eb3bbf0, e0fa2f3fe3d54375bd59d9fc382f74fa; no voters:
I20260207 20:53:04.570313 7596 raft_consensus.cc:2468] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0fa2f3fe3d54375bd59d9fc382f74fa in term 1.
I20260207 20:53:04.570755 7727 raft_consensus.cc:2804] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:04.575088 7727 raft_consensus.cc:697] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 LEADER]: Becoming Leader. State: Replica: e0fa2f3fe3d54375bd59d9fc382f74fa, State: Running, Role: LEADER
I20260207 20:53:04.575978 7727 consensus_queue.cc:237] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:04.584607 7380 catalog_manager.cc:5654] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa reported cstate change: term changed from 0 to 1, leader changed from <none> to e0fa2f3fe3d54375bd59d9fc382f74fa (127.2.223.3). New cstate: current_term: 1 leader_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:04.788618 7744 consensus_queue.cc:1048] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:04.806735 7596 raft_consensus.cc:1275] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Refusing update from remote peer aa33bbb6cd814c7989d86a793eb3bbf0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:04.813982 7726 consensus_queue.cc:1048] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:04.825361 7726 consensus_queue.cc:1048] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:04.860689 7770 consensus_queue.cc:1048] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:04.958807 7727 consensus_queue.cc:1048] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:05.013447 7727 consensus_queue.cc:1048] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:08.520152 7584 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:53:08.628067 7507 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260207 20:53:08.642220 7664 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:53:09.390173 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:53:09.436311 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:09.436972 2940 tablet_replica.cc:333] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0: stopping tablet replica
I20260207 20:53:09.437940 2940 raft_consensus.cc:2243] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:09.438731 2940 raft_consensus.cc:2272] T 0e77c6295d324c82b4008f72b2b6ca8d P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:09.441710 2940 tablet_replica.cc:333] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0: stopping tablet replica
I20260207 20:53:09.442261 2940 raft_consensus.cc:2243] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:09.443454 2940 raft_consensus.cc:2272] T 8a02598d57154c0c96769372773992a6 P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:09.446960 2940 tablet_replica.cc:333] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0: stopping tablet replica
I20260207 20:53:09.447588 2940 raft_consensus.cc:2243] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:09.448475 2940 raft_consensus.cc:2272] T 42b38a6285cd49dea713c7f02a3237be P aa33bbb6cd814c7989d86a793eb3bbf0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260207 20:53:09.916276 7639 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.223.1:41347: connect: Connection refused (error 111) [suppressed 6 similar messages]
W20260207 20:53:09.936126 7639 consensus_peers.cc:597] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa -> Peer aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347): Couldn't send request to peer aa33bbb6cd814c7989d86a793eb3bbf0. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:41347: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:10.783241 7827 raft_consensus.cc:493] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa33bbb6cd814c7989d86a793eb3bbf0)
I20260207 20:53:10.784152 7827 raft_consensus.cc:515] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } }
I20260207 20:53:10.809790 7378 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59404 (request call id 280) took 1153 ms. Trace:
I20260207 20:53:10.810344 7378 rpcz_store.cc:276] 0207 20:53:09.655885 (+ 0us) service_pool.cc:168] Inserting onto call queue
0207 20:53:10.808086 (+1152201us) service_pool.cc:225] Handling call
0207 20:53:10.809600 (+ 1514us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":0}
I20260207 20:53:10.844691 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:53:10.848742 7827 leader_election.cc:290] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0fa2f3fe3d54375bd59d9fc382f74fa (127.2.223.3:44717), aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347)
I20260207 20:53:10.850867 7830 raft_consensus.cc:493] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa33bbb6cd814c7989d86a793eb3bbf0)
I20260207 20:53:10.852797 7830 raft_consensus.cc:515] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:10.855060 7830 leader_election.cc:290] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347), 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491)
I20260207 20:53:10.856599 7830 raft_consensus.cc:493] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa33bbb6cd814c7989d86a793eb3bbf0)
I20260207 20:53:10.861357 7380 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59402 (request call id 335) took 1206 ms. Trace:
I20260207 20:53:10.861750 7380 rpcz_store.cc:276] 0207 20:53:09.654851 (+ 0us) service_pool.cc:168] Inserting onto call queue
0207 20:53:10.859895 (+1205044us) service_pool.cc:225] Handling call
0207 20:53:10.861171 (+ 1276us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":0}
I20260207 20:53:10.857219 7830 raft_consensus.cc:515] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } }
I20260207 20:53:10.866847 7830 leader_election.cc:290] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491), aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347)
W20260207 20:53:10.871271 7561 leader_election.cc:336] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347): Network error: Client connection negotiation failed: client connection to 127.2.223.1:41347: connect: Connection refused (error 111)
I20260207 20:53:10.878988 7595 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42b38a6285cd49dea713c7f02a3237be" candidate_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "80209d228a454da1b95e7f3fc700d755" is_pre_election: true
I20260207 20:53:10.879379 7594 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a02598d57154c0c96769372773992a6" candidate_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "80209d228a454da1b95e7f3fc700d755" is_pre_election: true
I20260207 20:53:10.879894 7595 raft_consensus.cc:2468] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0fa2f3fe3d54375bd59d9fc382f74fa in term 1.
I20260207 20:53:10.879968 7594 raft_consensus.cc:2468] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0fa2f3fe3d54375bd59d9fc382f74fa in term 1.
I20260207 20:53:10.884783 7637 leader_election.cc:304] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80209d228a454da1b95e7f3fc700d755, e0fa2f3fe3d54375bd59d9fc382f74fa; no voters:
I20260207 20:53:10.885753 7637 leader_election.cc:304] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80209d228a454da1b95e7f3fc700d755, e0fa2f3fe3d54375bd59d9fc382f74fa; no voters:
I20260207 20:53:10.886927 7830 raft_consensus.cc:2804] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260207 20:53:10.887006 7777 raft_consensus.cc:2804] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260207 20:53:10.887346 7830 raft_consensus.cc:493] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa33bbb6cd814c7989d86a793eb3bbf0)
I20260207 20:53:10.887440 7777 raft_consensus.cc:493] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa33bbb6cd814c7989d86a793eb3bbf0)
I20260207 20:53:10.887831 7830 raft_consensus.cc:3060] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:53:10.888585 7777 raft_consensus.cc:3060] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:53:10.889138 7673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a02598d57154c0c96769372773992a6" candidate_uuid: "80209d228a454da1b95e7f3fc700d755" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" is_pre_election: true
I20260207 20:53:10.895643 7830 raft_consensus.cc:515] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } }
I20260207 20:53:10.897542 7830 leader_election.cc:290] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 2 election: Requested vote from peers 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491), aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347)
I20260207 20:53:10.898177 7594 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a02598d57154c0c96769372773992a6" candidate_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "80209d228a454da1b95e7f3fc700d755"
I20260207 20:53:10.898797 7594 raft_consensus.cc:3060] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:53:10.900840 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:53:10.901906 7673 raft_consensus.cc:2393] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80209d228a454da1b95e7f3fc700d755 in current term 2: Already voted for candidate e0fa2f3fe3d54375bd59d9fc382f74fa in this term.
I20260207 20:53:10.907428 7594 raft_consensus.cc:2468] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0fa2f3fe3d54375bd59d9fc382f74fa in term 2.
W20260207 20:53:10.907737 7639 leader_election.cc:336] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347): Network error: Client connection negotiation failed: client connection to 127.2.223.1:41347: connect: Connection refused (error 111)
I20260207 20:53:10.908828 7637 leader_election.cc:304] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80209d228a454da1b95e7f3fc700d755, e0fa2f3fe3d54375bd59d9fc382f74fa; no voters:
I20260207 20:53:10.909754 7777 raft_consensus.cc:515] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } } peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } }
I20260207 20:53:10.910058 7560 leader_election.cc:304] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80209d228a454da1b95e7f3fc700d755; no voters: aa33bbb6cd814c7989d86a793eb3bbf0, e0fa2f3fe3d54375bd59d9fc382f74fa
I20260207 20:53:10.910856 7827 raft_consensus.cc:2749] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260207 20:53:10.911259 7830 raft_consensus.cc:2804] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 2 FOLLOWER]: Leader election won for term 2
I20260207 20:53:10.911746 7830 raft_consensus.cc:697] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 2 LEADER]: Becoming Leader. State: Replica: e0fa2f3fe3d54375bd59d9fc382f74fa, State: Running, Role: LEADER
I20260207 20:53:10.912774 7777 leader_election.cc:290] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 2 election: Requested vote from peers aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347), 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491)
I20260207 20:53:10.912626 7830 consensus_queue.cc:237] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } }
W20260207 20:53:10.908804 7639 leader_election.cc:336] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347): Network error: Client connection negotiation failed: client connection to 127.2.223.1:41347: connect: Connection refused (error 111)
W20260207 20:53:10.915807 7637 leader_election.cc:336] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80209d228a454da1b95e7f3fc700d755 (127.2.223.2:39491): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260207 20:53:10.921897 7639 leader_election.cc:336] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347): Network error: Client connection negotiation failed: client connection to 127.2.223.1:41347: connect: Connection refused (error 111)
W20260207 20:53:10.922984 7639 leader_election.cc:336] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1:41347): Network error: Client connection negotiation failed: client connection to 127.2.223.1:41347: connect: Connection refused (error 111)
I20260207 20:53:10.923583 7639 leader_election.cc:304] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0fa2f3fe3d54375bd59d9fc382f74fa; no voters: 80209d228a454da1b95e7f3fc700d755, aa33bbb6cd814c7989d86a793eb3bbf0
I20260207 20:53:10.924638 7777 raft_consensus.cc:2749] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260207 20:53:10.939329 7378 catalog_manager.cc:5654] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa reported cstate change: term changed from 1 to 2, leader changed from aa33bbb6cd814c7989d86a793eb3bbf0 (127.2.223.1) to e0fa2f3fe3d54375bd59d9fc382f74fa (127.2.223.3). New cstate: current_term: 2 leader_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80209d228a454da1b95e7f3fc700d755" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0fa2f3fe3d54375bd59d9fc382f74fa" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa33bbb6cd814c7989d86a793eb3bbf0" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41347 } health_report { overall_health: UNKNOWN } } }
W20260207 20:53:10.975405 7282 debug-util.cc:398] Leaking SignalData structure 0x7b0800126420 after lost signal to thread 2943
W20260207 20:53:10.976433 7282 debug-util.cc:398] Leaking SignalData structure 0x7b0800099a40 after lost signal to thread 7285
W20260207 20:53:10.977303 7282 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa660 after lost signal to thread 7350
I20260207 20:53:10.977914 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260207 20:53:10.978107 7282 debug-util.cc:398] Leaking SignalData structure 0x7b08000a23a0 after lost signal to thread 7415
I20260207 20:53:10.979686 2940 tablet_replica.cc:333] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755: stopping tablet replica
W20260207 20:53:10.979794 7282 debug-util.cc:398] Leaking SignalData structure 0x7b08001360c0 after lost signal to thread 7620
I20260207 20:53:10.980566 2940 raft_consensus.cc:2243] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260207 20:53:10.980881 7282 debug-util.cc:398] Leaking SignalData structure 0x7b08000c39a0 after lost signal to thread 7698
I20260207 20:53:10.981187 2940 raft_consensus.cc:2272] T 0e77c6295d324c82b4008f72b2b6ca8d P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:10.984769 2940 tablet_replica.cc:333] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755: stopping tablet replica
I20260207 20:53:10.987056 2940 raft_consensus.cc:2243] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:10.987814 2940 raft_consensus.cc:2272] T 42b38a6285cd49dea713c7f02a3237be P 80209d228a454da1b95e7f3fc700d755 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:10.991154 2940 tablet_replica.cc:333] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755: stopping tablet replica
I20260207 20:53:10.992106 2940 raft_consensus.cc:2243] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:10.993155 2940 raft_consensus.cc:2272] T 8a02598d57154c0c96769372773992a6 P 80209d228a454da1b95e7f3fc700d755 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:11.017376 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:53:11.042291 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:53:11.075052 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:11.075886 2940 tablet_replica.cc:333] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa: stopping tablet replica
I20260207 20:53:11.076694 2940 raft_consensus.cc:2243] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:11.077787 2940 raft_consensus.cc:2272] T 0e77c6295d324c82b4008f72b2b6ca8d P e0fa2f3fe3d54375bd59d9fc382f74fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:11.080917 2940 tablet_replica.cc:333] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa: stopping tablet replica
I20260207 20:53:11.081583 2940 raft_consensus.cc:2243] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 2 LEADER]: Raft consensus shutting down.
I20260207 20:53:11.082412 2940 pending_rounds.cc:70] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa: Trying to abort 1 pending ops.
I20260207 20:53:11.082701 2940 pending_rounds.cc:77] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa: Aborting op as it isn't in flight: id { term: 2 index: 12 } timestamp: 7251958132402692096 op_type: NO_OP noop_request { }
I20260207 20:53:11.083091 2940 raft_consensus.cc:2889] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260207 20:53:11.083410 2940 raft_consensus.cc:2272] T 8a02598d57154c0c96769372773992a6 P e0fa2f3fe3d54375bd59d9fc382f74fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:11.086282 2940 tablet_replica.cc:333] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa: stopping tablet replica
I20260207 20:53:11.086979 2940 raft_consensus.cc:2243] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:11.087525 2940 raft_consensus.cc:2272] T 42b38a6285cd49dea713c7f02a3237be P e0fa2f3fe3d54375bd59d9fc382f74fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:11.115000 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:53:11.136029 2940 master.cc:561] Master@127.2.223.62:33057 shutting down...
I20260207 20:53:11.162115 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:11.162721 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:11.163089 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P e13d433e29994262a98dd959630e2286: stopping tablet replica
W20260207 20:53:11.441226 7366 consensus_peers.cc:597] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 -> Peer e13d433e29994262a98dd959630e2286 (127.2.223.62:33057): Couldn't send request to peer e13d433e29994262a98dd959630e2286. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.62:33057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:11.992897 7847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "630bc1e72410475d9f57f34d3056e149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13d433e29994262a98dd959630e2286" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33057 } } peers { permanent_uuid: "589d4308b1f04363a46aeda6eaa59854" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45441 } } peers { permanent_uuid: "630bc1e72410475d9f57f34d3056e149" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35245 } } }
I20260207 20:53:11.993763 7847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [sys.catalog]: This master's current role is: LEADER
W20260207 20:53:12.171269 2940 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 7282)
W20260207 20:53:13.171754 2940 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 7282)
I20260207 20:53:13.662662 2940 master.cc:583] Master@127.2.223.62:33057 shutdown complete.
I20260207 20:53:13.676975 2940 master.cc:561] Master@127.2.223.61:45441 shutting down...
I20260207 20:53:13.694777 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:13.695295 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:13.695645 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 589d4308b1f04363a46aeda6eaa59854: stopping tablet replica
I20260207 20:53:13.714793 2940 master.cc:583] Master@127.2.223.61:45441 shutdown complete.
I20260207 20:53:13.728022 2940 master.cc:561] Master@127.2.223.60:35245 shutting down...
I20260207 20:53:13.748147 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:13.749003 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:13.749411 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 630bc1e72410475d9f57f34d3056e149: stopping tablet replica
I20260207 20:53:13.770149 2940 master.cc:583] Master@127.2.223.60:35245 shutdown complete.
[ OK ] RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp (10967 ms)
[ RUN ] RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM
I20260207 20:53:13.806810 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:45145,127.2.223.61:33175,127.2.223.60:38055
I20260207 20:53:13.808082 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:13.813118 7859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:13.813252 7858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:13.813861 7861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:13.815671 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:13.816609 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:13.816798 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:13.816941 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497593816924 us; error 0 us; skew 500 ppm
I20260207 20:53:13.817436 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:13.819933 2940 webserver.cc:492] Webserver started at http://127.2.223.62:44909/ using document root <none> and password file <none>
I20260207 20:53:13.820384 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:13.820547 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:13.820794 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:13.821868 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "410f7ba132334278bcc2775d8abe7cad"
format_stamp: "Formatted at 2026-02-07 20:53:13 on dist-test-slave-kqw4"
I20260207 20:53:13.826011 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:53:13.829113 7866 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:13.829833 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:53:13.830101 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "410f7ba132334278bcc2775d8abe7cad"
format_stamp: "Formatted at 2026-02-07 20:53:13 on dist-test-slave-kqw4"
I20260207 20:53:13.830353 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:13.842294 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:13.843547 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:13.880843 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:45145
I20260207 20:53:13.880951 7917 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:45145 every 8 connection(s)
I20260207 20:53:13.884615 7918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:13.884882 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:13.890210 7920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:13.890555 7921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:13.893065 7918 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:13.893385 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:13.894238 7924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:13.897853 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:13.898149 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:13.898345 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497593898326 us; error 0 us; skew 500 ppm
I20260207 20:53:13.899047 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:13.901845 2940 webserver.cc:492] Webserver started at http://127.2.223.61:38815/ using document root <none> and password file <none>
I20260207 20:53:13.902444 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:13.902650 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:13.902899 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:13.904184 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "fe91c92b79044eb1af2bcb21489016a6"
format_stamp: "Formatted at 2026-02-07 20:53:13 on dist-test-slave-kqw4"
I20260207 20:53:13.908394 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260207 20:53:13.911736 7918 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:13.913127 7930 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:13.913938 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260207 20:53:13.914222 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "fe91c92b79044eb1af2bcb21489016a6"
format_stamp: "Formatted at 2026-02-07 20:53:13 on dist-test-slave-kqw4"
I20260207 20:53:13.914578 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:53:13.916915 7918 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:33175: Network error: Client connection negotiation failed: client connection to 127.2.223.61:33175: connect: Connection refused (error 111)
I20260207 20:53:13.930518 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:13.931789 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:13.961377 7918 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } attempt: 1
W20260207 20:53:13.966356 7918 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:33175: Network error: Client connection negotiation failed: client connection to 127.2.223.61:33175: connect: Connection refused (error 111)
I20260207 20:53:13.969378 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:33175
I20260207 20:53:13.969491 7982 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:33175 every 8 connection(s)
I20260207 20:53:13.972985 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:13.973122 7983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260207 20:53:13.978242 7985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:13.979534 7986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:13.980906 7983 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:13.984112 7988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:13.984465 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:13.985646 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:13.985895 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:13.986078 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497593986062 us; error 0 us; skew 500 ppm
I20260207 20:53:13.986640 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:13.988937 2940 webserver.cc:492] Webserver started at http://127.2.223.60:44311/ using document root <none> and password file <none>
I20260207 20:53:13.989490 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:13.989734 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:13.990039 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:13.991333 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "fa8ee9dffe1f47479a167bc5a7788f5d"
format_stamp: "Formatted at 2026-02-07 20:53:13 on dist-test-slave-kqw4"
I20260207 20:53:13.992729 7983 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:13.996716 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260207 20:53:14.000638 7995 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:14.001566 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260207 20:53:14.001832 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "fa8ee9dffe1f47479a167bc5a7788f5d"
format_stamp: "Formatted at 2026-02-07 20:53:13 on dist-test-slave-kqw4"
I20260207 20:53:14.002086 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:14.004211 7983 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:14.010123 7983 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38055: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38055: connect: Connection refused (error 111)
I20260207 20:53:14.019488 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:14.020682 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:14.031636 7983 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } attempt: 1
I20260207 20:53:14.033947 7918 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } attempt: 2
W20260207 20:53:14.037842 7983 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38055: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38055: connect: Connection refused (error 111)
I20260207 20:53:14.045310 7918 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:14.050040 7918 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38055: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38055: connect: Connection refused (error 111)
I20260207 20:53:14.063199 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:38055
I20260207 20:53:14.063324 8047 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:38055 every 8 connection(s)
I20260207 20:53:14.066143 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:53:14.066948 8048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:14.072965 8048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:14.079563 7918 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } attempt: 1
I20260207 20:53:14.084113 8048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:14.093519 8048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:14.097766 7918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad: Bootstrap starting.
I20260207 20:53:14.102933 7918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:14.107260 7918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad: No bootstrap required, opened a new log
I20260207 20:53:14.107463 8048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d: Bootstrap starting.
I20260207 20:53:14.109308 7918 raft_consensus.cc:359] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } }
I20260207 20:53:14.109841 7918 raft_consensus.cc:385] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:14.110046 7918 raft_consensus.cc:740] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 410f7ba132334278bcc2775d8abe7cad, State: Initialized, Role: FOLLOWER
I20260207 20:53:14.110646 7918 consensus_queue.cc:260] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } }
I20260207 20:53:14.112532 8048 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:14.112483 8053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } } }
I20260207 20:53:14.113281 8053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:14.113534 7918 sys_catalog.cc:565] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:14.115348 7983 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } attempt: 2
I20260207 20:53:14.117705 8048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d: No bootstrap required, opened a new log
I20260207 20:53:14.120550 8048 raft_consensus.cc:359] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } }
I20260207 20:53:14.121129 8048 raft_consensus.cc:385] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:14.121336 8048 raft_consensus.cc:740] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8ee9dffe1f47479a167bc5a7788f5d, State: Initialized, Role: FOLLOWER
I20260207 20:53:14.121932 8048 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } }
I20260207 20:53:14.124245 8061 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } } }
I20260207 20:53:14.125442 8061 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:14.125701 8048 sys_catalog.cc:565] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:14.137337 7983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6: Bootstrap starting.
I20260207 20:53:14.140888 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:53:14.144040 7983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6: Neither blocks nor log segments found. Creating new log.
W20260207 20:53:14.145610 8069 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:14.146027 8069 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:14.149159 7983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6: No bootstrap required, opened a new log
I20260207 20:53:14.151847 7983 raft_consensus.cc:359] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } }
I20260207 20:53:14.152571 7983 raft_consensus.cc:385] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:14.152853 7983 raft_consensus.cc:740] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe91c92b79044eb1af2bcb21489016a6, State: Initialized, Role: FOLLOWER
I20260207 20:53:14.153563 7983 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } }
I20260207 20:53:14.155478 8079 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } } }
I20260207 20:53:14.155992 8079 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [sys.catalog]: This master's current role is: FOLLOWER
W20260207 20:53:14.156230 8078 catalog_manager.cc:1568] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:14.156561 8078 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:14.157044 7983 sys_catalog.cc:565] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:14.166694 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:53:14.168013 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:14.169591 8090 catalog_manager.cc:1568] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:14.169865 8090 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:53:14.173645 8091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:14.174666 8092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:14.176213 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:14.176668 8094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:14.176822 8079 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:14.177294 8079 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } }
I20260207 20:53:14.177595 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:14.177870 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:14.178027 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497594178012 us; error 0 us; skew 500 ppm
I20260207 20:53:14.178567 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:14.178916 8079 leader_election.cc:290] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 410f7ba132334278bcc2775d8abe7cad (127.2.223.62:45145), fa8ee9dffe1f47479a167bc5a7788f5d (127.2.223.60:38055)
I20260207 20:53:14.179651 7893 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe91c92b79044eb1af2bcb21489016a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "410f7ba132334278bcc2775d8abe7cad" is_pre_election: true
I20260207 20:53:14.180322 7893 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe91c92b79044eb1af2bcb21489016a6 in term 0.
I20260207 20:53:14.180202 8023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe91c92b79044eb1af2bcb21489016a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" is_pre_election: true
I20260207 20:53:14.180932 8023 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe91c92b79044eb1af2bcb21489016a6 in term 0.
I20260207 20:53:14.181493 7935 leader_election.cc:304] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 410f7ba132334278bcc2775d8abe7cad, fe91c92b79044eb1af2bcb21489016a6; no voters:
I20260207 20:53:14.181959 2940 webserver.cc:492] Webserver started at http://127.2.223.1:37891/ using document root <none> and password file <none>
I20260207 20:53:14.182238 8079 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:14.182472 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:14.182649 8079 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:14.182790 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:14.183007 8079 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:14.183132 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:14.184263 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "9f9a17ba9d93454096bbc5dee055ce42"
format_stamp: "Formatted at 2026-02-07 20:53:14 on dist-test-slave-kqw4"
I20260207 20:53:14.188532 8079 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } }
I20260207 20:53:14.189888 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260207 20:53:14.190495 8079 leader_election.cc:290] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [CANDIDATE]: Term 1 election: Requested vote from peers 410f7ba132334278bcc2775d8abe7cad (127.2.223.62:45145), fa8ee9dffe1f47479a167bc5a7788f5d (127.2.223.60:38055)
I20260207 20:53:14.191318 7893 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe91c92b79044eb1af2bcb21489016a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "410f7ba132334278bcc2775d8abe7cad"
I20260207 20:53:14.191457 8023 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe91c92b79044eb1af2bcb21489016a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d"
I20260207 20:53:14.191783 7893 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:14.192032 8023 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:14.194219 8099 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:14.195143 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260207 20:53:14.195505 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "9f9a17ba9d93454096bbc5dee055ce42"
format_stamp: "Formatted at 2026-02-07 20:53:14 on dist-test-slave-kqw4"
I20260207 20:53:14.195861 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:14.197556 7893 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe91c92b79044eb1af2bcb21489016a6 in term 1.
I20260207 20:53:14.198472 7935 leader_election.cc:304] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 410f7ba132334278bcc2775d8abe7cad, fe91c92b79044eb1af2bcb21489016a6; no voters:
I20260207 20:53:14.199144 8079 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:14.199074 8023 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe91c92b79044eb1af2bcb21489016a6 in term 1.
I20260207 20:53:14.201426 8079 raft_consensus.cc:697] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [term 1 LEADER]: Becoming Leader. State: Replica: fe91c92b79044eb1af2bcb21489016a6, State: Running, Role: LEADER
I20260207 20:53:14.202237 8079 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } }
I20260207 20:53:14.206732 8101 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe91c92b79044eb1af2bcb21489016a6. Latest consensus state: current_term: 1 leader_uuid: "fe91c92b79044eb1af2bcb21489016a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } } }
I20260207 20:53:14.207252 8101 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:14.208786 8106 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:53:14.213305 8106 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:53:14.218331 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:14.219789 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:14.221236 7893 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [term 1 FOLLOWER]: Refusing update from remote peer fe91c92b79044eb1af2bcb21489016a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:14.221212 8023 raft_consensus.cc:1275] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [term 1 FOLLOWER]: Refusing update from remote peer fe91c92b79044eb1af2bcb21489016a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:14.221719 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:14.222880 8101 consensus_queue.cc:1048] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:14.223495 8079 consensus_queue.cc:1048] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:14.224593 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:14.224929 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260207 20:53:14.225198 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:14.225407 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:14.232044 8053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe91c92b79044eb1af2bcb21489016a6. Latest consensus state: current_term: 1 leader_uuid: "fe91c92b79044eb1af2bcb21489016a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } } }
I20260207 20:53:14.232765 8053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:14.234926 8061 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe91c92b79044eb1af2bcb21489016a6. Latest consensus state: current_term: 1 leader_uuid: "fe91c92b79044eb1af2bcb21489016a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } } }
I20260207 20:53:14.235810 8061 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:14.242398 8106 catalog_manager.cc:1357] Generated new cluster ID: 81895a95e5154311a39105fb6878252a
I20260207 20:53:14.242794 8106 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:53:14.244045 8119 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fe91c92b79044eb1af2bcb21489016a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } } }
I20260207 20:53:14.244804 8119 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:14.240631 8101 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fe91c92b79044eb1af2bcb21489016a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } } }
I20260207 20:53:14.248991 8101 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:14.250275 8111 mvcc.cc:204] Tried to move back new op lower bound from 7251958145918418944 to 7251958145860005888. Current Snapshot: MvccSnapshot[applied={T|T < 7251958145918418944}]
I20260207 20:53:14.250859 8061 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe91c92b79044eb1af2bcb21489016a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } } }
I20260207 20:53:14.251619 8061 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:14.256722 8053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe91c92b79044eb1af2bcb21489016a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "410f7ba132334278bcc2775d8abe7cad" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 45145 } } peers { permanent_uuid: "fe91c92b79044eb1af2bcb21489016a6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 33175 } } peers { permanent_uuid: "fa8ee9dffe1f47479a167bc5a7788f5d" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38055 } } }
I20260207 20:53:14.257421 8053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:14.275255 8106 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:53:14.276775 8106 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:53:14.301769 8106 catalog_manager.cc:6027] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6: Generated new TSK 0
I20260207 20:53:14.302577 8106 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:53:14.312618 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:35379
I20260207 20:53:14.312713 8173 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:35379 every 8 connection(s)
I20260207 20:53:14.322571 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:14.332366 8174 heartbeater.cc:344] Connected to a master server at 127.2.223.60:38055
I20260207 20:53:14.332821 8174 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:14.333699 8174 heartbeater.cc:507] Master 127.2.223.60:38055 requested a full tablet report, sending...
I20260207 20:53:14.335677 8175 heartbeater.cc:344] Connected to a master server at 127.2.223.61:33175
I20260207 20:53:14.336099 8175 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:14.336937 8175 heartbeater.cc:507] Master 127.2.223.61:33175 requested a full tablet report, sending...
I20260207 20:53:14.338407 8013 ts_manager.cc:194] Registered new tserver with Master: 9f9a17ba9d93454096bbc5dee055ce42 (127.2.223.1:35379)
I20260207 20:53:14.339669 7948 ts_manager.cc:194] Registered new tserver with Master: 9f9a17ba9d93454096bbc5dee055ce42 (127.2.223.1:35379)
I20260207 20:53:14.342314 7948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60826
I20260207 20:53:14.343868 8176 heartbeater.cc:344] Connected to a master server at 127.2.223.62:45145
W20260207 20:53:14.343417 8181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:14.344329 8176 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:14.345244 8176 heartbeater.cc:507] Master 127.2.223.62:45145 requested a full tablet report, sending...
W20260207 20:53:14.347918 8182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:14.348325 7883 ts_manager.cc:194] Registered new tserver with Master: 9f9a17ba9d93454096bbc5dee055ce42 (127.2.223.1:35379)
I20260207 20:53:14.349574 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:14.350708 8184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:14.351687 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:14.351945 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:14.352154 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497594352137 us; error 0 us; skew 500 ppm
I20260207 20:53:14.352818 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:14.354915 2940 webserver.cc:492] Webserver started at http://127.2.223.2:34041/ using document root <none> and password file <none>
I20260207 20:53:14.355342 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:14.355515 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:14.355717 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:14.356645 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b"
format_stamp: "Formatted at 2026-02-07 20:53:14 on dist-test-slave-kqw4"
I20260207 20:53:14.357153 8175 heartbeater.cc:499] Master 127.2.223.61:33175 was elected leader, sending a full tablet report...
I20260207 20:53:14.361061 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260207 20:53:14.364589 8189 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:14.365374 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:53:14.365675 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b"
format_stamp: "Formatted at 2026-02-07 20:53:14 on dist-test-slave-kqw4"
I20260207 20:53:14.365921 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:14.376919 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:14.378295 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:14.379616 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:14.381633 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:14.381804 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:14.382028 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:14.382169 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:14.428519 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:37037
I20260207 20:53:14.428628 8251 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:37037 every 8 connection(s)
I20260207 20:53:14.445156 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:14.460078 8253 heartbeater.cc:344] Connected to a master server at 127.2.223.61:33175
I20260207 20:53:14.460527 8253 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:14.461380 8253 heartbeater.cc:507] Master 127.2.223.61:33175 requested a full tablet report, sending...
I20260207 20:53:14.463554 7948 ts_manager.cc:194] Registered new tserver with Master: b2cf2b2c5b394ae58917dc8ac3a1ca8b (127.2.223.2:37037)
I20260207 20:53:14.463943 8254 heartbeater.cc:344] Connected to a master server at 127.2.223.62:45145
I20260207 20:53:14.464126 8252 heartbeater.cc:344] Connected to a master server at 127.2.223.60:38055
I20260207 20:53:14.464448 8254 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:14.464507 8252 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:14.465318 7948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60832
I20260207 20:53:14.465471 8252 heartbeater.cc:507] Master 127.2.223.60:38055 requested a full tablet report, sending...
W20260207 20:53:14.463541 8259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:14.468161 8254 heartbeater.cc:507] Master 127.2.223.62:45145 requested a full tablet report, sending...
I20260207 20:53:14.471585 8013 ts_manager.cc:194] Registered new tserver with Master: b2cf2b2c5b394ae58917dc8ac3a1ca8b (127.2.223.2:37037)
I20260207 20:53:14.471611 7883 ts_manager.cc:194] Registered new tserver with Master: b2cf2b2c5b394ae58917dc8ac3a1ca8b (127.2.223.2:37037)
W20260207 20:53:14.474176 8260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:14.477106 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:14.477154 8263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:14.478209 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:14.478438 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:14.478654 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497594478638 us; error 0 us; skew 500 ppm
I20260207 20:53:14.479245 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:14.480091 8253 heartbeater.cc:499] Master 127.2.223.61:33175 was elected leader, sending a full tablet report...
I20260207 20:53:14.482196 2940 webserver.cc:492] Webserver started at http://127.2.223.3:38513/ using document root <none> and password file <none>
I20260207 20:53:14.482900 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:14.483160 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:14.483526 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:14.484800 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "827a0bb540cf4dd3b439f348d64ee5e2"
format_stamp: "Formatted at 2026-02-07 20:53:14 on dist-test-slave-kqw4"
I20260207 20:53:14.490356 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260207 20:53:14.493755 8267 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:14.494714 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:53:14.495061 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "827a0bb540cf4dd3b439f348d64ee5e2"
format_stamp: "Formatted at 2026-02-07 20:53:14 on dist-test-slave-kqw4"
I20260207 20:53:14.495422 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:14.519824 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:14.521340 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:14.523103 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:14.525240 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:14.525441 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:14.525662 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:14.525841 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:14.584801 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:42357
I20260207 20:53:14.584940 8329 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:42357 every 8 connection(s)
I20260207 20:53:14.617308 8330 heartbeater.cc:344] Connected to a master server at 127.2.223.60:38055
I20260207 20:53:14.617882 8330 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:14.618822 8330 heartbeater.cc:507] Master 127.2.223.60:38055 requested a full tablet report, sending...
I20260207 20:53:14.621469 8012 ts_manager.cc:194] Registered new tserver with Master: 827a0bb540cf4dd3b439f348d64ee5e2 (127.2.223.3:42357)
I20260207 20:53:14.626732 8331 heartbeater.cc:344] Connected to a master server at 127.2.223.61:33175
I20260207 20:53:14.627081 8331 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:14.627810 8331 heartbeater.cc:507] Master 127.2.223.61:33175 requested a full tablet report, sending...
I20260207 20:53:14.629478 8333 heartbeater.cc:344] Connected to a master server at 127.2.223.62:45145
I20260207 20:53:14.629582 7948 ts_manager.cc:194] Registered new tserver with Master: 827a0bb540cf4dd3b439f348d64ee5e2 (127.2.223.3:42357)
I20260207 20:53:14.629858 8333 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:14.630537 8333 heartbeater.cc:507] Master 127.2.223.62:45145 requested a full tablet report, sending...
I20260207 20:53:14.630995 7948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60848
I20260207 20:53:14.633226 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017165453s
I20260207 20:53:14.633121 7882 ts_manager.cc:194] Registered new tserver with Master: 827a0bb540cf4dd3b439f348d64ee5e2 (127.2.223.3:42357)
I20260207 20:53:14.643390 8331 heartbeater.cc:499] Master 127.2.223.61:33175 was elected leader, sending a full tablet report...
I20260207 20:53:14.686826 7948 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60856:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:53:14.690716 7948 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:53:14.872792 8139 tablet_service.cc:1505] Processing CreateTablet for tablet c7794b75d70c4285a8349d0ae2f7a7f1 (DEFAULT_TABLE table=ksck-test-table [id=8c4d07e5b44a49f9a2d961c6df2cc36a]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:14.874141 8139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7794b75d70c4285a8349d0ae2f7a7f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:14.873878 8217 tablet_service.cc:1505] Processing CreateTablet for tablet c7794b75d70c4285a8349d0ae2f7a7f1 (DEFAULT_TABLE table=ksck-test-table [id=8c4d07e5b44a49f9a2d961c6df2cc36a]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:14.874253 8216 tablet_service.cc:1505] Processing CreateTablet for tablet 87c57b12f4854fd29a2bd7f43f3b8f81 (DEFAULT_TABLE table=ksck-test-table [id=8c4d07e5b44a49f9a2d961c6df2cc36a]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:14.875159 8217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7794b75d70c4285a8349d0ae2f7a7f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:14.875840 8216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87c57b12f4854fd29a2bd7f43f3b8f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:14.874607 8215 tablet_service.cc:1505] Processing CreateTablet for tablet eff383c3370e473a9b80b73f8dd775f3 (DEFAULT_TABLE table=ksck-test-table [id=8c4d07e5b44a49f9a2d961c6df2cc36a]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:14.880789 8215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eff383c3370e473a9b80b73f8dd775f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:14.883854 8138 tablet_service.cc:1505] Processing CreateTablet for tablet 87c57b12f4854fd29a2bd7f43f3b8f81 (DEFAULT_TABLE table=ksck-test-table [id=8c4d07e5b44a49f9a2d961c6df2cc36a]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:14.884518 8295 tablet_service.cc:1505] Processing CreateTablet for tablet c7794b75d70c4285a8349d0ae2f7a7f1 (DEFAULT_TABLE table=ksck-test-table [id=8c4d07e5b44a49f9a2d961c6df2cc36a]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:14.885222 8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87c57b12f4854fd29a2bd7f43f3b8f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:14.885772 8295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7794b75d70c4285a8349d0ae2f7a7f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:14.887491 8137 tablet_service.cc:1505] Processing CreateTablet for tablet eff383c3370e473a9b80b73f8dd775f3 (DEFAULT_TABLE table=ksck-test-table [id=8c4d07e5b44a49f9a2d961c6df2cc36a]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:14.887835 8294 tablet_service.cc:1505] Processing CreateTablet for tablet 87c57b12f4854fd29a2bd7f43f3b8f81 (DEFAULT_TABLE table=ksck-test-table [id=8c4d07e5b44a49f9a2d961c6df2cc36a]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:14.888769 8137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eff383c3370e473a9b80b73f8dd775f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:14.889187 8294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87c57b12f4854fd29a2bd7f43f3b8f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:14.891595 8293 tablet_service.cc:1505] Processing CreateTablet for tablet eff383c3370e473a9b80b73f8dd775f3 (DEFAULT_TABLE table=ksck-test-table [id=8c4d07e5b44a49f9a2d961c6df2cc36a]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:14.892866 8293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eff383c3370e473a9b80b73f8dd775f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:14.939970 8352 tablet_bootstrap.cc:492] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: Bootstrap starting.
I20260207 20:53:14.945760 8352 tablet_bootstrap.cc:654] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:14.973402 8352 tablet_bootstrap.cc:492] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: No bootstrap required, opened a new log
I20260207 20:53:14.973901 8352 ts_tablet_manager.cc:1403] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.008s
I20260207 20:53:14.976558 8352 raft_consensus.cc:359] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:14.977242 8352 raft_consensus.cc:385] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:14.977517 8352 raft_consensus.cc:740] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cf2b2c5b394ae58917dc8ac3a1ca8b, State: Initialized, Role: FOLLOWER
I20260207 20:53:14.986282 8352 consensus_queue.cc:260] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:14.992247 8352 ts_tablet_manager.cc:1434] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: Time spent starting tablet: real 0.018s user 0.008s sys 0.001s
I20260207 20:53:14.996843 8355 tablet_bootstrap.cc:492] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2: Bootstrap starting.
I20260207 20:53:15.004307 8355 tablet_bootstrap.cc:654] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:15.016630 8352 tablet_bootstrap.cc:492] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: Bootstrap starting.
I20260207 20:53:15.019153 8351 tablet_bootstrap.cc:492] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42: Bootstrap starting.
I20260207 20:53:15.023130 8352 tablet_bootstrap.cc:654] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:15.025413 8351 tablet_bootstrap.cc:654] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:15.030678 8352 tablet_bootstrap.cc:492] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: No bootstrap required, opened a new log
I20260207 20:53:15.031195 8352 ts_tablet_manager.cc:1403] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.008s
I20260207 20:53:15.037271 8355 tablet_bootstrap.cc:492] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2: No bootstrap required, opened a new log
I20260207 20:53:15.037801 8355 ts_tablet_manager.cc:1403] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2: Time spent bootstrapping tablet: real 0.043s user 0.008s sys 0.003s
I20260207 20:53:15.040586 8355 raft_consensus.cc:359] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } }
I20260207 20:53:15.041245 8355 raft_consensus.cc:385] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:15.041515 8355 raft_consensus.cc:740] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 827a0bb540cf4dd3b439f348d64ee5e2, State: Initialized, Role: FOLLOWER
I20260207 20:53:15.034075 8352 raft_consensus.cc:359] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.042317 8352 raft_consensus.cc:385] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:15.042686 8352 raft_consensus.cc:740] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cf2b2c5b394ae58917dc8ac3a1ca8b, State: Initialized, Role: FOLLOWER
I20260207 20:53:15.043452 8352 consensus_queue.cc:260] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.044499 8355 consensus_queue.cc:260] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } }
I20260207 20:53:15.049319 8352 ts_tablet_manager.cc:1434] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260207 20:53:15.052476 8351 tablet_bootstrap.cc:492] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42: No bootstrap required, opened a new log
I20260207 20:53:15.053002 8351 ts_tablet_manager.cc:1403] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42: Time spent bootstrapping tablet: real 0.037s user 0.021s sys 0.011s
I20260207 20:53:15.055747 8351 raft_consensus.cc:359] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } }
I20260207 20:53:15.056393 8351 raft_consensus.cc:385] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:15.056679 8351 raft_consensus.cc:740] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f9a17ba9d93454096bbc5dee055ce42, State: Initialized, Role: FOLLOWER
I20260207 20:53:15.057386 8351 consensus_queue.cc:260] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } }
I20260207 20:53:15.058261 8352 tablet_bootstrap.cc:492] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: Bootstrap starting.
I20260207 20:53:15.067068 8351 ts_tablet_manager.cc:1434] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42: Time spent starting tablet: real 0.014s user 0.006s sys 0.007s
I20260207 20:53:15.071358 8351 tablet_bootstrap.cc:492] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42: Bootstrap starting.
I20260207 20:53:15.077664 8351 tablet_bootstrap.cc:654] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:15.091507 8351 tablet_bootstrap.cc:492] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42: No bootstrap required, opened a new log
I20260207 20:53:15.092402 8351 ts_tablet_manager.cc:1403] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.012s
I20260207 20:53:15.094689 8351 raft_consensus.cc:359] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.095391 8351 raft_consensus.cc:385] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:15.095696 8351 raft_consensus.cc:740] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f9a17ba9d93454096bbc5dee055ce42, State: Initialized, Role: FOLLOWER
I20260207 20:53:15.096451 8351 consensus_queue.cc:260] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.099406 8355 ts_tablet_manager.cc:1434] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2: Time spent starting tablet: real 0.061s user 0.016s sys 0.014s
I20260207 20:53:15.100520 8355 tablet_bootstrap.cc:492] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2: Bootstrap starting.
I20260207 20:53:15.103287 8351 ts_tablet_manager.cc:1434] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42: Time spent starting tablet: real 0.011s user 0.002s sys 0.004s
I20260207 20:53:15.104473 8351 tablet_bootstrap.cc:492] T eff383c3370e473a9b80b73f8dd775f3 P 9f9a17ba9d93454096bbc5dee055ce42: Bootstrap starting.
I20260207 20:53:15.110553 8351 tablet_bootstrap.cc:654] T eff383c3370e473a9b80b73f8dd775f3 P 9f9a17ba9d93454096bbc5dee055ce42: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:15.112715 8355 tablet_bootstrap.cc:654] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:15.120633 8352 tablet_bootstrap.cc:654] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:15.124742 8355 tablet_bootstrap.cc:492] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2: No bootstrap required, opened a new log
I20260207 20:53:15.125288 8355 ts_tablet_manager.cc:1403] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.011s
I20260207 20:53:15.133024 8355 raft_consensus.cc:359] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.133778 8355 raft_consensus.cc:385] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:15.134223 8355 raft_consensus.cc:740] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 827a0bb540cf4dd3b439f348d64ee5e2, State: Initialized, Role: FOLLOWER
I20260207 20:53:15.135038 8355 consensus_queue.cc:260] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.137351 8355 ts_tablet_manager.cc:1434] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2: Time spent starting tablet: real 0.012s user 0.003s sys 0.003s
I20260207 20:53:15.138401 8355 tablet_bootstrap.cc:492] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2: Bootstrap starting.
I20260207 20:53:15.148773 8355 tablet_bootstrap.cc:654] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:15.157017 8069 catalog_manager.cc:1269] Loaded cluster ID: 81895a95e5154311a39105fb6878252a
I20260207 20:53:15.157351 8069 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad: loading cluster ID for follower catalog manager: success
I20260207 20:53:15.161759 8078 catalog_manager.cc:1269] Loaded cluster ID: 81895a95e5154311a39105fb6878252a
I20260207 20:53:15.162166 8078 catalog_manager.cc:1562] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d: loading cluster ID for follower catalog manager: success
I20260207 20:53:15.168771 8078 catalog_manager.cc:1584] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d: acquiring CA information for follower catalog manager: success
I20260207 20:53:15.168413 8355 tablet_bootstrap.cc:492] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2: No bootstrap required, opened a new log
I20260207 20:53:15.172595 8359 raft_consensus.cc:493] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:15.173091 8355 ts_tablet_manager.cc:1403] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2: Time spent bootstrapping tablet: real 0.035s user 0.015s sys 0.003s
I20260207 20:53:15.173156 8359 raft_consensus.cc:515] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.173668 8078 catalog_manager.cc:1612] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:15.176802 8355 raft_consensus.cc:359] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.179814 8355 raft_consensus.cc:385] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:15.180189 8355 raft_consensus.cc:740] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 827a0bb540cf4dd3b439f348d64ee5e2, State: Initialized, Role: FOLLOWER
I20260207 20:53:15.180692 8352 tablet_bootstrap.cc:492] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: No bootstrap required, opened a new log
I20260207 20:53:15.180998 8355 consensus_queue.cc:260] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.181831 8352 ts_tablet_manager.cc:1403] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: Time spent bootstrapping tablet: real 0.124s user 0.014s sys 0.001s
I20260207 20:53:15.192775 8359 leader_election.cc:290] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f9a17ba9d93454096bbc5dee055ce42 (127.2.223.1:35379), b2cf2b2c5b394ae58917dc8ac3a1ca8b (127.2.223.2:37037)
I20260207 20:53:15.204764 8355 ts_tablet_manager.cc:1434] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2: Time spent starting tablet: real 0.031s user 0.009s sys 0.009s
I20260207 20:53:15.175889 8069 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad: acquiring CA information for follower catalog manager: success
I20260207 20:53:15.210840 8149 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eff383c3370e473a9b80b73f8dd775f3" candidate_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f9a17ba9d93454096bbc5dee055ce42" is_pre_election: true
W20260207 20:53:15.212210 8269 leader_election.cc:343] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f9a17ba9d93454096bbc5dee055ce42 (127.2.223.1:35379): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:53:15.215409 8360 raft_consensus.cc:493] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:15.215929 8360 raft_consensus.cc:515] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.220595 8360 leader_election.cc:290] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cf2b2c5b394ae58917dc8ac3a1ca8b (127.2.223.2:37037), 827a0bb540cf4dd3b439f348d64ee5e2 (127.2.223.3:42357)
I20260207 20:53:15.226120 8352 raft_consensus.cc:359] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } }
I20260207 20:53:15.231015 8360 raft_consensus.cc:493] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:15.255558 8360 raft_consensus.cc:515] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } }
I20260207 20:53:15.255339 8352 raft_consensus.cc:385] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:15.256695 8352 raft_consensus.cc:740] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cf2b2c5b394ae58917dc8ac3a1ca8b, State: Initialized, Role: FOLLOWER
I20260207 20:53:15.257670 8360 leader_election.cc:290] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 827a0bb540cf4dd3b439f348d64ee5e2 (127.2.223.3:42357), b2cf2b2c5b394ae58917dc8ac3a1ca8b (127.2.223.2:37037)
I20260207 20:53:15.258925 8069 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:15.258035 8352 consensus_queue.cc:260] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } }
I20260207 20:53:15.259516 8227 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87c57b12f4854fd29a2bd7f43f3b8f81" candidate_uuid: "9f9a17ba9d93454096bbc5dee055ce42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" is_pre_election: true
I20260207 20:53:15.259860 8226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7794b75d70c4285a8349d0ae2f7a7f1" candidate_uuid: "9f9a17ba9d93454096bbc5dee055ce42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" is_pre_election: true
I20260207 20:53:15.260226 8227 raft_consensus.cc:2468] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f9a17ba9d93454096bbc5dee055ce42 in term 0.
I20260207 20:53:15.260485 8226 raft_consensus.cc:2468] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f9a17ba9d93454096bbc5dee055ce42 in term 0.
I20260207 20:53:15.261994 8100 leader_election.cc:304] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f9a17ba9d93454096bbc5dee055ce42, b2cf2b2c5b394ae58917dc8ac3a1ca8b; no voters:
I20260207 20:53:15.262948 8360 raft_consensus.cc:2804] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:15.263329 8360 raft_consensus.cc:493] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:15.263725 8360 raft_consensus.cc:3060] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:15.268308 8352 ts_tablet_manager.cc:1434] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: Time spent starting tablet: real 0.086s user 0.003s sys 0.003s
I20260207 20:53:15.271104 8100 leader_election.cc:304] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f9a17ba9d93454096bbc5dee055ce42, b2cf2b2c5b394ae58917dc8ac3a1ca8b; no voters:
I20260207 20:53:15.275725 8226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eff383c3370e473a9b80b73f8dd775f3" candidate_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" is_pre_election: true
I20260207 20:53:15.276420 8226 raft_consensus.cc:2468] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 827a0bb540cf4dd3b439f348d64ee5e2 in term 0.
I20260207 20:53:15.277029 8305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87c57b12f4854fd29a2bd7f43f3b8f81" candidate_uuid: "9f9a17ba9d93454096bbc5dee055ce42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" is_pre_election: true
I20260207 20:53:15.277721 8305 raft_consensus.cc:2468] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f9a17ba9d93454096bbc5dee055ce42 in term 0.
I20260207 20:53:15.279500 8305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7794b75d70c4285a8349d0ae2f7a7f1" candidate_uuid: "9f9a17ba9d93454096bbc5dee055ce42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" is_pre_election: true
I20260207 20:53:15.280156 8305 raft_consensus.cc:2468] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f9a17ba9d93454096bbc5dee055ce42 in term 0.
I20260207 20:53:15.280961 8268 leader_election.cc:304] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 827a0bb540cf4dd3b439f348d64ee5e2, b2cf2b2c5b394ae58917dc8ac3a1ca8b; no voters: 9f9a17ba9d93454096bbc5dee055ce42
I20260207 20:53:15.282908 8366 raft_consensus.cc:2804] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:15.283280 8366 raft_consensus.cc:493] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:15.283592 8366 raft_consensus.cc:3060] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:15.285702 8351 tablet_bootstrap.cc:492] T eff383c3370e473a9b80b73f8dd775f3 P 9f9a17ba9d93454096bbc5dee055ce42: No bootstrap required, opened a new log
I20260207 20:53:15.287624 8351 ts_tablet_manager.cc:1403] T eff383c3370e473a9b80b73f8dd775f3 P 9f9a17ba9d93454096bbc5dee055ce42: Time spent bootstrapping tablet: real 0.183s user 0.025s sys 0.042s
I20260207 20:53:15.286296 8360 raft_consensus.cc:515] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.291229 8366 raft_consensus.cc:515] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.294576 8149 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eff383c3370e473a9b80b73f8dd775f3" candidate_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f9a17ba9d93454096bbc5dee055ce42"
I20260207 20:53:15.295132 8366 leader_election.cc:290] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [CANDIDATE]: Term 1 election: Requested vote from peers 9f9a17ba9d93454096bbc5dee055ce42 (127.2.223.1:35379), b2cf2b2c5b394ae58917dc8ac3a1ca8b (127.2.223.2:37037)
I20260207 20:53:15.291164 8351 raft_consensus.cc:359] T eff383c3370e473a9b80b73f8dd775f3 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.296730 8226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eff383c3370e473a9b80b73f8dd775f3" candidate_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b"
I20260207 20:53:15.297549 8351 raft_consensus.cc:385] T eff383c3370e473a9b80b73f8dd775f3 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:15.297428 8226 raft_consensus.cc:3060] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:15.298342 8351 raft_consensus.cc:740] T eff383c3370e473a9b80b73f8dd775f3 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f9a17ba9d93454096bbc5dee055ce42, State: Initialized, Role: FOLLOWER
I20260207 20:53:15.299115 8351 consensus_queue.cc:260] T eff383c3370e473a9b80b73f8dd775f3 P 9f9a17ba9d93454096bbc5dee055ce42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.300783 8149 raft_consensus.cc:3060] T eff383c3370e473a9b80b73f8dd775f3 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:15.305488 8226 raft_consensus.cc:2468] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 827a0bb540cf4dd3b439f348d64ee5e2 in term 1.
I20260207 20:53:15.306862 8268 leader_election.cc:304] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 827a0bb540cf4dd3b439f348d64ee5e2, b2cf2b2c5b394ae58917dc8ac3a1ca8b; no voters:
I20260207 20:53:15.317950 8366 raft_consensus.cc:2804] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:15.320103 8366 raft_consensus.cc:697] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 1 LEADER]: Becoming Leader. State: Replica: 827a0bb540cf4dd3b439f348d64ee5e2, State: Running, Role: LEADER
I20260207 20:53:15.318315 8149 raft_consensus.cc:2468] T eff383c3370e473a9b80b73f8dd775f3 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 827a0bb540cf4dd3b439f348d64ee5e2 in term 1.
I20260207 20:53:15.321221 8366 consensus_queue.cc:237] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.344410 8372 raft_consensus.cc:2804] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260207 20:53:15.344297 8100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.223.2:37037, user_credentials={real_user=slave}} blocked reactor thread for 73289.7us
I20260207 20:53:15.346626 8372 raft_consensus.cc:493] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:15.347160 8372 raft_consensus.cc:3060] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:15.294616 8360 leader_election.cc:290] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [CANDIDATE]: Term 1 election: Requested vote from peers b2cf2b2c5b394ae58917dc8ac3a1ca8b (127.2.223.2:37037), 827a0bb540cf4dd3b439f348d64ee5e2 (127.2.223.3:42357)
I20260207 20:53:15.347733 8226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87c57b12f4854fd29a2bd7f43f3b8f81" candidate_uuid: "9f9a17ba9d93454096bbc5dee055ce42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b"
I20260207 20:53:15.348310 8226 raft_consensus.cc:3060] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:15.350500 8351 ts_tablet_manager.cc:1434] T eff383c3370e473a9b80b73f8dd775f3 P 9f9a17ba9d93454096bbc5dee055ce42: Time spent starting tablet: real 0.062s user 0.013s sys 0.016s
I20260207 20:53:15.294646 8305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87c57b12f4854fd29a2bd7f43f3b8f81" candidate_uuid: "9f9a17ba9d93454096bbc5dee055ce42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827a0bb540cf4dd3b439f348d64ee5e2"
I20260207 20:53:15.351066 8305 raft_consensus.cc:3060] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:15.360023 8305 raft_consensus.cc:2468] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f9a17ba9d93454096bbc5dee055ce42 in term 1.
I20260207 20:53:15.360471 8226 raft_consensus.cc:2468] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f9a17ba9d93454096bbc5dee055ce42 in term 1.
I20260207 20:53:15.361263 8102 leader_election.cc:304] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 827a0bb540cf4dd3b439f348d64ee5e2, 9f9a17ba9d93454096bbc5dee055ce42; no voters:
I20260207 20:53:15.361531 8372 raft_consensus.cc:515] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } }
I20260207 20:53:15.363101 8374 raft_consensus.cc:2804] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:15.365326 8374 raft_consensus.cc:697] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 LEADER]: Becoming Leader. State: Replica: 9f9a17ba9d93454096bbc5dee055ce42, State: Running, Role: LEADER
I20260207 20:53:15.366271 8374 consensus_queue.cc:237] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } }
I20260207 20:53:15.370764 8372 leader_election.cc:290] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [CANDIDATE]: Term 1 election: Requested vote from peers 827a0bb540cf4dd3b439f348d64ee5e2 (127.2.223.3:42357), b2cf2b2c5b394ae58917dc8ac3a1ca8b (127.2.223.2:37037)
I20260207 20:53:15.371834 8226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7794b75d70c4285a8349d0ae2f7a7f1" candidate_uuid: "9f9a17ba9d93454096bbc5dee055ce42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b"
I20260207 20:53:15.372265 8305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7794b75d70c4285a8349d0ae2f7a7f1" candidate_uuid: "9f9a17ba9d93454096bbc5dee055ce42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827a0bb540cf4dd3b439f348d64ee5e2"
I20260207 20:53:15.372457 8226 raft_consensus.cc:3060] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:15.372857 8305 raft_consensus.cc:3060] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:15.377230 7948 catalog_manager.cc:5654] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 827a0bb540cf4dd3b439f348d64ee5e2 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:15.382047 8305 raft_consensus.cc:2468] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f9a17ba9d93454096bbc5dee055ce42 in term 1.
I20260207 20:53:15.383291 8102 leader_election.cc:304] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 827a0bb540cf4dd3b439f348d64ee5e2, 9f9a17ba9d93454096bbc5dee055ce42; no voters:
I20260207 20:53:15.384776 8372 raft_consensus.cc:2804] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:15.386041 8226 raft_consensus.cc:2468] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f9a17ba9d93454096bbc5dee055ce42 in term 1.
I20260207 20:53:15.388630 8372 raft_consensus.cc:697] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 LEADER]: Becoming Leader. State: Replica: 9f9a17ba9d93454096bbc5dee055ce42, State: Running, Role: LEADER
I20260207 20:53:15.389851 8372 consensus_queue.cc:237] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } } peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } }
I20260207 20:53:15.432904 7946 catalog_manager.cc:5654] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f9a17ba9d93454096bbc5dee055ce42 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "9f9a17ba9d93454096bbc5dee055ce42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } health_report { overall_health: UNKNOWN } } }
I20260207 20:53:15.464020 7946 catalog_manager.cc:5654] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f9a17ba9d93454096bbc5dee055ce42 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "9f9a17ba9d93454096bbc5dee055ce42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a0bb540cf4dd3b439f348d64ee5e2" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2cf2b2c5b394ae58917dc8ac3a1ca8b" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f9a17ba9d93454096bbc5dee055ce42" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 35379 } health_report { overall_health: HEALTHY } } }
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tools/ksck_remote-test.cc:514: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
I20260207 20:53:15.639448 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:53:15.681121 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:15.682804 2940 tablet_replica.cc:333] T eff383c3370e473a9b80b73f8dd775f3 P 9f9a17ba9d93454096bbc5dee055ce42: stopping tablet replica
I20260207 20:53:15.683606 2940 raft_consensus.cc:2243] T eff383c3370e473a9b80b73f8dd775f3 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:15.684128 2940 raft_consensus.cc:2272] T eff383c3370e473a9b80b73f8dd775f3 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:15.688210 2940 tablet_replica.cc:333] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42: stopping tablet replica
I20260207 20:53:15.688967 2940 raft_consensus.cc:2243] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:15.690274 2940 pending_rounds.cc:70] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42: Trying to abort 1 pending ops.
I20260207 20:53:15.690452 2940 pending_rounds.cc:77] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7251958150631108608 op_type: NO_OP noop_request { }
I20260207 20:53:15.690771 2940 raft_consensus.cc:2889] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260207 20:53:15.691040 2940 raft_consensus.cc:2272] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:15.693066 2940 tablet_replica.cc:333] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42: stopping tablet replica
I20260207 20:53:15.693570 2940 raft_consensus.cc:2243] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:15.694221 2940 pending_rounds.cc:70] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42: Trying to abort 1 pending ops.
I20260207 20:53:15.694442 2940 pending_rounds.cc:77] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7251958150734753792 op_type: NO_OP noop_request { }
I20260207 20:53:15.694802 2940 raft_consensus.cc:2889] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260207 20:53:15.695129 2940 raft_consensus.cc:2272] T c7794b75d70c4285a8349d0ae2f7a7f1 P 9f9a17ba9d93454096bbc5dee055ce42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:15.721388 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
W20260207 20:53:15.732127 8269 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.223.1:35379: connect: Connection refused (error 111) [suppressed 17 similar messages]
I20260207 20:53:15.736195 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
W20260207 20:53:15.736716 8269 consensus_peers.cc:597] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 -> Peer 9f9a17ba9d93454096bbc5dee055ce42 (127.2.223.1:35379): Couldn't send request to peer 9f9a17ba9d93454096bbc5dee055ce42. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:35379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:15.775624 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:15.776391 2940 tablet_replica.cc:333] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: stopping tablet replica
I20260207 20:53:15.776944 2940 raft_consensus.cc:2243] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:15.777359 2940 raft_consensus.cc:2272] T c7794b75d70c4285a8349d0ae2f7a7f1 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:15.779457 2940 tablet_replica.cc:333] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: stopping tablet replica
I20260207 20:53:15.779961 2940 raft_consensus.cc:2243] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:15.780299 2940 raft_consensus.cc:2272] T 87c57b12f4854fd29a2bd7f43f3b8f81 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:15.782150 2940 tablet_replica.cc:333] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b: stopping tablet replica
I20260207 20:53:15.782670 2940 raft_consensus.cc:2243] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:15.783106 2940 raft_consensus.cc:2272] T eff383c3370e473a9b80b73f8dd775f3 P b2cf2b2c5b394ae58917dc8ac3a1ca8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:15.803229 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:53:15.814088 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:53:15.841396 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:15.841990 2940 tablet_replica.cc:333] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2: stopping tablet replica
I20260207 20:53:15.842505 2940 raft_consensus.cc:2243] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:15.842948 2940 raft_consensus.cc:2272] T 87c57b12f4854fd29a2bd7f43f3b8f81 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:15.844568 2940 tablet_replica.cc:333] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2: stopping tablet replica
I20260207 20:53:15.845011 2940 raft_consensus.cc:2243] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:15.845611 2940 pending_rounds.cc:70] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2: Trying to abort 1 pending ops.
I20260207 20:53:15.845796 2940 pending_rounds.cc:77] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7251958150534721536 op_type: NO_OP noop_request { }
I20260207 20:53:15.846033 2940 raft_consensus.cc:2889] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260207 20:53:15.846274 2940 raft_consensus.cc:2272] T eff383c3370e473a9b80b73f8dd775f3 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:15.848237 2940 tablet_replica.cc:333] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2: stopping tablet replica
I20260207 20:53:15.848676 2940 raft_consensus.cc:2243] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:15.849002 2940 raft_consensus.cc:2272] T c7794b75d70c4285a8349d0ae2f7a7f1 P 827a0bb540cf4dd3b439f348d64ee5e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:15.868618 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:53:15.880178 2940 master.cc:561] Master@127.2.223.62:45145 shutting down...
I20260207 20:53:15.893165 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:15.893682 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:15.893985 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 410f7ba132334278bcc2775d8abe7cad: stopping tablet replica
I20260207 20:53:15.913172 2940 master.cc:583] Master@127.2.223.62:45145 shutdown complete.
W20260207 20:53:15.924264 7935 consensus_peers.cc:597] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 -> Peer 410f7ba132334278bcc2775d8abe7cad (127.2.223.62:45145): Couldn't send request to peer 410f7ba132334278bcc2775d8abe7cad. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.62:45145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:15.924924 2940 master.cc:561] Master@127.2.223.61:33175 shutting down...
I20260207 20:53:15.938016 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:15.938932 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:15.939258 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P fe91c92b79044eb1af2bcb21489016a6: stopping tablet replica
I20260207 20:53:15.958074 2940 master.cc:583] Master@127.2.223.61:33175 shutdown complete.
I20260207 20:53:15.968509 2940 master.cc:561] Master@127.2.223.60:38055 shutting down...
I20260207 20:53:15.982156 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:15.982765 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:15.983085 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P fa8ee9dffe1f47479a167bc5a7788f5d: stopping tablet replica
I20260207 20:53:16.002243 2940 master.cc:583] Master@127.2.223.60:38055 shutdown complete.
[ SKIPPED ] RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM (2222 ms)
[ RUN ] RemoteKsckTest.TestLeaderMasterDown
I20260207 20:53:16.029476 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:36353,127.2.223.61:39235,127.2.223.60:33479
I20260207 20:53:16.030843 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:16.035547 8393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:16.035738 8394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:16.036788 8396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:16.037935 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:16.038671 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:16.038839 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:16.038980 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497596038964 us; error 0 us; skew 500 ppm
I20260207 20:53:16.039449 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:16.041523 2940 webserver.cc:492] Webserver started at http://127.2.223.62:43905/ using document root <none> and password file <none>
I20260207 20:53:16.041935 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:16.042089 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:16.042316 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:16.043325 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df"
format_stamp: "Formatted at 2026-02-07 20:53:16 on dist-test-slave-kqw4"
I20260207 20:53:16.047365 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260207 20:53:16.050572 8401 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:16.051362 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260207 20:53:16.051680 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df"
format_stamp: "Formatted at 2026-02-07 20:53:16 on dist-test-slave-kqw4"
I20260207 20:53:16.052008 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:16.077512 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:16.078475 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:16.111249 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:36353
I20260207 20:53:16.111342 8452 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:36353 every 8 connection(s)
I20260207 20:53:16.114967 8453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:16.115089 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:16.120098 8455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:16.121549 8456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:16.123064 8458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:16.123286 8453 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:16.123986 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:16.124910 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:16.125108 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:16.125265 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497596125250 us; error 0 us; skew 500 ppm
I20260207 20:53:16.125805 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:16.128330 2940 webserver.cc:492] Webserver started at http://127.2.223.61:45429/ using document root <none> and password file <none>
I20260207 20:53:16.128772 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:16.128952 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:16.129184 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:16.130142 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "540c438f6152485a8c49fdc1a034ad1c"
format_stamp: "Formatted at 2026-02-07 20:53:16 on dist-test-slave-kqw4"
I20260207 20:53:16.135342 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260207 20:53:16.139065 8465 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:16.139838 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260207 20:53:16.140115 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "540c438f6152485a8c49fdc1a034ad1c"
format_stamp: "Formatted at 2026-02-07 20:53:16 on dist-test-slave-kqw4"
I20260207 20:53:16.140435 8453 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:16.140439 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:53:16.145911 8453 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:39235: Network error: Client connection negotiation failed: client connection to 127.2.223.61:39235: connect: Connection refused (error 111)
I20260207 20:53:16.151415 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:16.152447 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:16.186766 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:39235
I20260207 20:53:16.186879 8517 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:39235 every 8 connection(s)
I20260207 20:53:16.190351 8518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:16.190483 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:16.195605 8520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:16.197310 8453 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } attempt: 1
I20260207 20:53:16.199357 8518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:16.197933 8521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:16.206007 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:16.208420 8523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:16.209575 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:16.209906 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:16.210107 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497596210091 us; error 0 us; skew 500 ppm
I20260207 20:53:16.210738 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:16.213003 8518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:16.214695 2940 webserver.cc:492] Webserver started at http://127.2.223.60:35451/ using document root <none> and password file <none>
I20260207 20:53:16.215286 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:16.215533 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:16.215826 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:16.216171 8453 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:16.217046 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "f1e9b4ee86f54b98a67a3a689ff46d86"
format_stamp: "Formatted at 2026-02-07 20:53:16 on dist-test-slave-kqw4"
W20260207 20:53:16.221009 8453 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:33479: Network error: Client connection negotiation failed: client connection to 127.2.223.60:33479: connect: Connection refused (error 111)
I20260207 20:53:16.222890 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260207 20:53:16.223981 8518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:16.226835 8530 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:16.227841 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260207 20:53:16.228204 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "f1e9b4ee86f54b98a67a3a689ff46d86"
format_stamp: "Formatted at 2026-02-07 20:53:16 on dist-test-slave-kqw4"
I20260207 20:53:16.228484 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:53:16.229506 8518 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:33479: Network error: Client connection negotiation failed: client connection to 127.2.223.60:33479: connect: Connection refused (error 111)
I20260207 20:53:16.241508 8453 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } attempt: 1
W20260207 20:53:16.245584 8453 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:33479: Network error: Client connection negotiation failed: client connection to 127.2.223.60:33479: connect: Connection refused (error 111)
I20260207 20:53:16.255681 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:16.256718 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:16.260018 8518 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } attempt: 1
W20260207 20:53:16.264062 8518 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:33479: Network error: Client connection negotiation failed: client connection to 127.2.223.60:33479: connect: Connection refused (error 111)
I20260207 20:53:16.283064 8453 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } attempt: 2
W20260207 20:53:16.287710 8453 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:33479: Network error: Client connection negotiation failed: client connection to 127.2.223.60:33479: connect: Connection refused (error 111)
I20260207 20:53:16.292924 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:33479
I20260207 20:53:16.293015 8582 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:33479 every 8 connection(s)
I20260207 20:53:16.295830 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:53:16.296720 8583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:16.302767 8583 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:16.307562 8518 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } attempt: 2
I20260207 20:53:16.314174 8583 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:16.323545 8583 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:16.324498 8518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c: Bootstrap starting.
I20260207 20:53:16.329681 8518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:16.334046 8518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c: No bootstrap required, opened a new log
I20260207 20:53:16.336027 8518 raft_consensus.cc:359] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } }
I20260207 20:53:16.336545 8518 raft_consensus.cc:385] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:16.336767 8518 raft_consensus.cc:740] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 540c438f6152485a8c49fdc1a034ad1c, State: Initialized, Role: FOLLOWER
I20260207 20:53:16.337327 8518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } }
I20260207 20:53:16.338838 8583 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86: Bootstrap starting.
I20260207 20:53:16.339069 8588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } } }
I20260207 20:53:16.339757 8588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:16.340260 8518 sys_catalog.cc:565] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:16.343844 8583 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:16.348554 8583 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86: No bootstrap required, opened a new log
I20260207 20:53:16.351063 8583 raft_consensus.cc:359] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } }
I20260207 20:53:16.351739 8583 raft_consensus.cc:385] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:16.352035 8583 raft_consensus.cc:740] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1e9b4ee86f54b98a67a3a689ff46d86, State: Initialized, Role: FOLLOWER
I20260207 20:53:16.352703 8583 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } }
I20260207 20:53:16.354692 8601 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } } }
I20260207 20:53:16.355221 8601 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [sys.catalog]: This master's current role is: FOLLOWER
W20260207 20:53:16.355350 8600 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:16.355720 8600 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:16.356295 8583 sys_catalog.cc:565] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [sys.catalog]: configured and running, proceeding with master startup.
W20260207 20:53:16.368394 8612 catalog_manager.cc:1568] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:16.368693 8612 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:16.379184 8453 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } attempt: 3
I20260207 20:53:16.392383 8453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df: Bootstrap starting.
I20260207 20:53:16.396441 8453 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:16.400053 8453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df: No bootstrap required, opened a new log
I20260207 20:53:16.401809 8453 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } }
I20260207 20:53:16.402278 8453 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:16.402457 8453 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f24dc3ff6d842c9983dfe3fac3bd4df, State: Initialized, Role: FOLLOWER
I20260207 20:53:16.402980 8453 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } }
I20260207 20:53:16.404428 8614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } } }
I20260207 20:53:16.404953 8614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:16.405622 8453 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:16.414855 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:53:16.415144 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:53:16.416951 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:16.418809 8625 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:16.419137 8625 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:53:16.423390 8626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:16.423998 8627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:16.426057 8629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:16.426314 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:16.427172 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:16.427369 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:16.427522 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497596427507 us; error 0 us; skew 500 ppm
I20260207 20:53:16.428035 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:16.430243 2940 webserver.cc:492] Webserver started at http://127.2.223.1:41749/ using document root <none> and password file <none>
I20260207 20:53:16.430737 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:16.430918 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:16.431147 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:16.432135 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "50d548d9eabe495d8e3b1a3f95876da6"
format_stamp: "Formatted at 2026-02-07 20:53:16 on dist-test-slave-kqw4"
I20260207 20:53:16.436261 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260207 20:53:16.439355 8634 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:16.440084 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:53:16.440356 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "50d548d9eabe495d8e3b1a3f95876da6"
format_stamp: "Formatted at 2026-02-07 20:53:16 on dist-test-slave-kqw4"
I20260207 20:53:16.440622 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:16.446084 8601 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:16.446612 8601 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } }
I20260207 20:53:16.448503 8601 leader_election.cc:290] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f24dc3ff6d842c9983dfe3fac3bd4df (127.2.223.62:36353), 540c438f6152485a8c49fdc1a034ad1c (127.2.223.61:39235)
I20260207 20:53:16.449141 8428 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" is_pre_election: true
I20260207 20:53:16.449867 8493 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "540c438f6152485a8c49fdc1a034ad1c" is_pre_election: true
I20260207 20:53:16.449882 8428 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1e9b4ee86f54b98a67a3a689ff46d86 in term 0.
I20260207 20:53:16.450659 8493 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1e9b4ee86f54b98a67a3a689ff46d86 in term 0.
I20260207 20:53:16.451913 8533 leader_election.cc:304] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 540c438f6152485a8c49fdc1a034ad1c, f1e9b4ee86f54b98a67a3a689ff46d86; no voters:
I20260207 20:53:16.453086 8601 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:16.453428 8601 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:16.453822 8601 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:16.460695 8601 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } }
I20260207 20:53:16.462519 8601 leader_election.cc:290] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [CANDIDATE]: Term 1 election: Requested vote from peers 9f24dc3ff6d842c9983dfe3fac3bd4df (127.2.223.62:36353), 540c438f6152485a8c49fdc1a034ad1c (127.2.223.61:39235)
I20260207 20:53:16.463361 8428 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df"
I20260207 20:53:16.463959 8428 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:16.463454 8493 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "540c438f6152485a8c49fdc1a034ad1c"
I20260207 20:53:16.466931 8493 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:16.470631 8428 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1e9b4ee86f54b98a67a3a689ff46d86 in term 1.
I20260207 20:53:16.471896 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:16.471822 8534 leader_election.cc:304] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f24dc3ff6d842c9983dfe3fac3bd4df, f1e9b4ee86f54b98a67a3a689ff46d86; no voters:
I20260207 20:53:16.472400 8493 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1e9b4ee86f54b98a67a3a689ff46d86 in term 1.
I20260207 20:53:16.472704 8601 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:16.473184 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:16.474084 8601 raft_consensus.cc:697] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [term 1 LEADER]: Becoming Leader. State: Replica: f1e9b4ee86f54b98a67a3a689ff46d86, State: Running, Role: LEADER
I20260207 20:53:16.474893 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:16.475090 8601 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } }
I20260207 20:53:16.477388 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:16.477620 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:16.477880 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:16.478089 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:16.479691 8639 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1e9b4ee86f54b98a67a3a689ff46d86. Latest consensus state: current_term: 1 leader_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } } }
I20260207 20:53:16.480269 8639 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:16.481791 8644 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:53:16.489032 8644 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:53:16.498903 8493 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 1 FOLLOWER]: Refusing update from remote peer f1e9b4ee86f54b98a67a3a689ff46d86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:16.499614 8428 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 1 FOLLOWER]: Refusing update from remote peer f1e9b4ee86f54b98a67a3a689ff46d86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:16.500243 8639 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:16.501201 8601 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:16.510497 8588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1e9b4ee86f54b98a67a3a689ff46d86. Latest consensus state: current_term: 1 leader_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } } }
I20260207 20:53:16.511303 8588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:16.513165 8614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1e9b4ee86f54b98a67a3a689ff46d86. Latest consensus state: current_term: 1 leader_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } } }
I20260207 20:53:16.514004 8614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:16.523553 8639 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } } }
I20260207 20:53:16.524403 8639 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:16.525099 8639 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } } }
I20260207 20:53:16.525833 8639 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:16.527581 8614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } } }
I20260207 20:53:16.528260 8614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:16.528469 8644 catalog_manager.cc:1357] Generated new cluster ID: ab15b7cfb2864c6da8b343ec33da87e3
I20260207 20:53:16.528857 8644 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:53:16.531441 8588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } } }
I20260207 20:53:16.532250 8588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:16.554369 8644 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:53:16.556248 8644 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:53:16.566504 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:33113
I20260207 20:53:16.566655 8707 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:33113 every 8 connection(s)
I20260207 20:53:16.582381 8644 catalog_manager.cc:6027] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86: Generated new TSK 0
I20260207 20:53:16.583667 8644 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:53:16.598659 8708 heartbeater.cc:344] Connected to a master server at 127.2.223.60:33479
I20260207 20:53:16.599141 8708 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:16.600106 8708 heartbeater.cc:507] Master 127.2.223.60:33479 requested a full tablet report, sending...
I20260207 20:53:16.601480 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:16.602387 8548 ts_manager.cc:194] Registered new tserver with Master: 50d548d9eabe495d8e3b1a3f95876da6 (127.2.223.1:33113)
I20260207 20:53:16.604573 8709 heartbeater.cc:344] Connected to a master server at 127.2.223.61:39235
I20260207 20:53:16.604702 8548 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60764
I20260207 20:53:16.605039 8709 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:16.605875 8709 heartbeater.cc:507] Master 127.2.223.61:39235 requested a full tablet report, sending...
I20260207 20:53:16.608677 8483 ts_manager.cc:194] Registered new tserver with Master: 50d548d9eabe495d8e3b1a3f95876da6 (127.2.223.1:33113)
W20260207 20:53:16.609442 8715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:16.613317 8711 heartbeater.cc:344] Connected to a master server at 127.2.223.62:36353
I20260207 20:53:16.613731 8711 heartbeater.cc:461] Registering TS with master...
W20260207 20:53:16.613870 8716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:16.614403 8718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:16.614434 8711 heartbeater.cc:507] Master 127.2.223.62:36353 requested a full tablet report, sending...
I20260207 20:53:16.616147 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:16.616987 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260207 20:53:16.617093 8418 ts_manager.cc:194] Registered new tserver with Master: 50d548d9eabe495d8e3b1a3f95876da6 (127.2.223.1:33113)
W20260207 20:53:16.617216 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:16.617463 8708 heartbeater.cc:499] Master 127.2.223.60:33479 was elected leader, sending a full tablet report...
I20260207 20:53:16.617559 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497596617538 us; error 0 us; skew 500 ppm
I20260207 20:53:16.618469 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:16.621371 2940 webserver.cc:492] Webserver started at http://127.2.223.2:35239/ using document root <none> and password file <none>
I20260207 20:53:16.621870 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:16.622051 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:16.622288 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:16.623432 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "e3f430e06c144faaacf94707c7d79c8c"
format_stamp: "Formatted at 2026-02-07 20:53:16 on dist-test-slave-kqw4"
I20260207 20:53:16.627434 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260207 20:53:16.630905 8723 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:16.631686 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260207 20:53:16.632025 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "e3f430e06c144faaacf94707c7d79c8c"
format_stamp: "Formatted at 2026-02-07 20:53:16 on dist-test-slave-kqw4"
I20260207 20:53:16.632309 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:16.656165 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:16.657445 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:16.658972 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:16.661919 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:16.662102 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:16.662281 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:16.662402 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:16.704541 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:32801
I20260207 20:53:16.704667 8785 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:32801 every 8 connection(s)
I20260207 20:53:16.724419 8786 heartbeater.cc:344] Connected to a master server at 127.2.223.60:33479
I20260207 20:53:16.725011 8786 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:16.731887 8786 heartbeater.cc:507] Master 127.2.223.60:33479 requested a full tablet report, sending...
I20260207 20:53:16.737363 8548 ts_manager.cc:194] Registered new tserver with Master: e3f430e06c144faaacf94707c7d79c8c (127.2.223.2:32801)
I20260207 20:53:16.739095 8548 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60778
I20260207 20:53:16.740792 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:16.743808 8789 heartbeater.cc:344] Connected to a master server at 127.2.223.62:36353
I20260207 20:53:16.744161 8789 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:16.744788 8789 heartbeater.cc:507] Master 127.2.223.62:36353 requested a full tablet report, sending...
I20260207 20:53:16.745795 8787 heartbeater.cc:344] Connected to a master server at 127.2.223.61:39235
I20260207 20:53:16.746276 8787 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:16.746924 8787 heartbeater.cc:507] Master 127.2.223.61:39235 requested a full tablet report, sending...
I20260207 20:53:16.747332 8418 ts_manager.cc:194] Registered new tserver with Master: e3f430e06c144faaacf94707c7d79c8c (127.2.223.2:32801)
I20260207 20:53:16.749500 8483 ts_manager.cc:194] Registered new tserver with Master: e3f430e06c144faaacf94707c7d79c8c (127.2.223.2:32801)
W20260207 20:53:16.750303 8793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:16.751009 8794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:16.752243 8786 heartbeater.cc:499] Master 127.2.223.60:33479 was elected leader, sending a full tablet report...
I20260207 20:53:16.753364 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:16.754887 8797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:16.756428 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:16.756662 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:16.756842 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497596756825 us; error 0 us; skew 500 ppm
I20260207 20:53:16.757325 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:16.760203 2940 webserver.cc:492] Webserver started at http://127.2.223.3:36871/ using document root <none> and password file <none>
I20260207 20:53:16.760764 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:16.760999 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:16.761289 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:16.762574 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "ff96b33659fd40648a3a6fee853f27d4"
format_stamp: "Formatted at 2026-02-07 20:53:16 on dist-test-slave-kqw4"
I20260207 20:53:16.766916 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260207 20:53:16.770993 8801 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:16.771682 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260207 20:53:16.771939 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "ff96b33659fd40648a3a6fee853f27d4"
format_stamp: "Formatted at 2026-02-07 20:53:16 on dist-test-slave-kqw4"
I20260207 20:53:16.772162 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:16.794279 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:16.795719 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:16.796854 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:16.799160 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:16.799405 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:16.799698 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:16.799894 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:16.863255 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:36499
I20260207 20:53:16.863387 8863 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:36499 every 8 connection(s)
I20260207 20:53:16.902581 8864 heartbeater.cc:344] Connected to a master server at 127.2.223.60:33479
I20260207 20:53:16.903012 8864 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:16.903867 8864 heartbeater.cc:507] Master 127.2.223.60:33479 requested a full tablet report, sending...
I20260207 20:53:16.906157 8548 ts_manager.cc:194] Registered new tserver with Master: ff96b33659fd40648a3a6fee853f27d4 (127.2.223.3:36499)
I20260207 20:53:16.907938 8548 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60780
I20260207 20:53:16.920704 8864 heartbeater.cc:499] Master 127.2.223.60:33479 was elected leader, sending a full tablet report...
I20260207 20:53:16.922827 8866 heartbeater.cc:344] Connected to a master server at 127.2.223.62:36353
I20260207 20:53:16.923031 8865 heartbeater.cc:344] Connected to a master server at 127.2.223.61:39235
I20260207 20:53:16.923283 8866 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:16.923468 8865 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:16.923974 8866 heartbeater.cc:507] Master 127.2.223.62:36353 requested a full tablet report, sending...
I20260207 20:53:16.924126 8865 heartbeater.cc:507] Master 127.2.223.61:39235 requested a full tablet report, sending...
I20260207 20:53:16.928114 8417 ts_manager.cc:194] Registered new tserver with Master: ff96b33659fd40648a3a6fee853f27d4 (127.2.223.3:36499)
I20260207 20:53:16.928167 8483 ts_manager.cc:194] Registered new tserver with Master: ff96b33659fd40648a3a6fee853f27d4 (127.2.223.3:36499)
I20260207 20:53:16.929204 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.008396815s
I20260207 20:53:16.971722 8547 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60796:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:53:16.980146 8547 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:53:17.106539 8665 tablet_service.cc:1505] Processing CreateTablet for tablet a55c933171f24dac875391cd625f6cd4 (DEFAULT_TABLE table=ksck-test-table [id=6fd4e8d7a914445e836ff156c9840d1a]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:17.106873 8666 tablet_service.cc:1505] Processing CreateTablet for tablet 39c1bda90f3548c08d365e8a0dc28776 (DEFAULT_TABLE table=ksck-test-table [id=6fd4e8d7a914445e836ff156c9840d1a]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:17.107987 8665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55c933171f24dac875391cd625f6cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:17.108803 8664 tablet_service.cc:1505] Processing CreateTablet for tablet 48e4b049bcf645e1b544a068bfcac556 (DEFAULT_TABLE table=ksck-test-table [id=6fd4e8d7a914445e836ff156c9840d1a]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:17.110018 8664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e4b049bcf645e1b544a068bfcac556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:17.111637 8666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c1bda90f3548c08d365e8a0dc28776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:17.124673 8828 tablet_service.cc:1505] Processing CreateTablet for tablet a55c933171f24dac875391cd625f6cd4 (DEFAULT_TABLE table=ksck-test-table [id=6fd4e8d7a914445e836ff156c9840d1a]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:17.125013 8829 tablet_service.cc:1505] Processing CreateTablet for tablet 39c1bda90f3548c08d365e8a0dc28776 (DEFAULT_TABLE table=ksck-test-table [id=6fd4e8d7a914445e836ff156c9840d1a]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:17.126015 8828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55c933171f24dac875391cd625f6cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:17.126878 8827 tablet_service.cc:1505] Processing CreateTablet for tablet 48e4b049bcf645e1b544a068bfcac556 (DEFAULT_TABLE table=ksck-test-table [id=6fd4e8d7a914445e836ff156c9840d1a]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:17.128082 8827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e4b049bcf645e1b544a068bfcac556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:17.129082 8829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c1bda90f3548c08d365e8a0dc28776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:17.145895 8750 tablet_service.cc:1505] Processing CreateTablet for tablet a55c933171f24dac875391cd625f6cd4 (DEFAULT_TABLE table=ksck-test-table [id=6fd4e8d7a914445e836ff156c9840d1a]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:17.147267 8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55c933171f24dac875391cd625f6cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:17.150998 8749 tablet_service.cc:1505] Processing CreateTablet for tablet 48e4b049bcf645e1b544a068bfcac556 (DEFAULT_TABLE table=ksck-test-table [id=6fd4e8d7a914445e836ff156c9840d1a]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:17.152231 8749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e4b049bcf645e1b544a068bfcac556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:17.154470 8751 tablet_service.cc:1505] Processing CreateTablet for tablet 39c1bda90f3548c08d365e8a0dc28776 (DEFAULT_TABLE table=ksck-test-table [id=6fd4e8d7a914445e836ff156c9840d1a]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:17.157768 8751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c1bda90f3548c08d365e8a0dc28776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:17.182564 8886 tablet_bootstrap.cc:492] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6: Bootstrap starting.
I20260207 20:53:17.190421 8886 tablet_bootstrap.cc:654] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:17.212157 8888 tablet_bootstrap.cc:492] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c: Bootstrap starting.
I20260207 20:53:17.213295 8886 tablet_bootstrap.cc:492] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6: No bootstrap required, opened a new log
I20260207 20:53:17.213826 8886 ts_tablet_manager.cc:1403] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6: Time spent bootstrapping tablet: real 0.031s user 0.010s sys 0.017s
I20260207 20:53:17.218037 8888 tablet_bootstrap.cc:654] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:17.221542 8885 tablet_bootstrap.cc:492] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4: Bootstrap starting.
I20260207 20:53:17.229250 8885 tablet_bootstrap.cc:654] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:17.228987 8886 raft_consensus.cc:359] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.242653 8886 raft_consensus.cc:385] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:17.243142 8886 raft_consensus.cc:740] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50d548d9eabe495d8e3b1a3f95876da6, State: Initialized, Role: FOLLOWER
I20260207 20:53:17.243829 8886 consensus_queue.cc:260] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.244539 8888 tablet_bootstrap.cc:492] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c: No bootstrap required, opened a new log
I20260207 20:53:17.245051 8888 ts_tablet_manager.cc:1403] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.008s
I20260207 20:53:17.247917 8888 raft_consensus.cc:359] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.248565 8888 raft_consensus.cc:385] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:17.248852 8888 raft_consensus.cc:740] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f430e06c144faaacf94707c7d79c8c, State: Initialized, Role: FOLLOWER
I20260207 20:53:17.249573 8888 consensus_queue.cc:260] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.250113 8886 ts_tablet_manager.cc:1434] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6: Time spent starting tablet: real 0.034s user 0.007s sys 0.000s
I20260207 20:53:17.252331 8885 tablet_bootstrap.cc:492] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4: No bootstrap required, opened a new log
I20260207 20:53:17.252777 8885 ts_tablet_manager.cc:1403] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4: Time spent bootstrapping tablet: real 0.031s user 0.013s sys 0.000s
I20260207 20:53:17.255048 8885 raft_consensus.cc:359] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.255633 8885 raft_consensus.cc:385] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:17.255903 8885 raft_consensus.cc:740] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff96b33659fd40648a3a6fee853f27d4, State: Initialized, Role: FOLLOWER
I20260207 20:53:17.256605 8885 consensus_queue.cc:260] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.268851 8886 tablet_bootstrap.cc:492] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6: Bootstrap starting.
I20260207 20:53:17.270881 8885 ts_tablet_manager.cc:1434] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4: Time spent starting tablet: real 0.018s user 0.002s sys 0.010s
I20260207 20:53:17.273308 8885 tablet_bootstrap.cc:492] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4: Bootstrap starting.
I20260207 20:53:17.285161 8888 ts_tablet_manager.cc:1434] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c: Time spent starting tablet: real 0.040s user 0.005s sys 0.009s
I20260207 20:53:17.286201 8888 tablet_bootstrap.cc:492] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c: Bootstrap starting.
I20260207 20:53:17.291958 8885 tablet_bootstrap.cc:654] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:17.294852 8888 tablet_bootstrap.cc:654] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:17.297914 8886 tablet_bootstrap.cc:654] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:17.299044 8885 tablet_bootstrap.cc:492] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4: No bootstrap required, opened a new log
I20260207 20:53:17.299551 8885 ts_tablet_manager.cc:1403] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.000s
I20260207 20:53:17.303475 8888 tablet_bootstrap.cc:492] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c: No bootstrap required, opened a new log
I20260207 20:53:17.303968 8888 ts_tablet_manager.cc:1403] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.005s
I20260207 20:53:17.306444 8885 raft_consensus.cc:359] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.307271 8885 raft_consensus.cc:385] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:17.307564 8885 raft_consensus.cc:740] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff96b33659fd40648a3a6fee853f27d4, State: Initialized, Role: FOLLOWER
I20260207 20:53:17.308295 8885 consensus_queue.cc:260] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.310106 8888 raft_consensus.cc:359] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.310802 8888 raft_consensus.cc:385] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:17.311619 8886 tablet_bootstrap.cc:492] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6: No bootstrap required, opened a new log
I20260207 20:53:17.312103 8886 ts_tablet_manager.cc:1403] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.013s
I20260207 20:53:17.314661 8886 raft_consensus.cc:359] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.315320 8886 raft_consensus.cc:385] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:17.315630 8886 raft_consensus.cc:740] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50d548d9eabe495d8e3b1a3f95876da6, State: Initialized, Role: FOLLOWER
I20260207 20:53:17.316488 8885 ts_tablet_manager.cc:1434] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260207 20:53:17.316253 8886 consensus_queue.cc:260] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.317571 8885 tablet_bootstrap.cc:492] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4: Bootstrap starting.
I20260207 20:53:17.318535 8886 ts_tablet_manager.cc:1434] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260207 20:53:17.319643 8886 tablet_bootstrap.cc:492] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6: Bootstrap starting.
I20260207 20:53:17.323725 8885 tablet_bootstrap.cc:654] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:17.325220 8886 tablet_bootstrap.cc:654] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:17.311072 8888 raft_consensus.cc:740] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f430e06c144faaacf94707c7d79c8c, State: Initialized, Role: FOLLOWER
I20260207 20:53:17.326857 8888 consensus_queue.cc:260] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.329475 8888 ts_tablet_manager.cc:1434] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c: Time spent starting tablet: real 0.025s user 0.005s sys 0.001s
I20260207 20:53:17.333636 8888 tablet_bootstrap.cc:492] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c: Bootstrap starting.
I20260207 20:53:17.335650 8886 tablet_bootstrap.cc:492] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6: No bootstrap required, opened a new log
I20260207 20:53:17.339936 8886 ts_tablet_manager.cc:1403] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.005s
I20260207 20:53:17.342749 8886 raft_consensus.cc:359] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.343427 8886 raft_consensus.cc:385] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:17.343732 8886 raft_consensus.cc:740] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50d548d9eabe495d8e3b1a3f95876da6, State: Initialized, Role: FOLLOWER
I20260207 20:53:17.345187 8886 consensus_queue.cc:260] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.347560 8888 tablet_bootstrap.cc:654] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:17.347827 8886 ts_tablet_manager.cc:1434] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20260207 20:53:17.352062 8892 raft_consensus.cc:493] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:17.352568 8892 raft_consensus.cc:515] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.354897 8892 leader_election.cc:290] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50d548d9eabe495d8e3b1a3f95876da6 (127.2.223.1:33113), ff96b33659fd40648a3a6fee853f27d4 (127.2.223.3:36499)
I20260207 20:53:17.361033 8600 catalog_manager.cc:1269] Loaded cluster ID: ab15b7cfb2864c6da8b343ec33da87e3
I20260207 20:53:17.361331 8600 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c: loading cluster ID for follower catalog manager: success
I20260207 20:53:17.362808 8885 tablet_bootstrap.cc:492] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4: No bootstrap required, opened a new log
I20260207 20:53:17.363324 8885 ts_tablet_manager.cc:1403] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4: Time spent bootstrapping tablet: real 0.046s user 0.010s sys 0.000s
I20260207 20:53:17.370673 8888 tablet_bootstrap.cc:492] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c: No bootstrap required, opened a new log
I20260207 20:53:17.371469 8600 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c: acquiring CA information for follower catalog manager: success
I20260207 20:53:17.373783 8888 ts_tablet_manager.cc:1403] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c: Time spent bootstrapping tablet: real 0.040s user 0.010s sys 0.001s
I20260207 20:53:17.377358 8888 raft_consensus.cc:359] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.378126 8888 raft_consensus.cc:385] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:17.366159 8885 raft_consensus.cc:359] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.379163 8885 raft_consensus.cc:385] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:17.379477 8885 raft_consensus.cc:740] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff96b33659fd40648a3a6fee853f27d4, State: Initialized, Role: FOLLOWER
I20260207 20:53:17.381506 8885 consensus_queue.cc:260] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.387857 8600 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:17.392174 8885 ts_tablet_manager.cc:1434] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20260207 20:53:17.378414 8888 raft_consensus.cc:740] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f430e06c144faaacf94707c7d79c8c, State: Initialized, Role: FOLLOWER
I20260207 20:53:17.401775 8888 consensus_queue.cc:260] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.413609 8888 ts_tablet_manager.cc:1434] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c: Time spent starting tablet: real 0.039s user 0.007s sys 0.000s
I20260207 20:53:17.418946 8893 raft_consensus.cc:493] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:17.419545 8893 raft_consensus.cc:515] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.428118 8893 leader_election.cc:290] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50d548d9eabe495d8e3b1a3f95876da6 (127.2.223.1:33113), e3f430e06c144faaacf94707c7d79c8c (127.2.223.2:32801)
I20260207 20:53:17.429574 8625 catalog_manager.cc:1269] Loaded cluster ID: ab15b7cfb2864c6da8b343ec33da87e3
I20260207 20:53:17.429924 8625 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df: loading cluster ID for follower catalog manager: success
I20260207 20:53:17.449918 8625 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df: acquiring CA information for follower catalog manager: success
I20260207 20:53:17.460336 8892 raft_consensus.cc:493] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:17.460888 8892 raft_consensus.cc:515] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.464702 8892 leader_election.cc:290] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50d548d9eabe495d8e3b1a3f95876da6 (127.2.223.1:33113), ff96b33659fd40648a3a6fee853f27d4 (127.2.223.3:36499)
I20260207 20:53:17.465627 8839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39c1bda90f3548c08d365e8a0dc28776" candidate_uuid: "e3f430e06c144faaacf94707c7d79c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff96b33659fd40648a3a6fee853f27d4" is_pre_election: true
I20260207 20:53:17.466149 8838 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "48e4b049bcf645e1b544a068bfcac556" candidate_uuid: "e3f430e06c144faaacf94707c7d79c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff96b33659fd40648a3a6fee853f27d4" is_pre_election: true
I20260207 20:53:17.466488 8839 raft_consensus.cc:2468] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f430e06c144faaacf94707c7d79c8c in term 0.
I20260207 20:53:17.466908 8838 raft_consensus.cc:2468] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f430e06c144faaacf94707c7d79c8c in term 0.
I20260207 20:53:17.468410 8727 leader_election.cc:304] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3f430e06c144faaacf94707c7d79c8c, ff96b33659fd40648a3a6fee853f27d4; no voters:
I20260207 20:53:17.469340 8727 leader_election.cc:304] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3f430e06c144faaacf94707c7d79c8c, ff96b33659fd40648a3a6fee853f27d4; no voters:
I20260207 20:53:17.470391 8625 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:17.470779 8682 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "48e4b049bcf645e1b544a068bfcac556" candidate_uuid: "e3f430e06c144faaacf94707c7d79c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50d548d9eabe495d8e3b1a3f95876da6" is_pre_election: true
I20260207 20:53:17.471411 8682 raft_consensus.cc:2468] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f430e06c144faaacf94707c7d79c8c in term 0.
I20260207 20:53:17.471603 8893 raft_consensus.cc:493] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:17.470428 8683 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39c1bda90f3548c08d365e8a0dc28776" candidate_uuid: "e3f430e06c144faaacf94707c7d79c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50d548d9eabe495d8e3b1a3f95876da6" is_pre_election: true
I20260207 20:53:17.472162 8893 raft_consensus.cc:515] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.473794 8683 raft_consensus.cc:2468] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f430e06c144faaacf94707c7d79c8c in term 0.
I20260207 20:53:17.472801 8892 raft_consensus.cc:2804] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:17.474478 8892 raft_consensus.cc:493] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:17.474900 8892 raft_consensus.cc:3060] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:17.475250 8893 leader_election.cc:290] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50d548d9eabe495d8e3b1a3f95876da6 (127.2.223.1:33113), e3f430e06c144faaacf94707c7d79c8c (127.2.223.2:32801)
I20260207 20:53:17.483793 8683 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39c1bda90f3548c08d365e8a0dc28776" candidate_uuid: "ff96b33659fd40648a3a6fee853f27d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50d548d9eabe495d8e3b1a3f95876da6" is_pre_election: true
I20260207 20:53:17.484433 8683 raft_consensus.cc:2468] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff96b33659fd40648a3a6fee853f27d4 in term 0.
I20260207 20:53:17.485653 8683 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a55c933171f24dac875391cd625f6cd4" candidate_uuid: "ff96b33659fd40648a3a6fee853f27d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50d548d9eabe495d8e3b1a3f95876da6" is_pre_election: true
I20260207 20:53:17.486227 8683 raft_consensus.cc:2468] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff96b33659fd40648a3a6fee853f27d4 in term 0.
I20260207 20:53:17.487079 8803 leader_election.cc:304] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50d548d9eabe495d8e3b1a3f95876da6, ff96b33659fd40648a3a6fee853f27d4; no voters:
I20260207 20:53:17.488874 8893 raft_consensus.cc:2804] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:17.489207 8893 raft_consensus.cc:493] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:17.489553 8893 raft_consensus.cc:3060] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:17.493044 8905 raft_consensus.cc:2804] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:17.493448 8905 raft_consensus.cc:493] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:17.493755 8905 raft_consensus.cc:3060] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:17.495002 8803 leader_election.cc:304] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50d548d9eabe495d8e3b1a3f95876da6, ff96b33659fd40648a3a6fee853f27d4; no voters:
I20260207 20:53:17.496348 8893 raft_consensus.cc:515] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.498327 8893 leader_election.cc:290] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [CANDIDATE]: Term 1 election: Requested vote from peers 50d548d9eabe495d8e3b1a3f95876da6 (127.2.223.1:33113), e3f430e06c144faaacf94707c7d79c8c (127.2.223.2:32801)
I20260207 20:53:17.498888 8893 raft_consensus.cc:2804] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:17.499230 8893 raft_consensus.cc:493] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:17.499564 8893 raft_consensus.cc:3060] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:17.501670 8892 raft_consensus.cc:515] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.508028 8683 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39c1bda90f3548c08d365e8a0dc28776" candidate_uuid: "ff96b33659fd40648a3a6fee853f27d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50d548d9eabe495d8e3b1a3f95876da6"
I20260207 20:53:17.508626 8683 raft_consensus.cc:3060] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:17.515044 8838 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39c1bda90f3548c08d365e8a0dc28776" candidate_uuid: "e3f430e06c144faaacf94707c7d79c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff96b33659fd40648a3a6fee853f27d4"
I20260207 20:53:17.515837 8838 raft_consensus.cc:2393] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e3f430e06c144faaacf94707c7d79c8c in current term 1: Already voted for candidate ff96b33659fd40648a3a6fee853f27d4 in this term.
I20260207 20:53:17.517894 8683 raft_consensus.cc:2468] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff96b33659fd40648a3a6fee853f27d4 in term 1.
I20260207 20:53:17.519404 8682 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39c1bda90f3548c08d365e8a0dc28776" candidate_uuid: "e3f430e06c144faaacf94707c7d79c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50d548d9eabe495d8e3b1a3f95876da6"
I20260207 20:53:17.520143 8682 raft_consensus.cc:2393] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e3f430e06c144faaacf94707c7d79c8c in current term 1: Already voted for candidate ff96b33659fd40648a3a6fee853f27d4 in this term.
I20260207 20:53:17.520617 8892 leader_election.cc:290] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [CANDIDATE]: Term 1 election: Requested vote from peers 50d548d9eabe495d8e3b1a3f95876da6 (127.2.223.1:33113), ff96b33659fd40648a3a6fee853f27d4 (127.2.223.3:36499)
I20260207 20:53:17.521226 8905 raft_consensus.cc:515] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.522704 8893 raft_consensus.cc:515] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.523260 8905 leader_election.cc:290] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [CANDIDATE]: Term 1 election: Requested vote from peers 50d548d9eabe495d8e3b1a3f95876da6 (127.2.223.1:33113), ff96b33659fd40648a3a6fee853f27d4 (127.2.223.3:36499)
I20260207 20:53:17.523356 8761 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39c1bda90f3548c08d365e8a0dc28776" candidate_uuid: "ff96b33659fd40648a3a6fee853f27d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f430e06c144faaacf94707c7d79c8c" is_pre_election: true
I20260207 20:53:17.524277 8761 raft_consensus.cc:2393] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff96b33659fd40648a3a6fee853f27d4 in current term 1: Already voted for candidate e3f430e06c144faaacf94707c7d79c8c in this term.
I20260207 20:53:17.523049 8725 leader_election.cc:304] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f430e06c144faaacf94707c7d79c8c; no voters: 50d548d9eabe495d8e3b1a3f95876da6, ff96b33659fd40648a3a6fee853f27d4
I20260207 20:53:17.526489 8905 raft_consensus.cc:2749] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260207 20:53:17.527983 8761 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a55c933171f24dac875391cd625f6cd4" candidate_uuid: "ff96b33659fd40648a3a6fee853f27d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f430e06c144faaacf94707c7d79c8c" is_pre_election: true
I20260207 20:53:17.528631 8761 raft_consensus.cc:2468] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff96b33659fd40648a3a6fee853f27d4 in term 0.
I20260207 20:53:17.529577 8683 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "48e4b049bcf645e1b544a068bfcac556" candidate_uuid: "e3f430e06c144faaacf94707c7d79c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50d548d9eabe495d8e3b1a3f95876da6"
I20260207 20:53:17.529901 8761 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39c1bda90f3548c08d365e8a0dc28776" candidate_uuid: "ff96b33659fd40648a3a6fee853f27d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f430e06c144faaacf94707c7d79c8c"
I20260207 20:53:17.530277 8683 raft_consensus.cc:3060] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:17.531857 8761 raft_consensus.cc:2393] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ff96b33659fd40648a3a6fee853f27d4 in current term 1: Already voted for candidate e3f430e06c144faaacf94707c7d79c8c in this term.
I20260207 20:53:17.537353 8683 raft_consensus.cc:2468] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f430e06c144faaacf94707c7d79c8c in term 1.
I20260207 20:53:17.537973 8761 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a55c933171f24dac875391cd625f6cd4" candidate_uuid: "ff96b33659fd40648a3a6fee853f27d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f430e06c144faaacf94707c7d79c8c"
I20260207 20:53:17.538532 8761 raft_consensus.cc:3060] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:17.538446 8725 leader_election.cc:304] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50d548d9eabe495d8e3b1a3f95876da6, e3f430e06c144faaacf94707c7d79c8c; no voters:
I20260207 20:53:17.538728 8838 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "48e4b049bcf645e1b544a068bfcac556" candidate_uuid: "e3f430e06c144faaacf94707c7d79c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff96b33659fd40648a3a6fee853f27d4"
I20260207 20:53:17.539381 8838 raft_consensus.cc:3060] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:17.521266 8803 leader_election.cc:304] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50d548d9eabe495d8e3b1a3f95876da6, ff96b33659fd40648a3a6fee853f27d4; no voters:
I20260207 20:53:17.542294 8905 raft_consensus.cc:2804] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:17.525030 8893 leader_election.cc:290] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [CANDIDATE]: Term 1 election: Requested vote from peers 50d548d9eabe495d8e3b1a3f95876da6 (127.2.223.1:33113), e3f430e06c144faaacf94707c7d79c8c (127.2.223.2:32801)
I20260207 20:53:17.542801 8906 raft_consensus.cc:2804] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:17.546345 8906 raft_consensus.cc:697] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 1 LEADER]: Becoming Leader. State: Replica: ff96b33659fd40648a3a6fee853f27d4, State: Running, Role: LEADER
I20260207 20:53:17.547288 8906 consensus_queue.cc:237] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.550382 8905 raft_consensus.cc:697] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [term 1 LEADER]: Becoming Leader. State: Replica: e3f430e06c144faaacf94707c7d79c8c, State: Running, Role: LEADER
I20260207 20:53:17.551353 8905 consensus_queue.cc:237] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.551909 8683 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a55c933171f24dac875391cd625f6cd4" candidate_uuid: "ff96b33659fd40648a3a6fee853f27d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50d548d9eabe495d8e3b1a3f95876da6"
I20260207 20:53:17.553580 8838 raft_consensus.cc:2468] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f430e06c144faaacf94707c7d79c8c in term 1.
I20260207 20:53:17.553498 8683 raft_consensus.cc:3060] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:17.564893 8761 raft_consensus.cc:2468] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff96b33659fd40648a3a6fee853f27d4 in term 1.
I20260207 20:53:17.566009 8804 leader_election.cc:304] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3f430e06c144faaacf94707c7d79c8c, ff96b33659fd40648a3a6fee853f27d4; no voters:
I20260207 20:53:17.566881 8893 raft_consensus.cc:2804] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:17.568624 8683 raft_consensus.cc:2468] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff96b33659fd40648a3a6fee853f27d4 in term 1.
I20260207 20:53:17.581847 8893 raft_consensus.cc:697] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [term 1 LEADER]: Becoming Leader. State: Replica: ff96b33659fd40648a3a6fee853f27d4, State: Running, Role: LEADER
I20260207 20:53:17.583207 8893 consensus_queue.cc:237] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } }
I20260207 20:53:17.582764 8546 catalog_manager.cc:5654] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f430e06c144faaacf94707c7d79c8c (127.2.223.2). New cstate: current_term: 1 leader_uuid: "e3f430e06c144faaacf94707c7d79c8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260207 20:53:17.592901 8548 catalog_manager.cc:5654] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff96b33659fd40648a3a6fee853f27d4 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "ff96b33659fd40648a3a6fee853f27d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:17.634681 8546 catalog_manager.cc:5654] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff96b33659fd40648a3a6fee853f27d4 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "ff96b33659fd40648a3a6fee853f27d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:17.977322 8893 consensus_queue.cc:1048] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:17.994882 8893 consensus_queue.cc:1048] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:18.006245 8893 consensus_queue.cc:1048] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:18.082259 8893 consensus_queue.cc:1048] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f430e06c144faaacf94707c7d79c8c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 32801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:18.084616 8905 consensus_queue.cc:1048] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "50d548d9eabe495d8e3b1a3f95876da6" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:18.112493 8905 consensus_queue.cc:1048] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff96b33659fd40648a3a6fee853f27d4" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:18.420450 2940 master.cc:561] Master@127.2.223.60:33479 shutting down...
I20260207 20:53:18.470256 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:18.471124 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:18.471505 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P f1e9b4ee86f54b98a67a3a689ff46d86: stopping tablet replica
I20260207 20:53:18.496508 2940 master.cc:583] Master@127.2.223.60:33479 shutdown complete.
I20260207 20:53:19.601444 8974 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1e9b4ee86f54b98a67a3a689ff46d86)
I20260207 20:53:19.602388 8974 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } }
I20260207 20:53:19.604452 8974 leader_election.cc:290] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 540c438f6152485a8c49fdc1a034ad1c (127.2.223.61:39235), f1e9b4ee86f54b98a67a3a689ff46d86 (127.2.223.60:33479)
I20260207 20:53:19.605654 8493 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "540c438f6152485a8c49fdc1a034ad1c" is_pre_election: true
W20260207 20:53:19.616081 8402 leader_election.cc:336] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f1e9b4ee86f54b98a67a3a689ff46d86 (127.2.223.60:33479): Network error: Client connection negotiation failed: client connection to 127.2.223.60:33479: connect: Connection refused (error 111)
I20260207 20:53:19.616632 8402 leader_election.cc:304] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f24dc3ff6d842c9983dfe3fac3bd4df; no voters: 540c438f6152485a8c49fdc1a034ad1c, f1e9b4ee86f54b98a67a3a689ff46d86
I20260207 20:53:19.617316 8974 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260207 20:53:19.647115 8977 raft_consensus.cc:493] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1e9b4ee86f54b98a67a3a689ff46d86)
I20260207 20:53:19.647575 8977 raft_consensus.cc:515] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } }
I20260207 20:53:19.649642 8977 leader_election.cc:290] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f24dc3ff6d842c9983dfe3fac3bd4df (127.2.223.62:36353), f1e9b4ee86f54b98a67a3a689ff46d86 (127.2.223.60:33479)
I20260207 20:53:19.650701 8428 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "540c438f6152485a8c49fdc1a034ad1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" is_pre_election: true
I20260207 20:53:19.651510 8428 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 540c438f6152485a8c49fdc1a034ad1c in term 1.
I20260207 20:53:19.657013 8469 leader_election.cc:304] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 540c438f6152485a8c49fdc1a034ad1c, 9f24dc3ff6d842c9983dfe3fac3bd4df; no voters:
I20260207 20:53:19.658051 8977 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260207 20:53:19.658454 8977 raft_consensus.cc:493] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1e9b4ee86f54b98a67a3a689ff46d86)
I20260207 20:53:19.658833 8977 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 1 FOLLOWER]: Advancing to term 2
W20260207 20:53:19.664405 8466 leader_election.cc:336] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f1e9b4ee86f54b98a67a3a689ff46d86 (127.2.223.60:33479): Network error: Client connection negotiation failed: client connection to 127.2.223.60:33479: connect: Connection refused (error 111)
I20260207 20:53:19.667127 8977 raft_consensus.cc:515] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } }
I20260207 20:53:19.672988 8977 leader_election.cc:290] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [CANDIDATE]: Term 2 election: Requested vote from peers 9f24dc3ff6d842c9983dfe3fac3bd4df (127.2.223.62:36353), f1e9b4ee86f54b98a67a3a689ff46d86 (127.2.223.60:33479)
I20260207 20:53:19.673749 8428 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "540c438f6152485a8c49fdc1a034ad1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df"
I20260207 20:53:19.674451 8428 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 1 FOLLOWER]: Advancing to term 2
W20260207 20:53:19.681543 8466 leader_election.cc:336] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f1e9b4ee86f54b98a67a3a689ff46d86 (127.2.223.60:33479): Network error: Client connection negotiation failed: client connection to 127.2.223.60:33479: connect: Connection refused (error 111)
I20260207 20:53:19.681807 8428 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 540c438f6152485a8c49fdc1a034ad1c in term 2.
I20260207 20:53:19.682895 8469 leader_election.cc:304] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 540c438f6152485a8c49fdc1a034ad1c, 9f24dc3ff6d842c9983dfe3fac3bd4df; no voters: f1e9b4ee86f54b98a67a3a689ff46d86
I20260207 20:53:19.685106 8977 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 2 FOLLOWER]: Leader election won for term 2
I20260207 20:53:19.686355 8977 raft_consensus.cc:697] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 2 LEADER]: Becoming Leader. State: Replica: 540c438f6152485a8c49fdc1a034ad1c, State: Running, Role: LEADER
I20260207 20:53:19.687249 8977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } }
I20260207 20:53:19.695441 8980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 540c438f6152485a8c49fdc1a034ad1c. Latest consensus state: current_term: 2 leader_uuid: "540c438f6152485a8c49fdc1a034ad1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } } }
I20260207 20:53:19.700773 8980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:19.702734 8982 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:53:19.711148 8982 catalog_manager.cc:679] Loaded metadata for table ksck-test-table [id=6fd4e8d7a914445e836ff156c9840d1a]
I20260207 20:53:19.720466 8982 tablet_loader.cc:96] loaded metadata for tablet 39c1bda90f3548c08d365e8a0dc28776 (table ksck-test-table [id=6fd4e8d7a914445e836ff156c9840d1a])
I20260207 20:53:19.722105 8982 tablet_loader.cc:96] loaded metadata for tablet 48e4b049bcf645e1b544a068bfcac556 (table ksck-test-table [id=6fd4e8d7a914445e836ff156c9840d1a])
I20260207 20:53:19.723469 8982 tablet_loader.cc:96] loaded metadata for tablet a55c933171f24dac875391cd625f6cd4 (table ksck-test-table [id=6fd4e8d7a914445e836ff156c9840d1a])
I20260207 20:53:19.724844 8982 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:53:19.731316 8982 catalog_manager.cc:1269] Loaded cluster ID: ab15b7cfb2864c6da8b343ec33da87e3
I20260207 20:53:19.731690 8982 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:53:19.736420 8982 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:53:19.739766 8982 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c: Loaded TSK: 0
I20260207 20:53:19.740567 8982 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:53:19.760116 8709 heartbeater.cc:499] Master 127.2.223.61:39235 was elected leader, sending a full tablet report...
I20260207 20:53:19.760558 8787 heartbeater.cc:499] Master 127.2.223.61:39235 was elected leader, sending a full tablet report...
I20260207 20:53:19.762372 8865 heartbeater.cc:499] Master 127.2.223.61:39235 was elected leader, sending a full tablet report...
I20260207 20:53:19.894273 8829 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260207 20:53:19.896478 8749 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:53:19.899570 8666 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:53:20.159123 8428 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 2 FOLLOWER]: Refusing update from remote peer 540c438f6152485a8c49fdc1a034ad1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260207 20:53:20.162040 8980 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260207 20:53:20.185485 8994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 540c438f6152485a8c49fdc1a034ad1c. Latest consensus state: current_term: 2 leader_uuid: "540c438f6152485a8c49fdc1a034ad1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } } }
I20260207 20:53:20.186282 8994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:20.206362 8994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "540c438f6152485a8c49fdc1a034ad1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } } }
I20260207 20:53:20.207422 8994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:20.228047 8977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "540c438f6152485a8c49fdc1a034ad1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f24dc3ff6d842c9983dfe3fac3bd4df" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 36353 } } peers { permanent_uuid: "540c438f6152485a8c49fdc1a034ad1c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 39235 } } peers { permanent_uuid: "f1e9b4ee86f54b98a67a3a689ff46d86" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33479 } } }
I20260207 20:53:20.228796 8977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [sys.catalog]: This master's current role is: LEADER
W20260207 20:53:20.248509 8466 consensus_peers.cc:597] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c -> Peer f1e9b4ee86f54b98a67a3a689ff46d86 (127.2.223.60:33479): Couldn't send request to peer f1e9b4ee86f54b98a67a3a689ff46d86. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.60:33479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:20.333884 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:53:20.392850 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:20.393537 2940 tablet_replica.cc:333] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6: stopping tablet replica
I20260207 20:53:20.394266 2940 raft_consensus.cc:2243] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:20.394878 2940 raft_consensus.cc:2272] T 39c1bda90f3548c08d365e8a0dc28776 P 50d548d9eabe495d8e3b1a3f95876da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:20.396956 2940 tablet_replica.cc:333] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6: stopping tablet replica
I20260207 20:53:20.397419 2940 raft_consensus.cc:2243] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:20.397815 2940 raft_consensus.cc:2272] T 48e4b049bcf645e1b544a068bfcac556 P 50d548d9eabe495d8e3b1a3f95876da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:20.400426 2940 tablet_replica.cc:333] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6: stopping tablet replica
I20260207 20:53:20.401032 2940 raft_consensus.cc:2243] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:20.401605 2940 raft_consensus.cc:2272] T a55c933171f24dac875391cd625f6cd4 P 50d548d9eabe495d8e3b1a3f95876da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:20.424480 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:53:20.442437 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
W20260207 20:53:20.456650 8803 consensus_peers.cc:597] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 -> Peer 50d548d9eabe495d8e3b1a3f95876da6 (127.2.223.1:33113): Couldn't send request to peer 50d548d9eabe495d8e3b1a3f95876da6. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:33113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260207 20:53:20.484222 8804 consensus_peers.cc:597] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 -> Peer e3f430e06c144faaacf94707c7d79c8c (127.2.223.2:32801): Couldn't send request to peer e3f430e06c144faaacf94707c7d79c8c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:20.497469 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:20.498088 2940 tablet_replica.cc:333] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c: stopping tablet replica
I20260207 20:53:20.498697 2940 raft_consensus.cc:2243] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:20.499493 2940 raft_consensus.cc:2272] T 48e4b049bcf645e1b544a068bfcac556 P e3f430e06c144faaacf94707c7d79c8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:20.501706 2940 tablet_replica.cc:333] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c: stopping tablet replica
I20260207 20:53:20.502243 2940 raft_consensus.cc:2243] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:20.502674 2940 raft_consensus.cc:2272] T 39c1bda90f3548c08d365e8a0dc28776 P e3f430e06c144faaacf94707c7d79c8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:20.504715 2940 tablet_replica.cc:333] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c: stopping tablet replica
I20260207 20:53:20.505180 2940 raft_consensus.cc:2243] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:20.505599 2940 raft_consensus.cc:2272] T a55c933171f24dac875391cd625f6cd4 P e3f430e06c144faaacf94707c7d79c8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:20.527714 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:53:20.543383 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:53:20.572950 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:20.573689 2940 tablet_replica.cc:333] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4: stopping tablet replica
I20260207 20:53:20.574419 2940 raft_consensus.cc:2243] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:20.575309 2940 raft_consensus.cc:2272] T a55c933171f24dac875391cd625f6cd4 P ff96b33659fd40648a3a6fee853f27d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:20.577385 2940 tablet_replica.cc:333] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4: stopping tablet replica
I20260207 20:53:20.577858 2940 raft_consensus.cc:2243] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:20.578284 2940 raft_consensus.cc:2272] T 48e4b049bcf645e1b544a068bfcac556 P ff96b33659fd40648a3a6fee853f27d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:20.580233 2940 tablet_replica.cc:333] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4: stopping tablet replica
I20260207 20:53:20.580677 2940 raft_consensus.cc:2243] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:20.581435 2940 raft_consensus.cc:2272] T 39c1bda90f3548c08d365e8a0dc28776 P ff96b33659fd40648a3a6fee853f27d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:20.602355 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:53:20.617533 2940 master.cc:561] Master@127.2.223.62:36353 shutting down...
I20260207 20:53:20.639789 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:20.640306 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:20.640584 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9f24dc3ff6d842c9983dfe3fac3bd4df: stopping tablet replica
I20260207 20:53:20.660352 2940 master.cc:583] Master@127.2.223.62:36353 shutdown complete.
I20260207 20:53:20.674446 2940 master.cc:561] Master@127.2.223.61:39235 shutting down...
I20260207 20:53:20.692504 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 2 LEADER]: Raft consensus shutting down.
I20260207 20:53:20.693369 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:20.693753 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 540c438f6152485a8c49fdc1a034ad1c: stopping tablet replica
I20260207 20:53:20.713794 2940 master.cc:583] Master@127.2.223.61:39235 shutdown complete.
[ OK ] RemoteKsckTest.TestLeaderMasterDown (4719 ms)
[ RUN ] RemoteKsckTest.TestClusterWithLocation
I20260207 20:53:20.748636 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:33957,127.2.223.61:38521,127.2.223.60:46833
I20260207 20:53:20.749871 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:20.754755 9002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:20.754954 9003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:20.755887 9005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:20.757540 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:20.758311 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:20.758473 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:20.758610 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497600758573 us; error 0 us; skew 500 ppm
I20260207 20:53:20.759068 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:20.761124 2940 webserver.cc:492] Webserver started at http://127.2.223.62:32921/ using document root <none> and password file <none>
I20260207 20:53:20.761521 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:20.761668 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:20.761866 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:20.763034 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "b98234a6355f401486e90df80bf94b60"
format_stamp: "Formatted at 2026-02-07 20:53:20 on dist-test-slave-kqw4"
I20260207 20:53:20.766990 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260207 20:53:20.770004 9010 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:20.770685 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260207 20:53:20.770936 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "b98234a6355f401486e90df80bf94b60"
format_stamp: "Formatted at 2026-02-07 20:53:20 on dist-test-slave-kqw4"
I20260207 20:53:20.771180 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:20.785750 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:20.786962 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:20.822577 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:33957
I20260207 20:53:20.822692 9061 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:33957 every 8 connection(s)
I20260207 20:53:20.826237 9062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:20.826406 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:20.831272 9064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:20.832144 9065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:20.834685 9067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:20.834995 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:20.834939 9062 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:20.837402 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:20.837666 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:20.837872 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497600837854 us; error 0 us; skew 500 ppm
I20260207 20:53:20.838685 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:20.841380 2940 webserver.cc:492] Webserver started at http://127.2.223.61:46097/ using document root <none> and password file <none>
I20260207 20:53:20.841859 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:20.842017 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:20.842242 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:20.843348 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd"
format_stamp: "Formatted at 2026-02-07 20:53:20 on dist-test-slave-kqw4"
I20260207 20:53:20.847853 9062 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:20.848191 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
W20260207 20:53:20.849884 9014 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.223.61:38521: connect: Connection refused (error 111) [suppressed 14 similar messages]
I20260207 20:53:20.851761 9075 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:20.852649 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260207 20:53:20.852973 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd"
format_stamp: "Formatted at 2026-02-07 20:53:20 on dist-test-slave-kqw4"
W20260207 20:53:20.853284 9062 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:38521: Network error: Client connection negotiation failed: client connection to 127.2.223.61:38521: connect: Connection refused (error 111)
I20260207 20:53:20.853302 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:20.866467 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:20.867709 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:20.904193 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:38521
I20260207 20:53:20.904285 9126 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:38521 every 8 connection(s)
I20260207 20:53:20.907871 9127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:20.907907 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:20.913187 9129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:20.914683 9130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:20.916004 9127 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:20.915923 9062 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } attempt: 1
W20260207 20:53:20.917527 9132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:20.918692 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:20.919934 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:20.920188 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:20.920392 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497600920374 us; error 0 us; skew 500 ppm
I20260207 20:53:20.921168 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:20.924077 2940 webserver.cc:492] Webserver started at http://127.2.223.60:46041/ using document root <none> and password file <none>
I20260207 20:53:20.924576 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:20.924774 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:20.925026 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:20.926568 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "220d7f81ee2a4a208583bd4b50c52a88"
format_stamp: "Formatted at 2026-02-07 20:53:20 on dist-test-slave-kqw4"
I20260207 20:53:20.930720 9062 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:20.931123 9127 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:20.932256 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
W20260207 20:53:20.935446 9062 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:46833: Network error: Client connection negotiation failed: client connection to 127.2.223.60:46833: connect: Connection refused (error 111)
I20260207 20:53:20.936751 9139 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:20.937665 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260207 20:53:20.937996 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "220d7f81ee2a4a208583bd4b50c52a88"
format_stamp: "Formatted at 2026-02-07 20:53:20 on dist-test-slave-kqw4"
I20260207 20:53:20.938324 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:20.942688 9127 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:20.947997 9127 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:46833: Network error: Client connection negotiation failed: client connection to 127.2.223.60:46833: connect: Connection refused (error 111)
I20260207 20:53:20.954977 9062 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } attempt: 1
I20260207 20:53:20.955546 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:20.956980 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260207 20:53:20.958930 9062 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:46833: Network error: Client connection negotiation failed: client connection to 127.2.223.60:46833: connect: Connection refused (error 111)
I20260207 20:53:20.973444 9127 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } attempt: 1
W20260207 20:53:20.978283 9127 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:46833: Network error: Client connection negotiation failed: client connection to 127.2.223.60:46833: connect: Connection refused (error 111)
I20260207 20:53:20.993431 9062 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } attempt: 2
I20260207 20:53:20.996487 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:46833
I20260207 20:53:20.996577 9191 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:46833 every 8 connection(s)
I20260207 20:53:21.000500 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:53:21.001560 9193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:21.009141 9193 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:21.013136 9062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60: Bootstrap starting.
I20260207 20:53:21.017921 9062 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:21.019477 9193 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:21.022468 9062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60: No bootstrap required, opened a new log
I20260207 20:53:21.024658 9062 raft_consensus.cc:359] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:21.025170 9062 raft_consensus.cc:385] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:21.025404 9062 raft_consensus.cc:740] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98234a6355f401486e90df80bf94b60, State: Initialized, Role: FOLLOWER
I20260207 20:53:21.026010 9062 consensus_queue.cc:260] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:21.027907 9197 sys_catalog.cc:455] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:21.028465 9193 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:21.028640 9197 sys_catalog.cc:458] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:21.029457 9062 sys_catalog.cc:565] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: configured and running, proceeding with master startup.
W20260207 20:53:21.041693 9016 tablet.cc:2378] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260207 20:53:21.041796 9127 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } attempt: 2
I20260207 20:53:21.043267 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:53:21.043431 9193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: Bootstrap starting.
W20260207 20:53:21.047484 9208 catalog_manager.cc:1568] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:21.047909 9208 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:21.049469 9193 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:21.053794 9193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: No bootstrap required, opened a new log
I20260207 20:53:21.055915 9193 raft_consensus.cc:359] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:21.056429 9193 raft_consensus.cc:385] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:21.056555 9127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd: Bootstrap starting.
I20260207 20:53:21.056658 9193 raft_consensus.cc:740] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220d7f81ee2a4a208583bd4b50c52a88, State: Initialized, Role: FOLLOWER
I20260207 20:53:21.057374 9193 consensus_queue.cc:260] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:21.059144 9210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:21.059841 9210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:21.060660 9193 sys_catalog.cc:565] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:21.061416 9127 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:21.065814 9127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd: No bootstrap required, opened a new log
I20260207 20:53:21.068156 9127 raft_consensus.cc:359] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:21.068647 9127 raft_consensus.cc:385] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:21.068881 9127 raft_consensus.cc:740] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb51cf65ff54a69815b4dbdbc73c2fd, State: Initialized, Role: FOLLOWER
I20260207 20:53:21.069438 9127 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:21.071516 9219 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:21.072299 9219 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:21.073302 9127 sys_catalog.cc:565] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [sys.catalog]: configured and running, proceeding with master startup.
W20260207 20:53:21.078272 9223 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:21.078727 9223 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:21.084117 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:53:21.085435 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:21.087090 9234 catalog_manager.cc:1568] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:21.087356 9234 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:53:21.091909 9235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:21.091900 9236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:21.093649 9238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:21.094431 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:21.095253 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:21.095451 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:21.095587 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497601095570 us; error 0 us; skew 500 ppm
I20260207 20:53:21.096043 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:21.098134 2940 webserver.cc:492] Webserver started at http://127.2.223.1:40133/ using document root <none> and password file <none>
I20260207 20:53:21.098562 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:21.098773 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:21.098984 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:21.099960 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "716c92d6923f4a7d892124669c097366"
format_stamp: "Formatted at 2026-02-07 20:53:21 on dist-test-slave-kqw4"
I20260207 20:53:21.104203 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260207 20:53:21.107342 9243 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:21.108073 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:53:21.108363 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "716c92d6923f4a7d892124669c097366"
format_stamp: "Formatted at 2026-02-07 20:53:21 on dist-test-slave-kqw4"
I20260207 20:53:21.108623 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:21.128039 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:21.129227 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:21.130749 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:21.133025 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:21.133199 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:21.133417 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:21.133567 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:21.172348 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:33039
I20260207 20:53:21.172474 9305 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:33039 every 8 connection(s)
I20260207 20:53:21.178707 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:21.194079 9306 heartbeater.cc:344] Connected to a master server at 127.2.223.60:46833
I20260207 20:53:21.194571 9306 heartbeater.cc:461] Registering TS with master...
W20260207 20:53:21.195036 9313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:21.195537 9314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:21.194072 9307 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38521
I20260207 20:53:21.195578 9306 heartbeater.cc:507] Master 127.2.223.60:46833 requested a full tablet report, sending...
I20260207 20:53:21.197988 9308 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33957
I20260207 20:53:21.198417 9308 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:21.196173 9307 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:21.199393 9157 ts_manager.cc:194] Registered new tserver with Master: 716c92d6923f4a7d892124669c097366 (127.2.223.1:33039)
I20260207 20:53:21.200423 9307 heartbeater.cc:507] Master 127.2.223.61:38521 requested a full tablet report, sending...
I20260207 20:53:21.199378 9308 heartbeater.cc:507] Master 127.2.223.62:33957 requested a full tablet report, sending...
I20260207 20:53:21.203984 9092 ts_manager.cc:194] Registered new tserver with Master: 716c92d6923f4a7d892124669c097366 (127.2.223.1:33039)
I20260207 20:53:21.204638 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:21.205160 9027 ts_manager.cc:194] Registered new tserver with Master: 716c92d6923f4a7d892124669c097366 (127.2.223.1:33039)
W20260207 20:53:21.205703 9316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:21.206743 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:21.206943 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:21.207080 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497601207069 us; error 0 us; skew 500 ppm
I20260207 20:53:21.207536 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:21.209728 2940 webserver.cc:492] Webserver started at http://127.2.223.2:40421/ using document root <none> and password file <none>
I20260207 20:53:21.210180 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:21.210364 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:21.210659 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:21.211665 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "6215f47ac33642fcbd1218c2c19aeedc"
format_stamp: "Formatted at 2026-02-07 20:53:21 on dist-test-slave-kqw4"
I20260207 20:53:21.218286 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260207 20:53:21.221823 9321 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:21.222522 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:53:21.222836 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "6215f47ac33642fcbd1218c2c19aeedc"
format_stamp: "Formatted at 2026-02-07 20:53:21 on dist-test-slave-kqw4"
I20260207 20:53:21.223080 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:21.238965 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:21.240204 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:21.241725 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:21.244235 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:21.244484 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:21.244765 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:21.244964 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:21.259893 9197 raft_consensus.cc:493] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:21.260430 9197 raft_consensus.cc:515] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:21.262513 9197 leader_election.cc:290] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbb51cf65ff54a69815b4dbdbc73c2fd (127.2.223.61:38521), 220d7f81ee2a4a208583bd4b50c52a88 (127.2.223.60:46833)
I20260207 20:53:21.263202 9102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b98234a6355f401486e90df80bf94b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" is_pre_election: true
I20260207 20:53:21.263902 9102 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98234a6355f401486e90df80bf94b60 in term 0.
I20260207 20:53:21.263902 9167 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b98234a6355f401486e90df80bf94b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220d7f81ee2a4a208583bd4b50c52a88" is_pre_election: true
I20260207 20:53:21.264845 9167 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98234a6355f401486e90df80bf94b60 in term 0.
I20260207 20:53:21.265426 9014 leader_election.cc:304] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98234a6355f401486e90df80bf94b60, cbb51cf65ff54a69815b4dbdbc73c2fd; no voters:
I20260207 20:53:21.266494 9197 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:21.267068 9197 raft_consensus.cc:493] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:21.267405 9197 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:21.274706 9197 raft_consensus.cc:515] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:21.277513 9102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b98234a6355f401486e90df80bf94b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd"
I20260207 20:53:21.277526 9167 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b98234a6355f401486e90df80bf94b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220d7f81ee2a4a208583bd4b50c52a88"
I20260207 20:53:21.277997 9102 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:21.278263 9167 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:21.278683 9197 leader_election.cc:290] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [CANDIDATE]: Term 1 election: Requested vote from peers cbb51cf65ff54a69815b4dbdbc73c2fd (127.2.223.61:38521), 220d7f81ee2a4a208583bd4b50c52a88 (127.2.223.60:46833)
I20260207 20:53:21.283927 9102 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98234a6355f401486e90df80bf94b60 in term 1.
I20260207 20:53:21.284818 9014 leader_election.cc:304] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98234a6355f401486e90df80bf94b60, cbb51cf65ff54a69815b4dbdbc73c2fd; no voters:
I20260207 20:53:21.285437 9197 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:21.286949 9167 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98234a6355f401486e90df80bf94b60 in term 1.
I20260207 20:53:21.288785 9197 raft_consensus.cc:697] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 1 LEADER]: Becoming Leader. State: Replica: b98234a6355f401486e90df80bf94b60, State: Running, Role: LEADER
I20260207 20:53:21.290031 9197 consensus_queue.cc:237] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:21.295857 9355 sys_catalog.cc:455] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b98234a6355f401486e90df80bf94b60. Latest consensus state: current_term: 1 leader_uuid: "b98234a6355f401486e90df80bf94b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:21.296526 9355 sys_catalog.cc:458] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:21.298148 9361 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:53:21.306169 9361 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:53:21.317905 9167 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 1 FOLLOWER]: Refusing update from remote peer b98234a6355f401486e90df80bf94b60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:21.320323 9355 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:21.323396 9102 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 1 FOLLOWER]: Refusing update from remote peer b98234a6355f401486e90df80bf94b60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:21.325171 9355 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:21.340291 9219 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b98234a6355f401486e90df80bf94b60. Latest consensus state: current_term: 1 leader_uuid: "b98234a6355f401486e90df80bf94b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:21.341002 9219 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:21.341813 9210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b98234a6355f401486e90df80bf94b60. Latest consensus state: current_term: 1 leader_uuid: "b98234a6355f401486e90df80bf94b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:21.342481 9210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:21.344017 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:45131
I20260207 20:53:21.344233 9387 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:45131 every 8 connection(s)
I20260207 20:53:21.347910 9197 sys_catalog.cc:455] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b98234a6355f401486e90df80bf94b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:21.348635 9197 sys_catalog.cc:458] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:21.349280 9197 sys_catalog.cc:455] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b98234a6355f401486e90df80bf94b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:21.349977 9197 sys_catalog.cc:458] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:21.351339 9361 catalog_manager.cc:1357] Generated new cluster ID: 70ea4976f74b474dbe292d6ac62a0813
I20260207 20:53:21.351665 9361 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:53:21.352480 9219 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b98234a6355f401486e90df80bf94b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:21.353236 9219 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:21.364632 9210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b98234a6355f401486e90df80bf94b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:21.365489 9210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:21.392280 9361 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:53:21.393843 9361 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:53:21.414423 9396 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38521
I20260207 20:53:21.414865 9396 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:21.415796 9396 heartbeater.cc:507] Master 127.2.223.61:38521 requested a full tablet report, sending...
I20260207 20:53:21.419293 9393 heartbeater.cc:344] Connected to a master server at 127.2.223.60:46833
I20260207 20:53:21.419744 9393 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:21.420610 9393 heartbeater.cc:507] Master 127.2.223.60:46833 requested a full tablet report, sending...
I20260207 20:53:21.423429 9157 ts_manager.cc:194] Registered new tserver with Master: 6215f47ac33642fcbd1218c2c19aeedc (127.2.223.2:45131)
I20260207 20:53:21.434521 9361 catalog_manager.cc:6027] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60: Generated new TSK 0
I20260207 20:53:21.435263 9361 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:53:21.442334 9092 ts_manager.cc:194] Registered new tserver with Master: 6215f47ac33642fcbd1218c2c19aeedc (127.2.223.2:45131)
I20260207 20:53:21.446051 9027 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44432
I20260207 20:53:21.454386 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:21.459174 9308 heartbeater.cc:499] Master 127.2.223.62:33957 was elected leader, sending a full tablet report...
I20260207 20:53:21.462498 9398 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33957
I20260207 20:53:21.462947 9398 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:21.463820 9398 heartbeater.cc:507] Master 127.2.223.62:33957 requested a full tablet report, sending...
W20260207 20:53:21.464126 9402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:21.466033 9026 ts_manager.cc:194] Registered new tserver with Master: 6215f47ac33642fcbd1218c2c19aeedc (127.2.223.2:45131)
I20260207 20:53:21.468288 9026 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44448
W20260207 20:53:21.470470 9403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:21.476293 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:21.476234 9405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:21.477577 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:21.477854 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:21.478083 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497601478064 us; error 0 us; skew 500 ppm
I20260207 20:53:21.478912 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:21.481889 2940 webserver.cc:492] Webserver started at http://127.2.223.3:34611/ using document root <none> and password file <none>
I20260207 20:53:21.482501 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:21.482757 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:21.483083 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:21.484465 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "1f8e3143de004ea78f233dcb517399fc"
format_stamp: "Formatted at 2026-02-07 20:53:21 on dist-test-slave-kqw4"
I20260207 20:53:21.485100 9398 heartbeater.cc:499] Master 127.2.223.62:33957 was elected leader, sending a full tablet report...
I20260207 20:53:21.489411 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:53:21.492818 9410 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:21.493700 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:53:21.493990 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "1f8e3143de004ea78f233dcb517399fc"
format_stamp: "Formatted at 2026-02-07 20:53:21 on dist-test-slave-kqw4"
I20260207 20:53:21.494257 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:21.510362 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:21.511698 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:21.513100 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:21.517148 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:21.517355 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:21.517576 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:21.517733 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:21.580946 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:33627
I20260207 20:53:21.581049 9472 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:33627 every 8 connection(s)
I20260207 20:53:21.616036 9473 heartbeater.cc:344] Connected to a master server at 127.2.223.60:46833
I20260207 20:53:21.616493 9473 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:21.617426 9473 heartbeater.cc:507] Master 127.2.223.60:46833 requested a full tablet report, sending...
I20260207 20:53:21.620141 9157 ts_manager.cc:194] Registered new tserver with Master: 1f8e3143de004ea78f233dcb517399fc (127.2.223.3:33627)
I20260207 20:53:21.625020 9474 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38521
I20260207 20:53:21.625406 9474 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:21.626221 9474 heartbeater.cc:507] Master 127.2.223.61:38521 requested a full tablet report, sending...
I20260207 20:53:21.631052 9476 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33957
I20260207 20:53:21.631415 9476 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:21.631462 9091 ts_manager.cc:194] Registered new tserver with Master: 1f8e3143de004ea78f233dcb517399fc (127.2.223.3:33627)
I20260207 20:53:21.632256 9476 heartbeater.cc:507] Master 127.2.223.62:33957 requested a full tablet report, sending...
I20260207 20:53:21.635028 9026 ts_manager.cc:194] Registered new tserver with Master: 1f8e3143de004ea78f233dcb517399fc (127.2.223.3:33627)
I20260207 20:53:21.635918 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.027930613s
I20260207 20:53:21.636392 9026 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44460
I20260207 20:53:21.648975 9476 heartbeater.cc:499] Master 127.2.223.62:33957 was elected leader, sending a full tablet report...
I20260207 20:53:21.684724 9027 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44476:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:53:21.687592 9027 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:53:21.770637 9438 tablet_service.cc:1505] Processing CreateTablet for tablet df25b2ed05dc4bd089f3d98efdcc10cc (DEFAULT_TABLE table=ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:21.772128 9438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df25b2ed05dc4bd089f3d98efdcc10cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:21.777491 9437 tablet_service.cc:1505] Processing CreateTablet for tablet f0b2e4fad7c94295a3940a40d03ccd3a (DEFAULT_TABLE table=ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:21.779054 9437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b2e4fad7c94295a3940a40d03ccd3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:21.789525 9436 tablet_service.cc:1505] Processing CreateTablet for tablet c1b8f9ac3b28466c875dd8d4f59f2c26 (DEFAULT_TABLE table=ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:21.790928 9436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b8f9ac3b28466c875dd8d4f59f2c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:21.825244 9349 tablet_service.cc:1505] Processing CreateTablet for tablet df25b2ed05dc4bd089f3d98efdcc10cc (DEFAULT_TABLE table=ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:21.826542 9349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df25b2ed05dc4bd089f3d98efdcc10cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:21.827553 9271 tablet_service.cc:1505] Processing CreateTablet for tablet df25b2ed05dc4bd089f3d98efdcc10cc (DEFAULT_TABLE table=ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:21.828851 9271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df25b2ed05dc4bd089f3d98efdcc10cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:21.831533 9348 tablet_service.cc:1505] Processing CreateTablet for tablet f0b2e4fad7c94295a3940a40d03ccd3a (DEFAULT_TABLE table=ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:21.832792 9348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b2e4fad7c94295a3940a40d03ccd3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:21.835600 9347 tablet_service.cc:1505] Processing CreateTablet for tablet c1b8f9ac3b28466c875dd8d4f59f2c26 (DEFAULT_TABLE table=ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:21.836858 9347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b8f9ac3b28466c875dd8d4f59f2c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:21.839908 9270 tablet_service.cc:1505] Processing CreateTablet for tablet f0b2e4fad7c94295a3940a40d03ccd3a (DEFAULT_TABLE table=ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:21.841197 9270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b2e4fad7c94295a3940a40d03ccd3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:21.844106 9269 tablet_service.cc:1505] Processing CreateTablet for tablet c1b8f9ac3b28466c875dd8d4f59f2c26 (DEFAULT_TABLE table=ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:21.845408 9269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b8f9ac3b28466c875dd8d4f59f2c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:21.870234 9494 tablet_bootstrap.cc:492] T df25b2ed05dc4bd089f3d98efdcc10cc P 1f8e3143de004ea78f233dcb517399fc: Bootstrap starting.
I20260207 20:53:21.878378 9494 tablet_bootstrap.cc:654] T df25b2ed05dc4bd089f3d98efdcc10cc P 1f8e3143de004ea78f233dcb517399fc: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:21.895354 9495 tablet_bootstrap.cc:492] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366: Bootstrap starting.
I20260207 20:53:21.901787 9496 tablet_bootstrap.cc:492] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc: Bootstrap starting.
I20260207 20:53:21.902077 9495 tablet_bootstrap.cc:654] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:21.961796 9496 tablet_bootstrap.cc:654] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:21.972433 9496 tablet_bootstrap.cc:492] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc: No bootstrap required, opened a new log
I20260207 20:53:21.972959 9496 ts_tablet_manager.cc:1403] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc: Time spent bootstrapping tablet: real 0.072s user 0.005s sys 0.017s
I20260207 20:53:21.976091 9495 tablet_bootstrap.cc:492] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366: No bootstrap required, opened a new log
I20260207 20:53:21.976593 9495 ts_tablet_manager.cc:1403] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366: Time spent bootstrapping tablet: real 0.081s user 0.011s sys 0.016s
I20260207 20:53:21.979370 9495 raft_consensus.cc:359] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:21.980058 9495 raft_consensus.cc:385] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:21.980332 9495 raft_consensus.cc:740] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 716c92d6923f4a7d892124669c097366, State: Initialized, Role: FOLLOWER
I20260207 20:53:21.980985 9495 consensus_queue.cc:260] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:21.983263 9496 raft_consensus.cc:359] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } } peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } }
I20260207 20:53:21.984035 9496 raft_consensus.cc:385] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:21.984321 9496 raft_consensus.cc:740] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6215f47ac33642fcbd1218c2c19aeedc, State: Initialized, Role: FOLLOWER
I20260207 20:53:21.986088 9496 consensus_queue.cc:260] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } } peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } }
I20260207 20:53:21.988564 9495 ts_tablet_manager.cc:1434] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366: Time spent starting tablet: real 0.012s user 0.006s sys 0.002s
I20260207 20:53:21.989707 9495 tablet_bootstrap.cc:492] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366: Bootstrap starting.
I20260207 20:53:21.998142 9496 ts_tablet_manager.cc:1434] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc: Time spent starting tablet: real 0.025s user 0.008s sys 0.000s
I20260207 20:53:21.999302 9496 tablet_bootstrap.cc:492] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc: Bootstrap starting.
I20260207 20:53:22.002107 9494 tablet_bootstrap.cc:492] T df25b2ed05dc4bd089f3d98efdcc10cc P 1f8e3143de004ea78f233dcb517399fc: No bootstrap required, opened a new log
I20260207 20:53:22.002643 9494 ts_tablet_manager.cc:1403] T df25b2ed05dc4bd089f3d98efdcc10cc P 1f8e3143de004ea78f233dcb517399fc: Time spent bootstrapping tablet: real 0.133s user 0.055s sys 0.049s
I20260207 20:53:22.005519 9495 tablet_bootstrap.cc:654] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:22.005337 9494 raft_consensus.cc:359] T df25b2ed05dc4bd089f3d98efdcc10cc P 1f8e3143de004ea78f233dcb517399fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } } peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } }
I20260207 20:53:22.006129 9494 raft_consensus.cc:385] T df25b2ed05dc4bd089f3d98efdcc10cc P 1f8e3143de004ea78f233dcb517399fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:22.006445 9494 raft_consensus.cc:740] T df25b2ed05dc4bd089f3d98efdcc10cc P 1f8e3143de004ea78f233dcb517399fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f8e3143de004ea78f233dcb517399fc, State: Initialized, Role: FOLLOWER
I20260207 20:53:22.007220 9494 consensus_queue.cc:260] T df25b2ed05dc4bd089f3d98efdcc10cc P 1f8e3143de004ea78f233dcb517399fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } } peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } }
I20260207 20:53:22.005293 9496 tablet_bootstrap.cc:654] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:22.016594 9496 tablet_bootstrap.cc:492] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc: No bootstrap required, opened a new log
I20260207 20:53:22.017110 9496 ts_tablet_manager.cc:1403] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.000s
I20260207 20:53:22.017210 9494 ts_tablet_manager.cc:1434] T df25b2ed05dc4bd089f3d98efdcc10cc P 1f8e3143de004ea78f233dcb517399fc: Time spent starting tablet: real 0.014s user 0.009s sys 0.003s
I20260207 20:53:22.020563 9494 tablet_bootstrap.cc:492] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc: Bootstrap starting.
I20260207 20:53:22.021755 9496 raft_consensus.cc:359] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.022450 9496 raft_consensus.cc:385] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:22.022766 9496 raft_consensus.cc:740] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6215f47ac33642fcbd1218c2c19aeedc, State: Initialized, Role: FOLLOWER
I20260207 20:53:22.025054 9495 tablet_bootstrap.cc:492] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366: No bootstrap required, opened a new log
I20260207 20:53:22.025571 9495 ts_tablet_manager.cc:1403] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366: Time spent bootstrapping tablet: real 0.036s user 0.011s sys 0.002s
I20260207 20:53:22.028381 9495 raft_consensus.cc:359] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } } peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } }
I20260207 20:53:22.029102 9495 raft_consensus.cc:385] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:22.029389 9495 raft_consensus.cc:740] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 716c92d6923f4a7d892124669c097366, State: Initialized, Role: FOLLOWER
I20260207 20:53:22.030275 9495 consensus_queue.cc:260] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } } peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } }
I20260207 20:53:22.031373 9494 tablet_bootstrap.cc:654] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:22.033318 9500 raft_consensus.cc:493] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:22.033821 9500 raft_consensus.cc:515] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } } peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } }
I20260207 20:53:22.039140 9500 leader_election.cc:290] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6215f47ac33642fcbd1218c2c19aeedc (127.2.223.2:45131), 1f8e3143de004ea78f233dcb517399fc (127.2.223.3:33627)
I20260207 20:53:22.045873 9495 ts_tablet_manager.cc:1434] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20260207 20:53:22.047036 9495 tablet_bootstrap.cc:492] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366: Bootstrap starting.
I20260207 20:53:22.049518 9496 consensus_queue.cc:260] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.052953 9494 tablet_bootstrap.cc:492] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc: No bootstrap required, opened a new log
I20260207 20:53:22.053488 9494 ts_tablet_manager.cc:1403] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc: Time spent bootstrapping tablet: real 0.033s user 0.008s sys 0.012s
I20260207 20:53:22.053525 9496 ts_tablet_manager.cc:1434] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc: Time spent starting tablet: real 0.034s user 0.005s sys 0.000s
I20260207 20:53:22.056602 9494 raft_consensus.cc:359] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.057302 9494 raft_consensus.cc:385] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:22.057646 9494 raft_consensus.cc:740] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f8e3143de004ea78f233dcb517399fc, State: Initialized, Role: FOLLOWER
I20260207 20:53:22.058326 9494 consensus_queue.cc:260] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.060897 9494 ts_tablet_manager.cc:1434] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260207 20:53:22.062000 9494 tablet_bootstrap.cc:492] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc: Bootstrap starting.
I20260207 20:53:22.067910 9495 tablet_bootstrap.cc:654] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:22.068235 9494 tablet_bootstrap.cc:654] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:22.057238 9496 tablet_bootstrap.cc:492] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc: Bootstrap starting.
I20260207 20:53:22.071884 9362 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df25b2ed05dc4bd089f3d98efdcc10cc" candidate_uuid: "716c92d6923f4a7d892124669c097366" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6215f47ac33642fcbd1218c2c19aeedc" is_pre_election: true
I20260207 20:53:22.073091 9362 raft_consensus.cc:2468] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 716c92d6923f4a7d892124669c097366 in term 0.
I20260207 20:53:22.074656 9246 leader_election.cc:304] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6215f47ac33642fcbd1218c2c19aeedc, 716c92d6923f4a7d892124669c097366; no voters:
I20260207 20:53:22.075515 9500 raft_consensus.cc:2804] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:22.075908 9500 raft_consensus.cc:493] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:22.076223 9500 raft_consensus.cc:3060] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:22.084218 9223 catalog_manager.cc:1269] Loaded cluster ID: 70ea4976f74b474dbe292d6ac62a0813
I20260207 20:53:22.087230 9500 raft_consensus.cc:515] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } } peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } }
I20260207 20:53:22.091455 9362 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df25b2ed05dc4bd089f3d98efdcc10cc" candidate_uuid: "716c92d6923f4a7d892124669c097366" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6215f47ac33642fcbd1218c2c19aeedc"
I20260207 20:53:22.092031 9362 raft_consensus.cc:3060] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:22.093048 9234 catalog_manager.cc:1269] Loaded cluster ID: 70ea4976f74b474dbe292d6ac62a0813
I20260207 20:53:22.087302 9223 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: loading cluster ID for follower catalog manager: success
I20260207 20:53:22.099462 9362 raft_consensus.cc:2468] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 716c92d6923f4a7d892124669c097366 in term 1.
I20260207 20:53:22.100636 9246 leader_election.cc:304] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6215f47ac33642fcbd1218c2c19aeedc, 716c92d6923f4a7d892124669c097366; no voters:
I20260207 20:53:22.093374 9234 catalog_manager.cc:1562] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd: loading cluster ID for follower catalog manager: success
I20260207 20:53:22.110245 9500 leader_election.cc:290] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [CANDIDATE]: Term 1 election: Requested vote from peers 6215f47ac33642fcbd1218c2c19aeedc (127.2.223.2:45131), 1f8e3143de004ea78f233dcb517399fc (127.2.223.3:33627)
I20260207 20:53:22.111456 9500 raft_consensus.cc:2804] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:22.111908 9500 raft_consensus.cc:697] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [term 1 LEADER]: Becoming Leader. State: Replica: 716c92d6923f4a7d892124669c097366, State: Running, Role: LEADER
I20260207 20:53:22.112715 9500 consensus_queue.cc:237] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } } peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } }
I20260207 20:53:22.119450 9496 tablet_bootstrap.cc:654] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:22.133239 9495 tablet_bootstrap.cc:492] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366: No bootstrap required, opened a new log
I20260207 20:53:22.133824 9495 ts_tablet_manager.cc:1403] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366: Time spent bootstrapping tablet: real 0.087s user 0.012s sys 0.000s
I20260207 20:53:22.146346 9447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df25b2ed05dc4bd089f3d98efdcc10cc" candidate_uuid: "716c92d6923f4a7d892124669c097366" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f8e3143de004ea78f233dcb517399fc"
I20260207 20:53:22.147357 9447 raft_consensus.cc:3060] T df25b2ed05dc4bd089f3d98efdcc10cc P 1f8e3143de004ea78f233dcb517399fc [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:22.147912 9448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df25b2ed05dc4bd089f3d98efdcc10cc" candidate_uuid: "716c92d6923f4a7d892124669c097366" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f8e3143de004ea78f233dcb517399fc" is_pre_election: true
I20260207 20:53:22.150839 9223 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: acquiring CA information for follower catalog manager: success
I20260207 20:53:22.153926 9496 tablet_bootstrap.cc:492] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc: No bootstrap required, opened a new log
I20260207 20:53:22.154527 9496 ts_tablet_manager.cc:1403] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc: Time spent bootstrapping tablet: real 0.097s user 0.012s sys 0.006s
I20260207 20:53:22.154711 9447 raft_consensus.cc:2468] T df25b2ed05dc4bd089f3d98efdcc10cc P 1f8e3143de004ea78f233dcb517399fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 716c92d6923f4a7d892124669c097366 in term 1.
I20260207 20:53:22.162426 9234 catalog_manager.cc:1584] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd: acquiring CA information for follower catalog manager: success
W20260207 20:53:22.167604 9246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.223.2:45131, user_credentials={real_user=slave}} blocked reactor thread for 67063.9us
I20260207 20:53:22.143814 9495 raft_consensus.cc:359] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.171630 9495 raft_consensus.cc:385] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:22.172084 9495 raft_consensus.cc:740] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 716c92d6923f4a7d892124669c097366, State: Initialized, Role: FOLLOWER
I20260207 20:53:22.176057 9496 raft_consensus.cc:359] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.177250 9496 raft_consensus.cc:385] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:22.177386 9223 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:22.177585 9496 raft_consensus.cc:740] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6215f47ac33642fcbd1218c2c19aeedc, State: Initialized, Role: FOLLOWER
I20260207 20:53:22.183758 9496 consensus_queue.cc:260] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.192903 9496 ts_tablet_manager.cc:1434] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc: Time spent starting tablet: real 0.038s user 0.006s sys 0.000s
I20260207 20:53:22.172971 9495 consensus_queue.cc:260] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.214910 9495 ts_tablet_manager.cc:1434] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366: Time spent starting tablet: real 0.081s user 0.004s sys 0.006s
I20260207 20:53:22.216941 9494 tablet_bootstrap.cc:492] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc: No bootstrap required, opened a new log
I20260207 20:53:22.217468 9494 ts_tablet_manager.cc:1403] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc: Time spent bootstrapping tablet: real 0.156s user 0.043s sys 0.071s
I20260207 20:53:22.221577 9494 raft_consensus.cc:359] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.222288 9494 raft_consensus.cc:385] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:22.222560 9494 raft_consensus.cc:740] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f8e3143de004ea78f233dcb517399fc, State: Initialized, Role: FOLLOWER
I20260207 20:53:22.223274 9494 consensus_queue.cc:260] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.225736 9494 ts_tablet_manager.cc:1434] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260207 20:53:22.233425 9234 catalog_manager.cc:1612] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:22.238246 9027 catalog_manager.cc:5654] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 reported cstate change: term changed from 0 to 1, leader changed from <none> to 716c92d6923f4a7d892124669c097366 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "716c92d6923f4a7d892124669c097366" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:22.286531 9501 raft_consensus.cc:493] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:22.287160 9501 raft_consensus.cc:515] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.291074 9501 leader_election.cc:290] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 716c92d6923f4a7d892124669c097366 (127.2.223.1:33039), 1f8e3143de004ea78f233dcb517399fc (127.2.223.3:33627)
I20260207 20:53:22.321967 9447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0b2e4fad7c94295a3940a40d03ccd3a" candidate_uuid: "6215f47ac33642fcbd1218c2c19aeedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f8e3143de004ea78f233dcb517399fc" is_pre_election: true
I20260207 20:53:22.322739 9447 raft_consensus.cc:2468] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6215f47ac33642fcbd1218c2c19aeedc in term 0.
I20260207 20:53:22.324049 9323 leader_election.cc:304] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f8e3143de004ea78f233dcb517399fc, 6215f47ac33642fcbd1218c2c19aeedc; no voters:
I20260207 20:53:22.325235 9501 raft_consensus.cc:2804] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:22.325610 9501 raft_consensus.cc:493] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:22.325947 9501 raft_consensus.cc:3060] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:22.326578 9281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0b2e4fad7c94295a3940a40d03ccd3a" candidate_uuid: "6215f47ac33642fcbd1218c2c19aeedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "716c92d6923f4a7d892124669c097366" is_pre_election: true
I20260207 20:53:22.327323 9281 raft_consensus.cc:2468] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6215f47ac33642fcbd1218c2c19aeedc in term 0.
I20260207 20:53:22.332526 9501 raft_consensus.cc:515] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.335505 9447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0b2e4fad7c94295a3940a40d03ccd3a" candidate_uuid: "6215f47ac33642fcbd1218c2c19aeedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f8e3143de004ea78f233dcb517399fc"
I20260207 20:53:22.336084 9447 raft_consensus.cc:3060] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:22.336020 9281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0b2e4fad7c94295a3940a40d03ccd3a" candidate_uuid: "6215f47ac33642fcbd1218c2c19aeedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "716c92d6923f4a7d892124669c097366"
I20260207 20:53:22.336774 9281 raft_consensus.cc:3060] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:22.343309 9447 raft_consensus.cc:2468] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6215f47ac33642fcbd1218c2c19aeedc in term 1.
I20260207 20:53:22.344444 9323 leader_election.cc:304] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f8e3143de004ea78f233dcb517399fc, 6215f47ac33642fcbd1218c2c19aeedc; no voters:
I20260207 20:53:22.346410 9501 leader_election.cc:290] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [CANDIDATE]: Term 1 election: Requested vote from peers 716c92d6923f4a7d892124669c097366 (127.2.223.1:33039), 1f8e3143de004ea78f233dcb517399fc (127.2.223.3:33627)
I20260207 20:53:22.347060 9501 raft_consensus.cc:2804] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:22.347442 9501 raft_consensus.cc:697] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [term 1 LEADER]: Becoming Leader. State: Replica: 6215f47ac33642fcbd1218c2c19aeedc, State: Running, Role: LEADER
I20260207 20:53:22.348045 9501 consensus_queue.cc:237] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.350682 9281 raft_consensus.cc:2468] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6215f47ac33642fcbd1218c2c19aeedc in term 1.
I20260207 20:53:22.351001 9523 raft_consensus.cc:493] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:22.351644 9523 raft_consensus.cc:515] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.353703 9523 leader_election.cc:290] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 716c92d6923f4a7d892124669c097366 (127.2.223.1:33039), 1f8e3143de004ea78f233dcb517399fc (127.2.223.3:33627)
I20260207 20:53:22.357422 9447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1b8f9ac3b28466c875dd8d4f59f2c26" candidate_uuid: "6215f47ac33642fcbd1218c2c19aeedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f8e3143de004ea78f233dcb517399fc" is_pre_election: true
I20260207 20:53:22.358080 9447 raft_consensus.cc:2468] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6215f47ac33642fcbd1218c2c19aeedc in term 0.
I20260207 20:53:22.358476 9281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1b8f9ac3b28466c875dd8d4f59f2c26" candidate_uuid: "6215f47ac33642fcbd1218c2c19aeedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "716c92d6923f4a7d892124669c097366" is_pre_election: true
I20260207 20:53:22.359153 9281 raft_consensus.cc:2468] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6215f47ac33642fcbd1218c2c19aeedc in term 0.
I20260207 20:53:22.359165 9323 leader_election.cc:304] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f8e3143de004ea78f233dcb517399fc, 6215f47ac33642fcbd1218c2c19aeedc; no voters:
I20260207 20:53:22.367760 9501 raft_consensus.cc:2804] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:22.368163 9501 raft_consensus.cc:493] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:22.368558 9501 raft_consensus.cc:3060] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:22.368021 9026 catalog_manager.cc:5654] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6215f47ac33642fcbd1218c2c19aeedc (127.2.223.2). New cstate: current_term: 1 leader_uuid: "6215f47ac33642fcbd1218c2c19aeedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } health_report { overall_health: UNKNOWN } } }
I20260207 20:53:22.375178 9501 raft_consensus.cc:515] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.376842 9501 leader_election.cc:290] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [CANDIDATE]: Term 1 election: Requested vote from peers 716c92d6923f4a7d892124669c097366 (127.2.223.1:33039), 1f8e3143de004ea78f233dcb517399fc (127.2.223.3:33627)
I20260207 20:53:22.378189 9447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1b8f9ac3b28466c875dd8d4f59f2c26" candidate_uuid: "6215f47ac33642fcbd1218c2c19aeedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f8e3143de004ea78f233dcb517399fc"
I20260207 20:53:22.378859 9447 raft_consensus.cc:3060] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:22.384348 9281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1b8f9ac3b28466c875dd8d4f59f2c26" candidate_uuid: "6215f47ac33642fcbd1218c2c19aeedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "716c92d6923f4a7d892124669c097366"
I20260207 20:53:22.384927 9281 raft_consensus.cc:3060] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:22.392386 9281 raft_consensus.cc:2468] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6215f47ac33642fcbd1218c2c19aeedc in term 1.
I20260207 20:53:22.396693 9447 raft_consensus.cc:2468] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6215f47ac33642fcbd1218c2c19aeedc in term 1.
I20260207 20:53:22.393472 9324 leader_election.cc:304] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6215f47ac33642fcbd1218c2c19aeedc, 716c92d6923f4a7d892124669c097366; no voters:
I20260207 20:53:22.403513 9501 raft_consensus.cc:2804] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:22.404059 9501 raft_consensus.cc:697] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [term 1 LEADER]: Becoming Leader. State: Replica: 6215f47ac33642fcbd1218c2c19aeedc, State: Running, Role: LEADER
I20260207 20:53:22.404876 9501 consensus_queue.cc:237] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } }
I20260207 20:53:22.413386 9023 catalog_manager.cc:5654] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6215f47ac33642fcbd1218c2c19aeedc (127.2.223.2). New cstate: current_term: 1 leader_uuid: "6215f47ac33642fcbd1218c2c19aeedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 } health_report { overall_health: UNKNOWN } } }
I20260207 20:53:22.523277 2940 master.cc:561] Master@127.2.223.62:33957 shutting down...
I20260207 20:53:22.555291 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:22.556228 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:22.556628 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60: stopping tablet replica
W20260207 20:53:22.562322 9247 connection.cc:537] client connection to 127.2.223.62:33957 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260207 20:53:22.575315 2940 master.cc:583] Master@127.2.223.62:33957 shutdown complete.
I20260207 20:53:22.592604 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:22.601624 9531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:22.606568 9532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:22.610525 9535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:22.612186 9500 consensus_queue.cc:1048] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:22.622900 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:22.625541 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:22.625847 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:22.626005 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497602625994 us; error 0 us; skew 500 ppm
I20260207 20:53:22.627408 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:22.654066 9509 consensus_queue.cc:1048] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:22.664700 2940 webserver.cc:492] Webserver started at http://127.2.223.62:38303/ using document root <none> and password file <none>
I20260207 20:53:22.665482 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:22.665735 2940 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260207 20:53:22.685174 2940 fs_manager.cc:714] Time spent opening directory manager: real 0.016s user 0.005s sys 0.004s
I20260207 20:53:22.694336 9544 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:22.696309 2940 fs_manager.cc:730] Time spent opening block manager: real 0.009s user 0.003s sys 0.000s
I20260207 20:53:22.696630 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "b98234a6355f401486e90df80bf94b60"
format_stamp: "Formatted at 2026-02-07 20:53:20 on dist-test-slave-kqw4"
I20260207 20:53:22.696879 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:22.713989 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:22.715847 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:22.819784 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:33957
I20260207 20:53:22.819888 9595 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:33957 every 8 connection(s)
I20260207 20:53:22.829670 2940 master.cc:561] Master@127.2.223.61:38521 shutting down...
I20260207 20:53:22.851442 9501 consensus_queue.cc:1048] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:22.857863 9596 sys_catalog.cc:263] Verifying existing consensus state
I20260207 20:53:22.869004 9501 consensus_queue.cc:1048] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:22.897723 9596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60: Bootstrap starting.
I20260207 20:53:22.902546 9476 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33957
I20260207 20:53:22.906013 9398 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33957
I20260207 20:53:22.910287 9308 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33957
I20260207 20:53:22.922722 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:22.923413 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:22.923851 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd: stopping tablet replica
I20260207 20:53:22.952085 2940 master.cc:583] Master@127.2.223.61:38521 shutdown complete.
I20260207 20:53:22.970331 9522 consensus_queue.cc:1048] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260207 20:53:22.973357 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:22.991386 9596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=7 ignored=0} mutations{seen=6 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260207 20:53:22.992705 9596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60: Bootstrap complete.
I20260207 20:53:22.995950 9596 raft_consensus.cc:359] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:22.996681 9596 raft_consensus.cc:740] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98234a6355f401486e90df80bf94b60, State: Initialized, Role: FOLLOWER
I20260207 20:53:22.997467 9596 consensus_queue.cc:260] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:23.007786 9606 sys_catalog.cc:455] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:23.010996 9596 sys_catalog.cc:565] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:23.008543 9606 sys_catalog.cc:458] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: This master's current role is: FOLLOWER
W20260207 20:53:23.030400 9605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:23.038151 9522 consensus_queue.cc:1048] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "716c92d6923f4a7d892124669c097366" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260207 20:53:23.092350 9610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:23.093189 9398 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33957
I20260207 20:53:23.104257 9308 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33957
I20260207 20:53:23.107161 9476 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33957
W20260207 20:53:23.136395 9618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:23.144779 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:23.146111 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:23.146395 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:23.146641 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497603146620 us; error 0 us; skew 500 ppm
I20260207 20:53:23.148612 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:23.201068 2940 webserver.cc:492] Webserver started at http://127.2.223.61:43143/ using document root <none> and password file <none>
I20260207 20:53:23.201823 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:23.202054 2940 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260207 20:53:23.207068 2940 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260207 20:53:23.212002 9626 catalog_manager.cc:1269] Loaded cluster ID: 70ea4976f74b474dbe292d6ac62a0813
I20260207 20:53:23.212318 9626 catalog_manager.cc:1562] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60: loading cluster ID for follower catalog manager: success
I20260207 20:53:23.220217 9626 catalog_manager.cc:1584] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60: acquiring CA information for follower catalog manager: success
I20260207 20:53:23.228425 9626 catalog_manager.cc:1612] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:23.230160 9628 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:23.232403 9561 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" instance_seqno: 1770497601564751) as {username='slave'} at 127.0.0.1:45032; Asking this server to re-register.
I20260207 20:53:23.233382 9560 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" instance_seqno: 1770497601306398) as {username='slave'} at 127.0.0.1:45046; Asking this server to re-register.
I20260207 20:53:23.234503 2940 fs_manager.cc:730] Time spent opening block manager: real 0.025s user 0.002s sys 0.003s
I20260207 20:53:23.234892 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd"
format_stamp: "Formatted at 2026-02-07 20:53:20 on dist-test-slave-kqw4"
I20260207 20:53:23.234954 9559 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "716c92d6923f4a7d892124669c097366" instance_seqno: 1770497601162707) as {username='slave'} at 127.0.0.1:45048; Asking this server to re-register.
I20260207 20:53:23.235268 9398 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:23.235198 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:23.309063 9308 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:23.375413 9476 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:23.495137 9560 ts_manager.cc:194] Registered new tserver with Master: 6215f47ac33642fcbd1218c2c19aeedc (127.2.223.2:45131)
W20260207 20:53:23.535606 9414 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.Ping -> {remote=127.2.223.61:38521, user_credentials={real_user=slave}} blocked reactor thread for 70846.6us
I20260207 20:53:23.717280 9559 ts_manager.cc:194] Registered new tserver with Master: 716c92d6923f4a7d892124669c097366 (127.2.223.1:33039)
I20260207 20:53:23.741062 9561 ts_manager.cc:194] Registered new tserver with Master: 1f8e3143de004ea78f233dcb517399fc (127.2.223.3:33627)
I20260207 20:53:23.775986 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:23.778101 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:23.943756 9662 raft_consensus.cc:493] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98234a6355f401486e90df80bf94b60)
I20260207 20:53:23.944413 9662 raft_consensus.cc:515] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:23.986887 9662 leader_election.cc:290] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98234a6355f401486e90df80bf94b60 (127.2.223.62:33957), cbb51cf65ff54a69815b4dbdbc73c2fd (127.2.223.61:38521)
I20260207 20:53:24.071290 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "220d7f81ee2a4a208583bd4b50c52a88" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "b98234a6355f401486e90df80bf94b60" is_pre_election: true
I20260207 20:53:24.072604 9571 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 220d7f81ee2a4a208583bd4b50c52a88 in term 1.
I20260207 20:53:24.077689 9143 leader_election.cc:304] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220d7f81ee2a4a208583bd4b50c52a88, b98234a6355f401486e90df80bf94b60; no voters:
I20260207 20:53:24.078552 9662 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260207 20:53:24.079005 9662 raft_consensus.cc:493] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98234a6355f401486e90df80bf94b60)
I20260207 20:53:24.079375 9662 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 1 FOLLOWER]: Advancing to term 2
W20260207 20:53:24.086127 9143 leader_election.cc:336] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbb51cf65ff54a69815b4dbdbc73c2fd (127.2.223.61:38521): Network error: Client connection negotiation failed: client connection to 127.2.223.61:38521: connect: Connection refused (error 111)
I20260207 20:53:24.093137 9662 raft_consensus.cc:515] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:24.100859 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "220d7f81ee2a4a208583bd4b50c52a88" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "b98234a6355f401486e90df80bf94b60"
I20260207 20:53:24.101425 9571 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:53:24.101876 9662 leader_election.cc:290] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [CANDIDATE]: Term 2 election: Requested vote from peers b98234a6355f401486e90df80bf94b60 (127.2.223.62:33957), cbb51cf65ff54a69815b4dbdbc73c2fd (127.2.223.61:38521)
W20260207 20:53:24.103751 9143 leader_election.cc:336] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbb51cf65ff54a69815b4dbdbc73c2fd (127.2.223.61:38521): Network error: Client connection negotiation failed: client connection to 127.2.223.61:38521: connect: Connection refused (error 111)
I20260207 20:53:24.119240 9571 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220d7f81ee2a4a208583bd4b50c52a88 in term 2.
I20260207 20:53:24.120332 9143 leader_election.cc:304] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 220d7f81ee2a4a208583bd4b50c52a88, b98234a6355f401486e90df80bf94b60; no voters: cbb51cf65ff54a69815b4dbdbc73c2fd
I20260207 20:53:24.121259 9662 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 2 FOLLOWER]: Leader election won for term 2
I20260207 20:53:24.132159 9662 raft_consensus.cc:697] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 2 LEADER]: Becoming Leader. State: Replica: 220d7f81ee2a4a208583bd4b50c52a88, State: Running, Role: LEADER
I20260207 20:53:24.133226 9662 consensus_queue.cc:237] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:24.151436 9682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 220d7f81ee2a4a208583bd4b50c52a88. Latest consensus state: current_term: 2 leader_uuid: "220d7f81ee2a4a208583bd4b50c52a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:24.152238 9682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:24.158340 9686 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:53:24.172381 9686 catalog_manager.cc:679] Loaded metadata for table ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd]
I20260207 20:53:24.188858 9690 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:38521 every 8 connection(s)
I20260207 20:53:24.190397 9686 tablet_loader.cc:96] loaded metadata for tablet c1b8f9ac3b28466c875dd8d4f59f2c26 (table ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd])
I20260207 20:53:24.192341 9686 tablet_loader.cc:96] loaded metadata for tablet df25b2ed05dc4bd089f3d98efdcc10cc (table ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd])
I20260207 20:53:24.193972 9686 tablet_loader.cc:96] loaded metadata for tablet f0b2e4fad7c94295a3940a40d03ccd3a (table ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd])
I20260207 20:53:24.195582 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:38521
I20260207 20:53:24.195703 9686 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:53:24.205847 9686 catalog_manager.cc:1269] Loaded cluster ID: 70ea4976f74b474dbe292d6ac62a0813
I20260207 20:53:24.206235 9686 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:53:24.211845 9686 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:53:24.219491 9686 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: Loaded TSK: 0
I20260207 20:53:24.220641 9686 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:53:24.240922 9396 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38521
I20260207 20:53:24.243920 9473 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:24.247488 2940 master.cc:561] Master@127.2.223.60:46833 shutting down...
I20260207 20:53:24.256611 9307 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38521
I20260207 20:53:24.249969 9393 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:24.262879 9306 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:24.279808 9474 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38521
I20260207 20:53:24.290772 9306 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:24.292786 9692 sys_catalog.cc:263] Verifying existing consensus state
I20260207 20:53:24.294088 9393 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:24.306957 9306 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:24.307718 9692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd: Bootstrap starting.
I20260207 20:53:24.309728 9393 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:24.323331 9306 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:24.325706 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 2 LEADER]: Raft consensus shutting down.
I20260207 20:53:24.327708 2940 pending_rounds.cc:70] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: Trying to abort 1 pending ops.
I20260207 20:53:24.327994 2940 pending_rounds.cc:77] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: Aborting op as it isn't in flight: id { term: 2 index: 10 } timestamp: 7251958186553413632 op_type: NO_OP noop_request { }
I20260207 20:53:24.328410 2940 raft_consensus.cc:2889] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260207 20:53:24.328794 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:24.329533 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: stopping tablet replica
I20260207 20:53:24.335763 9393 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:24.341023 9306 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:24.352463 9393 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:24.355850 9306 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:24.368180 2940 master.cc:583] Master@127.2.223.60:46833 shutdown complete.
I20260207 20:53:24.380913 9692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=7 ignored=0} mutations{seen=6 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260207 20:53:24.381963 9692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd: Bootstrap complete.
I20260207 20:53:24.384903 9692 raft_consensus.cc:359] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:24.385556 9692 raft_consensus.cc:740] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb51cf65ff54a69815b4dbdbc73c2fd, State: Initialized, Role: FOLLOWER
I20260207 20:53:24.386672 9692 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:24.394555 9697 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:24.397401 9697 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:24.396696 9692 sys_catalog.cc:565] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:24.411012 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:24.439728 9703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:24.468550 9707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:24.452987 9705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:24.472612 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:24.473858 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:24.474151 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:24.474365 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497604474349 us; error 0 us; skew 500 ppm
I20260207 20:53:24.475131 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:24.485868 2940 webserver.cc:492] Webserver started at http://127.2.223.60:33271/ using document root <none> and password file <none>
I20260207 20:53:24.486497 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:24.486773 2940 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260207 20:53:24.491282 2940 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260207 20:53:24.494432 9717 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:24.496467 2940 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260207 20:53:24.496842 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "220d7f81ee2a4a208583bd4b50c52a88"
format_stamp: "Formatted at 2026-02-07 20:53:20 on dist-test-slave-kqw4"
I20260207 20:53:24.497221 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:24.508021 9647 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" instance_seqno: 1770497601306398) as {username='slave'} at 127.0.0.1:50426; Asking this server to re-register.
I20260207 20:53:24.508889 9646 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" instance_seqno: 1770497601564751) as {username='slave'} at 127.0.0.1:50416; Asking this server to re-register.
I20260207 20:53:24.506923 9648 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "716c92d6923f4a7d892124669c097366" instance_seqno: 1770497601162707) as {username='slave'} at 127.0.0.1:50432; Asking this server to re-register.
I20260207 20:53:24.510471 9396 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:24.513605 9307 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:24.515684 9474 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:24.576092 9716 catalog_manager.cc:1269] Loaded cluster ID: 70ea4976f74b474dbe292d6ac62a0813
I20260207 20:53:24.578549 9716 catalog_manager.cc:1562] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd: loading cluster ID for follower catalog manager: success
I20260207 20:53:24.612123 9716 catalog_manager.cc:1584] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd: acquiring CA information for follower catalog manager: success
I20260207 20:53:24.621194 9716 catalog_manager.cc:1612] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:24.726447 9648 ts_manager.cc:194] Registered new tserver with Master: 6215f47ac33642fcbd1218c2c19aeedc (127.2.223.2:45131)
I20260207 20:53:24.801947 9646 ts_manager.cc:194] Registered new tserver with Master: 716c92d6923f4a7d892124669c097366 (127.2.223.1:33039)
I20260207 20:53:24.805682 9647 ts_manager.cc:194] Registered new tserver with Master: 1f8e3143de004ea78f233dcb517399fc (127.2.223.3:33627)
I20260207 20:53:24.819530 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:24.822455 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:24.943934 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:46833
I20260207 20:53:24.944149 9771 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:46833 every 8 connection(s)
I20260207 20:53:24.994089 9473 heartbeater.cc:344] Connected to a master server at 127.2.223.60:46833
I20260207 20:53:24.993789 9772 sys_catalog.cc:263] Verifying existing consensus state
I20260207 20:53:24.998346 9393 heartbeater.cc:344] Connected to a master server at 127.2.223.60:46833
I20260207 20:53:24.998940 9393 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:25.007102 9772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: Bootstrap starting.
I20260207 20:53:25.012085 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:25.020133 9306 heartbeater.cc:344] Connected to a master server at 127.2.223.60:46833
I20260207 20:53:25.020705 9306 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:25.021549 9393 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
W20260207 20:53:25.029106 9777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:25.034881 9778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:25.043244 9306 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:25.065793 9393 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:25.080034 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:25.081945 9782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:25.083329 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:25.083649 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:25.083901 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497605083880 us; error 0 us; skew 500 ppm
I20260207 20:53:25.082039 9306 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:25.085021 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:25.090310 9393 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:25.095165 9772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=9 ignored=0} inserts{seen=7 ignored=0} mutations{seen=6 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260207 20:53:25.096274 9772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: Bootstrap complete.
I20260207 20:53:25.100535 9772 raft_consensus.cc:359] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:25.101212 9772 raft_consensus.cc:740] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220d7f81ee2a4a208583bd4b50c52a88, State: Initialized, Role: FOLLOWER
I20260207 20:53:25.101845 9772 consensus_queue.cc:260] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 2.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:25.107225 2940 webserver.cc:492] Webserver started at http://127.2.223.4:37797/ using document root <none> and password file <none>
I20260207 20:53:25.108062 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:25.108323 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:25.108686 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:25.109513 9784 sys_catalog.cc:455] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:25.109982 9306 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:25.110273 9784 sys_catalog.cc:458] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:25.110651 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-3-root/instance:
uuid: "335086a93dac433d87d54bd95991330d"
format_stamp: "Formatted at 2026-02-07 20:53:25 on dist-test-slave-kqw4"
I20260207 20:53:25.112881 9772 sys_catalog.cc:565] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:25.119910 9393 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:25.122233 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.011s user 0.004s sys 0.007s
I20260207 20:53:25.131007 9306 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:25.137591 9791 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:25.138306 9393 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:25.139029 2940 fs_manager.cc:730] Time spent opening block manager: real 0.013s user 0.002s sys 0.008s
I20260207 20:53:25.139560 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-3-root
uuid: "335086a93dac433d87d54bd95991330d"
format_stamp: "Formatted at 2026-02-07 20:53:25 on dist-test-slave-kqw4"
I20260207 20:53:25.139964 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1770497537224219-2940-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:25.153259 9306 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:25.154233 9393 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:25.168277 9306 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:25.170504 9393 heartbeater.cc:499] Master 127.2.223.60:46833 was elected leader, sending a full tablet report...
I20260207 20:53:25.175837 9737 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6215f47ac33642fcbd1218c2c19aeedc" instance_seqno: 1770497601306398) as {username='slave'} at 127.0.0.1:34028; Asking this server to re-register.
I20260207 20:53:25.176273 9735 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1f8e3143de004ea78f233dcb517399fc" instance_seqno: 1770497601564751) as {username='slave'} at 127.0.0.1:34026; Asking this server to re-register.
I20260207 20:53:25.177863 9473 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:25.178073 9736 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "716c92d6923f4a7d892124669c097366" instance_seqno: 1770497601162707) as {username='slave'} at 127.0.0.1:34042; Asking this server to re-register.
I20260207 20:53:25.181627 9393 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:25.181900 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:25.239873 9802 catalog_manager.cc:1269] Loaded cluster ID: 70ea4976f74b474dbe292d6ac62a0813
I20260207 20:53:25.243068 9802 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: loading cluster ID for follower catalog manager: success
I20260207 20:53:25.249850 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:25.271407 9802 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: acquiring CA information for follower catalog manager: success
I20260207 20:53:25.335353 9736 ts_manager.cc:194] Registered new tserver with Master: 1f8e3143de004ea78f233dcb517399fc (127.2.223.3:33627)
I20260207 20:53:25.375167 9802 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:25.182811 9306 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:25.528393 9735 ts_manager.cc:194] Registered new tserver with Master: 6215f47ac33642fcbd1218c2c19aeedc (127.2.223.2:45131)
I20260207 20:53:25.560511 9736 ts_manager.cc:194] Registered new tserver with Master: 716c92d6923f4a7d892124669c097366 (127.2.223.1:33039)
I20260207 20:53:25.567095 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:25.568934 9809 raft_consensus.cc:493] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:25.569797 9809 raft_consensus.cc:515] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:25.576251 9809 leader_election.cc:290] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98234a6355f401486e90df80bf94b60 (127.2.223.62:33957), 220d7f81ee2a4a208583bd4b50c52a88 (127.2.223.60:46833)
I20260207 20:53:25.582512 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:25.582974 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.001s
I20260207 20:53:25.583377 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:25.583608 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:25.605934 9747 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "220d7f81ee2a4a208583bd4b50c52a88" is_pre_election: true
I20260207 20:53:25.607015 9747 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbb51cf65ff54a69815b4dbdbc73c2fd in current term 2: Already voted for candidate 220d7f81ee2a4a208583bd4b50c52a88 in this term.
I20260207 20:53:25.615422 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "b98234a6355f401486e90df80bf94b60" is_pre_election: true
I20260207 20:53:25.616313 9571 raft_consensus.cc:2393] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbb51cf65ff54a69815b4dbdbc73c2fd in current term 2: Already voted for candidate 220d7f81ee2a4a208583bd4b50c52a88 in this term.
I20260207 20:53:25.617779 9635 leader_election.cc:304] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbb51cf65ff54a69815b4dbdbc73c2fd; no voters: 220d7f81ee2a4a208583bd4b50c52a88, b98234a6355f401486e90df80bf94b60
I20260207 20:53:25.618830 9809 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:53:25.636694 9809 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260207 20:53:25.761269 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.4:43979
I20260207 20:53:25.761468 9871 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.4:43979 every 8 connection(s)
I20260207 20:53:25.830502 9872 heartbeater.cc:344] Connected to a master server at 127.2.223.60:46833
I20260207 20:53:25.831019 9872 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:25.831967 9872 heartbeater.cc:507] Master 127.2.223.60:46833 requested a full tablet report, sending...
I20260207 20:53:26.003103 9881 raft_consensus.cc:493] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:26.004491 9881 raft_consensus.cc:515] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:26.006062 9873 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38521
I20260207 20:53:26.006889 9873 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:26.010789 9873 heartbeater.cc:507] Master 127.2.223.61:38521 requested a full tablet report, sending...
I20260207 20:53:26.019062 9881 leader_election.cc:290] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cbb51cf65ff54a69815b4dbdbc73c2fd (127.2.223.61:38521), 220d7f81ee2a4a208583bd4b50c52a88 (127.2.223.60:46833)
I20260207 20:53:26.120517 9735 ts_manager.cc:194] Registered new tserver with Master: 335086a93dac433d87d54bd95991330d (127.2.223.4:43979)
I20260207 20:53:26.223136 9875 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33957
I20260207 20:53:26.224144 9875 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:26.225988 9875 heartbeater.cc:507] Master 127.2.223.62:33957 requested a full tablet report, sending...
I20260207 20:53:26.319221 9747 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b98234a6355f401486e90df80bf94b60" candidate_term: 3 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "220d7f81ee2a4a208583bd4b50c52a88" is_pre_election: true
I20260207 20:53:26.320963 9747 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98234a6355f401486e90df80bf94b60 for term 3 because replica has last-logged OpId of term: 2 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 9.
I20260207 20:53:26.405290 9648 ts_manager.cc:194] Registered new tserver with Master: 335086a93dac433d87d54bd95991330d (127.2.223.4:43979)
I20260207 20:53:26.641691 9658 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b98234a6355f401486e90df80bf94b60" candidate_term: 3 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" is_pre_election: true
I20260207 20:53:26.642805 9658 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98234a6355f401486e90df80bf94b60 in term 2.
I20260207 20:53:26.644774 9548 leader_election.cc:304] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98234a6355f401486e90df80bf94b60, cbb51cf65ff54a69815b4dbdbc73c2fd; no voters: 220d7f81ee2a4a208583bd4b50c52a88
I20260207 20:53:26.668175 9895 raft_consensus.cc:493] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:26.669634 9895 raft_consensus.cc:515] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:26.675909 9896 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260207 20:53:26.676409 9896 raft_consensus.cc:493] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:26.676736 9896 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 2 FOLLOWER]: Advancing to term 3
I20260207 20:53:26.691138 9558 ts_manager.cc:194] Registered new tserver with Master: 335086a93dac433d87d54bd95991330d (127.2.223.4:43979)
I20260207 20:53:26.698968 9896 raft_consensus.cc:515] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:26.708165 9658 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b98234a6355f401486e90df80bf94b60" candidate_term: 3 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd"
I20260207 20:53:26.708782 9658 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 2 FOLLOWER]: Advancing to term 3
I20260207 20:53:26.710510 9747 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b98234a6355f401486e90df80bf94b60" candidate_term: 3 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "220d7f81ee2a4a208583bd4b50c52a88"
I20260207 20:53:26.711179 9747 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 2 FOLLOWER]: Advancing to term 3
I20260207 20:53:26.722707 9896 leader_election.cc:290] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [CANDIDATE]: Term 3 election: Requested vote from peers cbb51cf65ff54a69815b4dbdbc73c2fd (127.2.223.61:38521), 220d7f81ee2a4a208583bd4b50c52a88 (127.2.223.60:46833)
I20260207 20:53:26.726317 9658 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98234a6355f401486e90df80bf94b60 in term 3.
I20260207 20:53:26.727037 9747 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98234a6355f401486e90df80bf94b60 for term 3 because replica has last-logged OpId of term: 2 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 9.
I20260207 20:53:26.728048 9548 leader_election.cc:304] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98234a6355f401486e90df80bf94b60, cbb51cf65ff54a69815b4dbdbc73c2fd; no voters:
I20260207 20:53:26.729698 9896 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 3 FOLLOWER]: Leader election won for term 3
I20260207 20:53:26.739001 9896 raft_consensus.cc:697] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 3 LEADER]: Becoming Leader. State: Replica: b98234a6355f401486e90df80bf94b60, State: Running, Role: LEADER
I20260207 20:53:26.741125 9896 consensus_queue.cc:237] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } }
I20260207 20:53:26.769199 9897 sys_catalog.cc:455] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b98234a6355f401486e90df80bf94b60. Latest consensus state: current_term: 3 leader_uuid: "b98234a6355f401486e90df80bf94b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:26.770097 9897 sys_catalog.cc:458] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:26.810819 9899 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:53:26.830117 9895 leader_election.cc:290] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98234a6355f401486e90df80bf94b60 (127.2.223.62:33957), cbb51cf65ff54a69815b4dbdbc73c2fd (127.2.223.61:38521)
I20260207 20:53:26.848018 9899 catalog_manager.cc:679] Loaded metadata for table ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd]
I20260207 20:53:26.884003 9899 tablet_loader.cc:96] loaded metadata for tablet c1b8f9ac3b28466c875dd8d4f59f2c26 (table ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd])
I20260207 20:53:26.889303 9899 tablet_loader.cc:96] loaded metadata for tablet df25b2ed05dc4bd089f3d98efdcc10cc (table ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd])
I20260207 20:53:26.890795 9899 tablet_loader.cc:96] loaded metadata for tablet f0b2e4fad7c94295a3940a40d03ccd3a (table ksck-test-table [id=989c03c9d8d64bf6ad14cde24ee78edd])
I20260207 20:53:26.911967 9899 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:53:26.918159 9899 catalog_manager.cc:1269] Loaded cluster ID: 70ea4976f74b474dbe292d6ac62a0813
I20260207 20:53:26.919857 9899 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:53:26.928409 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "220d7f81ee2a4a208583bd4b50c52a88" candidate_term: 3 candidate_status { last_received { term: 2 index: 10 } } ignore_live_leader: false dest_uuid: "b98234a6355f401486e90df80bf94b60" is_pre_election: true
I20260207 20:53:26.941694 9899 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:53:26.957775 9899 catalog_manager.cc:6038] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60: Loaded TSK: 0
I20260207 20:53:26.961405 9658 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "220d7f81ee2a4a208583bd4b50c52a88" candidate_term: 3 candidate_status { last_received { term: 2 index: 10 } } ignore_live_leader: false dest_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" is_pre_election: true
I20260207 20:53:26.968017 9658 raft_consensus.cc:2393] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 220d7f81ee2a4a208583bd4b50c52a88 in current term 3: Already voted for candidate b98234a6355f401486e90df80bf94b60 in this term.
I20260207 20:53:26.968205 9899 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:53:26.976599 9724 leader_election.cc:304] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 220d7f81ee2a4a208583bd4b50c52a88; no voters: b98234a6355f401486e90df80bf94b60, cbb51cf65ff54a69815b4dbdbc73c2fd
I20260207 20:53:26.977613 9895 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260207 20:53:26.985996 9398 heartbeater.cc:499] Master 127.2.223.62:33957 was elected leader, sending a full tablet report...
I20260207 20:53:26.991412 9476 heartbeater.cc:499] Master 127.2.223.62:33957 was elected leader, sending a full tablet report...
I20260207 20:53:26.993942 9560 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35098
I20260207 20:53:27.023273 9308 heartbeater.cc:499] Master 127.2.223.62:33957 was elected leader, sending a full tablet report...
I20260207 20:53:27.025305 9875 heartbeater.cc:499] Master 127.2.223.62:33957 was elected leader, sending a full tablet report...
I20260207 20:53:27.135005 9658 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 3 FOLLOWER]: Refusing update from remote peer b98234a6355f401486e90df80bf94b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 3 index: 10. (index mismatch)
I20260207 20:53:27.138491 9897 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260207 20:53:27.147974 9747 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 3 FOLLOWER]: Refusing update from remote peer b98234a6355f401486e90df80bf94b60: Log matching property violated. Preceding OpId in replica: term: 2 index: 10. Preceding OpId from leader: term: 3 index: 10. (term mismatch)
I20260207 20:53:27.148298 9747 pending_rounds.cc:85] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: Aborting all ops after (but not including) 9
I20260207 20:53:27.148519 9747 pending_rounds.cc:107] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88: Aborting uncommitted NO_OP operation due to leader change: 2.10
I20260207 20:53:27.148777 9747 raft_consensus.cc:2889] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260207 20:53:27.150429 9897 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260207 20:53:27.172569 9895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b98234a6355f401486e90df80bf94b60. Latest consensus state: current_term: 3 leader_uuid: "b98234a6355f401486e90df80bf94b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:27.173375 9895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:27.196568 9902 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b98234a6355f401486e90df80bf94b60. Latest consensus state: current_term: 3 leader_uuid: "b98234a6355f401486e90df80bf94b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:27.197438 9902 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:27.200230 9902 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b98234a6355f401486e90df80bf94b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:27.200992 9902 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:27.218096 9895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b98234a6355f401486e90df80bf94b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:27.225994 9895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:27.229331 9896 sys_catalog.cc:455] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b98234a6355f401486e90df80bf94b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:27.230089 9896 sys_catalog.cc:458] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:27.246989 9896 sys_catalog.cc:455] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b98234a6355f401486e90df80bf94b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98234a6355f401486e90df80bf94b60" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33957 } } peers { permanent_uuid: "cbb51cf65ff54a69815b4dbdbc73c2fd" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38521 } } peers { permanent_uuid: "220d7f81ee2a4a208583bd4b50c52a88" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 46833 } } }
I20260207 20:53:27.247761 9896 sys_catalog.cc:458] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:27.613243 9438 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:53:27.673504 9271 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:53:27.677389 9349 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260207 20:53:27.678119 9837 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:53:28.284648 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:53:28.370376 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:28.371953 2940 tablet_replica.cc:333] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366: stopping tablet replica
I20260207 20:53:28.372577 2940 raft_consensus.cc:2243] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:28.373090 2940 raft_consensus.cc:2272] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 716c92d6923f4a7d892124669c097366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:28.375926 2940 tablet_replica.cc:333] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366: stopping tablet replica
I20260207 20:53:28.376752 2940 raft_consensus.cc:2243] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:28.377882 2940 raft_consensus.cc:2272] T df25b2ed05dc4bd089f3d98efdcc10cc P 716c92d6923f4a7d892124669c097366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:28.383113 2940 tablet_replica.cc:333] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366: stopping tablet replica
I20260207 20:53:28.383827 2940 raft_consensus.cc:2243] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:28.384433 2940 raft_consensus.cc:2272] T f0b2e4fad7c94295a3940a40d03ccd3a P 716c92d6923f4a7d892124669c097366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:28.415606 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:53:28.434701 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:53:28.499161 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:28.500988 2940 tablet_replica.cc:333] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc: stopping tablet replica
I20260207 20:53:28.502988 2940 raft_consensus.cc:2243] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:28.504961 2940 raft_consensus.cc:2272] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 6215f47ac33642fcbd1218c2c19aeedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:28.507354 2940 tablet_replica.cc:333] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc: stopping tablet replica
I20260207 20:53:28.507880 2940 raft_consensus.cc:2243] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:28.508617 2940 raft_consensus.cc:2272] T f0b2e4fad7c94295a3940a40d03ccd3a P 6215f47ac33642fcbd1218c2c19aeedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:28.510538 2940 tablet_replica.cc:333] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc: stopping tablet replica
I20260207 20:53:28.511130 2940 raft_consensus.cc:2243] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:28.511529 2940 raft_consensus.cc:2272] T df25b2ed05dc4bd089f3d98efdcc10cc P 6215f47ac33642fcbd1218c2c19aeedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:28.536916 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:53:28.553247 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:53:28.591404 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:28.592114 2940 tablet_replica.cc:333] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc: stopping tablet replica
I20260207 20:53:28.592765 2940 raft_consensus.cc:2243] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:28.593256 2940 raft_consensus.cc:2272] T c1b8f9ac3b28466c875dd8d4f59f2c26 P 1f8e3143de004ea78f233dcb517399fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:28.595752 2940 tablet_replica.cc:333] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc: stopping tablet replica
I20260207 20:53:28.596349 2940 raft_consensus.cc:2243] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:28.596745 2940 raft_consensus.cc:2272] T f0b2e4fad7c94295a3940a40d03ccd3a P 1f8e3143de004ea78f233dcb517399fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:28.598620 2940 tablet_replica.cc:333] T df25b2ed05dc4bd089f3d98efdcc10cc P 1f8e3143de004ea78f233dcb517399fc: stopping tablet replica
I20260207 20:53:28.599206 2940 raft_consensus.cc:2243] T df25b2ed05dc4bd089f3d98efdcc10cc P 1f8e3143de004ea78f233dcb517399fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:28.599680 2940 raft_consensus.cc:2272] T df25b2ed05dc4bd089f3d98efdcc10cc P 1f8e3143de004ea78f233dcb517399fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:28.621138 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:53:28.637156 2940 tablet_server.cc:178] TabletServer@127.2.223.4:0 shutting down...
I20260207 20:53:28.665302 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:28.681324 2940 tablet_server.cc:195] TabletServer@127.2.223.4:0 shutdown complete.
I20260207 20:53:28.690114 2940 master.cc:561] Master@127.2.223.62:33957 shutting down...
I20260207 20:53:28.709887 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 3 LEADER]: Raft consensus shutting down.
I20260207 20:53:28.710744 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b98234a6355f401486e90df80bf94b60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:28.711064 2940 tablet_replica.cc:333] stopping tablet replica
I20260207 20:53:28.734344 2940 master.cc:583] Master@127.2.223.62:33957 shutdown complete.
I20260207 20:53:28.748461 2940 master.cc:561] Master@127.2.223.61:38521 shutting down...
I20260207 20:53:28.765230 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:28.765725 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cbb51cf65ff54a69815b4dbdbc73c2fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:28.766010 2940 tablet_replica.cc:333] stopping tablet replica
I20260207 20:53:28.785310 2940 master.cc:583] Master@127.2.223.61:38521 shutdown complete.
I20260207 20:53:28.798810 2940 master.cc:561] Master@127.2.223.60:46833 shutting down...
I20260207 20:53:28.815752 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:28.816236 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 220d7f81ee2a4a208583bd4b50c52a88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:28.816526 2940 tablet_replica.cc:333] stopping tablet replica
I20260207 20:53:28.835080 2940 master.cc:583] Master@127.2.223.60:46833 shutdown complete.
[ OK ] RemoteKsckTest.TestClusterWithLocation (8119 ms)
[ RUN ] RemoteKsckTest.TestFilterOnNoTableCluster
I20260207 20:53:28.868149 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:33625,127.2.223.61:45057,127.2.223.60:45135
I20260207 20:53:28.869410 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:28.874270 9938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:28.875322 9939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:28.875949 9941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:28.876291 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:28.876971 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:28.877135 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:28.877244 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497608877234 us; error 0 us; skew 500 ppm
I20260207 20:53:28.877668 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:28.879712 2940 webserver.cc:492] Webserver started at http://127.2.223.62:40911/ using document root <none> and password file <none>
I20260207 20:53:28.880107 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:28.880246 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:28.880440 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:28.881386 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "04d7170b7e70481f8b4a3370d10831f7"
format_stamp: "Formatted at 2026-02-07 20:53:28 on dist-test-slave-kqw4"
I20260207 20:53:28.885372 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260207 20:53:28.888383 9946 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:28.889128 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260207 20:53:28.889362 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "04d7170b7e70481f8b4a3370d10831f7"
format_stamp: "Formatted at 2026-02-07 20:53:28 on dist-test-slave-kqw4"
I20260207 20:53:28.889590 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:28.923187 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:28.924242 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:28.961042 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:33625
I20260207 20:53:28.961155 9997 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:33625 every 8 connection(s)
I20260207 20:53:28.964687 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:28.964811 9998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260207 20:53:28.969841 10000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:28.971586 10001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:28.972963 10003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:28.973320 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:28.973603 9998 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:28.974268 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:28.974468 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:28.974680 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497608974661 us; error 0 us; skew 500 ppm
I20260207 20:53:28.975466 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:28.980429 2940 webserver.cc:492] Webserver started at http://127.2.223.61:43297/ using document root <none> and password file <none>
I20260207 20:53:28.980918 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:28.981093 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:28.981321 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:28.982399 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "29960e03455f4cd7b7ecaa8f531a55b6"
format_stamp: "Formatted at 2026-02-07 20:53:28 on dist-test-slave-kqw4"
I20260207 20:53:28.985667 9998 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:28.987533 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
W20260207 20:53:28.987972 9950 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.223.61:45057: connect: Connection refused (error 111) [suppressed 7 similar messages]
W20260207 20:53:28.991348 9998 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:45057: Network error: Client connection negotiation failed: client connection to 127.2.223.61:45057: connect: Connection refused (error 111)
I20260207 20:53:28.992199 10011 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:28.992969 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260207 20:53:28.993220 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "29960e03455f4cd7b7ecaa8f531a55b6"
format_stamp: "Formatted at 2026-02-07 20:53:28 on dist-test-slave-kqw4"
I20260207 20:53:28.993453 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:29.018110 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:29.019234 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:29.045846 9998 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } attempt: 1
W20260207 20:53:29.050802 9998 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:45057: Network error: Client connection negotiation failed: client connection to 127.2.223.61:45057: connect: Connection refused (error 111)
I20260207 20:53:29.057149 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:45057
I20260207 20:53:29.057243 10062 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:45057 every 8 connection(s)
I20260207 20:53:29.060879 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:29.061055 10063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260207 20:53:29.066227 10065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:29.067266 10066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:29.069284 10063 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:29.071502 10068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:29.072043 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:29.074891 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:29.075152 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:29.075352 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497609075332 us; error 0 us; skew 500 ppm
I20260207 20:53:29.075961 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:29.078413 2940 webserver.cc:492] Webserver started at http://127.2.223.60:39597/ using document root <none> and password file <none>
I20260207 20:53:29.079038 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:29.079262 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:29.079567 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:29.080993 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "df6374c492a14a89ae9d20a07237ee28"
format_stamp: "Formatted at 2026-02-07 20:53:29 on dist-test-slave-kqw4"
I20260207 20:53:29.083782 10063 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:29.086194 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260207 20:53:29.090131 10075 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:29.091141 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260207 20:53:29.091495 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "df6374c492a14a89ae9d20a07237ee28"
format_stamp: "Formatted at 2026-02-07 20:53:29 on dist-test-slave-kqw4"
I20260207 20:53:29.091856 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:29.096271 10063 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:29.101956 10063 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:45135: Network error: Client connection negotiation failed: client connection to 127.2.223.60:45135: connect: Connection refused (error 111)
I20260207 20:53:29.118265 9998 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } attempt: 2
I20260207 20:53:29.121358 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:29.122506 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:29.127866 9998 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:29.132009 9998 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:45135: Network error: Client connection negotiation failed: client connection to 127.2.223.60:45135: connect: Connection refused (error 111)
I20260207 20:53:29.176179 9998 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } attempt: 1
I20260207 20:53:29.177412 10063 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } attempt: 1
W20260207 20:53:29.187103 9998 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:45135: Network error: Client connection negotiation failed: client connection to 127.2.223.60:45135: connect: Connection refused (error 111)
W20260207 20:53:29.189235 10063 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:45135: Network error: Client connection negotiation failed: client connection to 127.2.223.60:45135: connect: Connection refused (error 111)
I20260207 20:53:29.204226 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:45135
I20260207 20:53:29.204324 10128 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:45135 every 8 connection(s)
I20260207 20:53:29.208222 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:53:29.209307 10129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:29.218652 10129 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:29.221685 9998 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } attempt: 2
I20260207 20:53:29.232966 10129 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:29.235762 10063 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } attempt: 2
I20260207 20:53:29.245168 9998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7: Bootstrap starting.
I20260207 20:53:29.246558 10129 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:29.252817 9998 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:29.258694 9998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7: No bootstrap required, opened a new log
I20260207 20:53:29.261485 10063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6: Bootstrap starting.
I20260207 20:53:29.261289 9998 raft_consensus.cc:359] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } }
I20260207 20:53:29.262053 9998 raft_consensus.cc:385] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:29.262368 9998 raft_consensus.cc:740] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04d7170b7e70481f8b4a3370d10831f7, State: Initialized, Role: FOLLOWER
I20260207 20:53:29.263078 9998 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } }
I20260207 20:53:29.265317 10129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28: Bootstrap starting.
I20260207 20:53:29.266680 10134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } } }
I20260207 20:53:29.267580 10134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:29.268472 9998 sys_catalog.cc:565] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:29.269011 10063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:29.272653 10129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:29.275367 10063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6: No bootstrap required, opened a new log
I20260207 20:53:29.278671 10129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28: No bootstrap required, opened a new log
I20260207 20:53:29.278213 10063 raft_consensus.cc:359] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } }
I20260207 20:53:29.279050 10063 raft_consensus.cc:385] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:29.279413 10063 raft_consensus.cc:740] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29960e03455f4cd7b7ecaa8f531a55b6, State: Initialized, Role: FOLLOWER
I20260207 20:53:29.280382 10063 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } }
I20260207 20:53:29.281874 10129 raft_consensus.cc:359] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } }
I20260207 20:53:29.282703 10129 raft_consensus.cc:385] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:29.283067 10129 raft_consensus.cc:740] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6374c492a14a89ae9d20a07237ee28, State: Initialized, Role: FOLLOWER
I20260207 20:53:29.283450 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:53:29.284137 10129 consensus_queue.cc:260] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } }
I20260207 20:53:29.286751 10149 sys_catalog.cc:455] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } } }
I20260207 20:53:29.287572 10149 sys_catalog.cc:458] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [sys.catalog]: This master's current role is: FOLLOWER
W20260207 20:53:29.287834 10148 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:29.288168 10148 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:29.288640 10129 sys_catalog.cc:565] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:29.289165 10147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } } }
I20260207 20:53:29.289716 10147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:29.291035 10063 sys_catalog.cc:565] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:29.306071 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
W20260207 20:53:29.306365 10167 catalog_manager.cc:1568] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:29.306722 10167 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:29.308455 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:29.310344 10171 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:29.310716 10171 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:53:29.316840 10173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:29.317862 10172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:29.320868 10175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:29.321820 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:29.322664 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:29.322865 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:29.323031 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497609323014 us; error 0 us; skew 500 ppm
I20260207 20:53:29.323542 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:29.325975 2940 webserver.cc:492] Webserver started at http://127.2.223.1:40619/ using document root <none> and password file <none>
I20260207 20:53:29.326436 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:29.326683 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:29.326628 10147 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:29.327186 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:29.327229 10147 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } }
I20260207 20:53:29.328640 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "0ba2df3c03644d6e9e395cb8b703b51b"
format_stamp: "Formatted at 2026-02-07 20:53:29 on dist-test-slave-kqw4"
I20260207 20:53:29.329160 10147 leader_election.cc:290] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04d7170b7e70481f8b4a3370d10831f7 (127.2.223.62:33625), df6374c492a14a89ae9d20a07237ee28 (127.2.223.60:45135)
I20260207 20:53:29.330049 9973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d7170b7e70481f8b4a3370d10831f7" is_pre_election: true
I20260207 20:53:29.330657 10103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6374c492a14a89ae9d20a07237ee28" is_pre_election: true
I20260207 20:53:29.330942 9973 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29960e03455f4cd7b7ecaa8f531a55b6 in term 0.
I20260207 20:53:29.331348 10103 raft_consensus.cc:2468] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29960e03455f4cd7b7ecaa8f531a55b6 in term 0.
I20260207 20:53:29.332257 10014 leader_election.cc:304] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d7170b7e70481f8b4a3370d10831f7, 29960e03455f4cd7b7ecaa8f531a55b6; no voters:
I20260207 20:53:29.333055 10147 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:29.333423 10147 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:29.333730 10147 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:29.334388 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260207 20:53:29.339301 10180 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:29.340230 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260207 20:53:29.340574 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "0ba2df3c03644d6e9e395cb8b703b51b"
format_stamp: "Formatted at 2026-02-07 20:53:29 on dist-test-slave-kqw4"
I20260207 20:53:29.340955 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:29.342285 10147 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } }
I20260207 20:53:29.344208 10147 leader_election.cc:290] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [CANDIDATE]: Term 1 election: Requested vote from peers 04d7170b7e70481f8b4a3370d10831f7 (127.2.223.62:33625), df6374c492a14a89ae9d20a07237ee28 (127.2.223.60:45135)
I20260207 20:53:29.344944 9973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d7170b7e70481f8b4a3370d10831f7"
I20260207 20:53:29.345300 10103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6374c492a14a89ae9d20a07237ee28"
I20260207 20:53:29.345551 9973 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:29.345947 10103 raft_consensus.cc:3060] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:29.352169 9973 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29960e03455f4cd7b7ecaa8f531a55b6 in term 1.
I20260207 20:53:29.353158 10014 leader_election.cc:304] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d7170b7e70481f8b4a3370d10831f7, 29960e03455f4cd7b7ecaa8f531a55b6; no voters:
I20260207 20:53:29.353799 10147 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:29.354212 10103 raft_consensus.cc:2468] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29960e03455f4cd7b7ecaa8f531a55b6 in term 1.
I20260207 20:53:29.355022 10147 raft_consensus.cc:697] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [term 1 LEADER]: Becoming Leader. State: Replica: 29960e03455f4cd7b7ecaa8f531a55b6, State: Running, Role: LEADER
I20260207 20:53:29.355934 10147 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } }
I20260207 20:53:29.360913 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:29.362140 10185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29960e03455f4cd7b7ecaa8f531a55b6. Latest consensus state: current_term: 1 leader_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } } }
I20260207 20:53:29.362679 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:29.362752 10185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:29.364550 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:29.364753 10187 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:53:29.367837 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:29.368155 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:29.368458 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:29.368688 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:29.371614 10187 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:53:29.382266 10103 raft_consensus.cc:1275] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [term 1 FOLLOWER]: Refusing update from remote peer 29960e03455f4cd7b7ecaa8f531a55b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:29.382297 9973 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [term 1 FOLLOWER]: Refusing update from remote peer 29960e03455f4cd7b7ecaa8f531a55b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:29.384083 10147 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:29.384987 10185 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:29.399299 10134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29960e03455f4cd7b7ecaa8f531a55b6. Latest consensus state: current_term: 1 leader_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } } }
I20260207 20:53:29.400094 10134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:29.406502 10185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } } }
I20260207 20:53:29.407104 10185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:29.408299 10187 catalog_manager.cc:1357] Generated new cluster ID: 6f3397a72d9644239ec607f4d863a166
I20260207 20:53:29.408619 10187 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:53:29.423748 10149 sys_catalog.cc:455] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29960e03455f4cd7b7ecaa8f531a55b6. Latest consensus state: current_term: 1 leader_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } } }
I20260207 20:53:29.424612 10149 sys_catalog.cc:458] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:29.432186 10185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } } }
I20260207 20:53:29.433010 10185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:29.434882 10134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } } }
I20260207 20:53:29.435650 10134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:29.438580 10149 sys_catalog.cc:455] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d7170b7e70481f8b4a3370d10831f7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 33625 } } peers { permanent_uuid: "29960e03455f4cd7b7ecaa8f531a55b6" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 45057 } } peers { permanent_uuid: "df6374c492a14a89ae9d20a07237ee28" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 45135 } } }
I20260207 20:53:29.439312 10149 sys_catalog.cc:458] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:29.458034 10187 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:53:29.459957 10187 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:53:29.471655 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:39675
I20260207 20:53:29.472029 10254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:39675 every 8 connection(s)
I20260207 20:53:29.488082 10187 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6: Generated new TSK 0
I20260207 20:53:29.488920 10187 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:53:29.509719 10255 heartbeater.cc:344] Connected to a master server at 127.2.223.60:45135
I20260207 20:53:29.510308 10255 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:29.512356 10255 heartbeater.cc:507] Master 127.2.223.60:45135 requested a full tablet report, sending...
I20260207 20:53:29.512575 10256 heartbeater.cc:344] Connected to a master server at 127.2.223.61:45057
I20260207 20:53:29.513046 10256 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:29.513921 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:29.513995 10256 heartbeater.cc:507] Master 127.2.223.61:45057 requested a full tablet report, sending...
I20260207 20:53:29.516477 10093 ts_manager.cc:194] Registered new tserver with Master: 0ba2df3c03644d6e9e395cb8b703b51b (127.2.223.1:39675)
I20260207 20:53:29.516667 10028 ts_manager.cc:194] Registered new tserver with Master: 0ba2df3c03644d6e9e395cb8b703b51b (127.2.223.1:39675)
I20260207 20:53:29.519412 10028 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60426
I20260207 20:53:29.521883 10258 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33625
I20260207 20:53:29.522398 10258 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:29.523334 10258 heartbeater.cc:507] Master 127.2.223.62:33625 requested a full tablet report, sending...
W20260207 20:53:29.525240 10262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:29.526432 9963 ts_manager.cc:194] Registered new tserver with Master: 0ba2df3c03644d6e9e395cb8b703b51b (127.2.223.1:39675)
W20260207 20:53:29.528918 10263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:29.530467 10265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:29.531213 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:29.532117 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:29.532367 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:29.532553 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497609532536 us; error 0 us; skew 500 ppm
I20260207 20:53:29.532908 10256 heartbeater.cc:499] Master 127.2.223.61:45057 was elected leader, sending a full tablet report...
I20260207 20:53:29.533069 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:29.535810 2940 webserver.cc:492] Webserver started at http://127.2.223.2:34093/ using document root <none> and password file <none>
I20260207 20:53:29.536265 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:29.536445 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:29.536674 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:29.537771 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "d15241a5ccf24545b175518887236150"
format_stamp: "Formatted at 2026-02-07 20:53:29 on dist-test-slave-kqw4"
I20260207 20:53:29.542717 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260207 20:53:29.546428 10270 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:29.547226 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:53:29.547572 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "d15241a5ccf24545b175518887236150"
format_stamp: "Formatted at 2026-02-07 20:53:29 on dist-test-slave-kqw4"
I20260207 20:53:29.547899 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:29.566022 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:29.567507 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:29.568971 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:29.571522 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:29.571704 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:29.571962 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:29.572108 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:29.622382 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:42109
I20260207 20:53:29.622479 10332 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:42109 every 8 connection(s)
I20260207 20:53:29.642000 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:29.645124 10333 heartbeater.cc:344] Connected to a master server at 127.2.223.60:45135
I20260207 20:53:29.645509 10333 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:29.646410 10333 heartbeater.cc:507] Master 127.2.223.60:45135 requested a full tablet report, sending...
I20260207 20:53:29.649729 10092 ts_manager.cc:194] Registered new tserver with Master: d15241a5ccf24545b175518887236150 (127.2.223.2:42109)
I20260207 20:53:29.660115 10335 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33625
I20260207 20:53:29.660918 10335 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:29.661881 10335 heartbeater.cc:507] Master 127.2.223.62:33625 requested a full tablet report, sending...
I20260207 20:53:29.664651 9963 ts_manager.cc:194] Registered new tserver with Master: d15241a5ccf24545b175518887236150 (127.2.223.2:42109)
I20260207 20:53:29.665802 10334 heartbeater.cc:344] Connected to a master server at 127.2.223.61:45057
I20260207 20:53:29.666195 10334 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:29.667083 10334 heartbeater.cc:507] Master 127.2.223.61:45057 requested a full tablet report, sending...
W20260207 20:53:29.667266 10340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:29.669049 10341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:29.670419 10027 ts_manager.cc:194] Registered new tserver with Master: d15241a5ccf24545b175518887236150 (127.2.223.2:42109)
I20260207 20:53:29.671945 10027 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60440
W20260207 20:53:29.675052 10343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:29.676156 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:29.677068 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:29.677282 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:29.677460 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497609677442 us; error 0 us; skew 500 ppm
I20260207 20:53:29.677982 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:29.681315 2940 webserver.cc:492] Webserver started at http://127.2.223.3:41095/ using document root <none> and password file <none>
I20260207 20:53:29.681993 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:29.682212 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:29.682493 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:29.684202 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "b5b1c4fc6cac4c8abe1590470f391022"
format_stamp: "Formatted at 2026-02-07 20:53:29 on dist-test-slave-kqw4"
I20260207 20:53:29.684635 10334 heartbeater.cc:499] Master 127.2.223.61:45057 was elected leader, sending a full tablet report...
I20260207 20:53:29.689183 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:53:29.693437 10348 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:29.694342 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260207 20:53:29.694839 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "b5b1c4fc6cac4c8abe1590470f391022"
format_stamp: "Formatted at 2026-02-07 20:53:29 on dist-test-slave-kqw4"
I20260207 20:53:29.695320 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:29.730014 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:29.731199 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:29.740394 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:29.743036 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:29.743295 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:29.743573 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:29.743758 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:29.805238 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:36089
I20260207 20:53:29.805339 10410 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:36089 every 8 connection(s)
I20260207 20:53:29.837625 10411 heartbeater.cc:344] Connected to a master server at 127.2.223.60:45135
I20260207 20:53:29.838023 10411 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:29.838898 10411 heartbeater.cc:507] Master 127.2.223.60:45135 requested a full tablet report, sending...
I20260207 20:53:29.842438 10092 ts_manager.cc:194] Registered new tserver with Master: b5b1c4fc6cac4c8abe1590470f391022 (127.2.223.3:36089)
I20260207 20:53:29.846170 10412 heartbeater.cc:344] Connected to a master server at 127.2.223.61:45057
I20260207 20:53:29.846560 10412 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:29.846663 10413 heartbeater.cc:344] Connected to a master server at 127.2.223.62:33625
I20260207 20:53:29.847107 10413 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:29.847405 10412 heartbeater.cc:507] Master 127.2.223.61:45057 requested a full tablet report, sending...
I20260207 20:53:29.847783 10413 heartbeater.cc:507] Master 127.2.223.62:33625 requested a full tablet report, sending...
I20260207 20:53:29.849459 10028 ts_manager.cc:194] Registered new tserver with Master: b5b1c4fc6cac4c8abe1590470f391022 (127.2.223.3:36089)
I20260207 20:53:29.850136 9963 ts_manager.cc:194] Registered new tserver with Master: b5b1c4fc6cac4c8abe1590470f391022 (127.2.223.3:36089)
I20260207 20:53:29.850545 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.025313203s
I20260207 20:53:29.851315 10028 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60450
I20260207 20:53:29.864240 10412 heartbeater.cc:499] Master 127.2.223.61:45057 was elected leader, sending a full tablet report...
I20260207 20:53:29.913162 10027 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60464:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:53:29.917482 10027 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:53:30.026978 10218 tablet_service.cc:1505] Processing CreateTablet for tablet 3912c85ca7be4dd4ab01773129f7155b (DEFAULT_TABLE table=ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:30.028211 10218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3912c85ca7be4dd4ab01773129f7155b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:30.034823 10216 tablet_service.cc:1505] Processing CreateTablet for tablet 9882ec51f4704e2ba6de28f834b35ac8 (DEFAULT_TABLE table=ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:30.035804 10216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9882ec51f4704e2ba6de28f834b35ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:30.031487 10217 tablet_service.cc:1505] Processing CreateTablet for tablet 9f2c862d5de141a8b3147359bb72edc4 (DEFAULT_TABLE table=ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:30.042263 10217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f2c862d5de141a8b3147359bb72edc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:30.068394 10298 tablet_service.cc:1505] Processing CreateTablet for tablet 3912c85ca7be4dd4ab01773129f7155b (DEFAULT_TABLE table=ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:30.069718 10298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3912c85ca7be4dd4ab01773129f7155b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:30.076320 10297 tablet_service.cc:1505] Processing CreateTablet for tablet 9f2c862d5de141a8b3147359bb72edc4 (DEFAULT_TABLE table=ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:30.077780 10297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f2c862d5de141a8b3147359bb72edc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:30.095744 10296 tablet_service.cc:1505] Processing CreateTablet for tablet 9882ec51f4704e2ba6de28f834b35ac8 (DEFAULT_TABLE table=ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:30.097152 10296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9882ec51f4704e2ba6de28f834b35ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:30.110141 10376 tablet_service.cc:1505] Processing CreateTablet for tablet 3912c85ca7be4dd4ab01773129f7155b (DEFAULT_TABLE table=ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:30.112208 10376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3912c85ca7be4dd4ab01773129f7155b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:30.112221 10374 tablet_service.cc:1505] Processing CreateTablet for tablet 9882ec51f4704e2ba6de28f834b35ac8 (DEFAULT_TABLE table=ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:30.114935 10432 tablet_bootstrap.cc:492] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b: Bootstrap starting.
I20260207 20:53:30.111878 10375 tablet_service.cc:1505] Processing CreateTablet for tablet 9f2c862d5de141a8b3147359bb72edc4 (DEFAULT_TABLE table=ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:30.126580 10374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9882ec51f4704e2ba6de28f834b35ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:30.131417 10432 tablet_bootstrap.cc:654] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:30.134992 10375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f2c862d5de141a8b3147359bb72edc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:30.139298 10432 tablet_bootstrap.cc:492] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b: No bootstrap required, opened a new log
I20260207 20:53:30.139793 10432 ts_tablet_manager.cc:1403] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.005s
I20260207 20:53:30.140641 10433 tablet_bootstrap.cc:492] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150: Bootstrap starting.
I20260207 20:53:30.142634 10432 raft_consensus.cc:359] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.143453 10432 raft_consensus.cc:385] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:30.143743 10432 raft_consensus.cc:740] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba2df3c03644d6e9e395cb8b703b51b, State: Initialized, Role: FOLLOWER
I20260207 20:53:30.144718 10432 consensus_queue.cc:260] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.148577 10433 tablet_bootstrap.cc:654] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:30.150436 10432 ts_tablet_manager.cc:1434] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260207 20:53:30.151605 10432 tablet_bootstrap.cc:492] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b: Bootstrap starting.
I20260207 20:53:30.199188 10433 tablet_bootstrap.cc:492] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150: No bootstrap required, opened a new log
I20260207 20:53:30.199746 10433 ts_tablet_manager.cc:1403] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.016s
I20260207 20:53:30.203325 10433 raft_consensus.cc:359] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.204039 10433 raft_consensus.cc:385] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:30.204327 10433 raft_consensus.cc:740] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d15241a5ccf24545b175518887236150, State: Initialized, Role: FOLLOWER
I20260207 20:53:30.205041 10433 consensus_queue.cc:260] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.212095 10432 tablet_bootstrap.cc:654] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:30.213376 10437 tablet_bootstrap.cc:492] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022: Bootstrap starting.
I20260207 20:53:30.220571 10433 ts_tablet_manager.cc:1434] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150: Time spent starting tablet: real 0.021s user 0.006s sys 0.004s
I20260207 20:53:30.223462 10433 tablet_bootstrap.cc:492] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150: Bootstrap starting.
I20260207 20:53:30.229744 10433 tablet_bootstrap.cc:654] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:30.245158 10437 tablet_bootstrap.cc:654] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:30.260854 10432 tablet_bootstrap.cc:492] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b: No bootstrap required, opened a new log
I20260207 20:53:30.261507 10432 ts_tablet_manager.cc:1403] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b: Time spent bootstrapping tablet: real 0.110s user 0.010s sys 0.007s
I20260207 20:53:30.263830 10433 tablet_bootstrap.cc:492] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150: No bootstrap required, opened a new log
I20260207 20:53:30.264356 10433 ts_tablet_manager.cc:1403] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150: Time spent bootstrapping tablet: real 0.041s user 0.020s sys 0.009s
I20260207 20:53:30.267405 10433 raft_consensus.cc:359] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.268144 10433 raft_consensus.cc:385] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:30.264948 10432 raft_consensus.cc:359] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.269001 10432 raft_consensus.cc:385] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:30.269304 10432 raft_consensus.cc:740] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba2df3c03644d6e9e395cb8b703b51b, State: Initialized, Role: FOLLOWER
I20260207 20:53:30.272294 10432 consensus_queue.cc:260] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.268426 10433 raft_consensus.cc:740] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d15241a5ccf24545b175518887236150, State: Initialized, Role: FOLLOWER
I20260207 20:53:30.274248 10433 consensus_queue.cc:260] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.277148 10433 ts_tablet_manager.cc:1434] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150: Time spent starting tablet: real 0.012s user 0.009s sys 0.000s
I20260207 20:53:30.278163 10433 tablet_bootstrap.cc:492] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150: Bootstrap starting.
I20260207 20:53:30.288367 10433 tablet_bootstrap.cc:654] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:30.293613 10148 catalog_manager.cc:1269] Loaded cluster ID: 6f3397a72d9644239ec607f4d863a166
I20260207 20:53:30.296128 10148 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7: loading cluster ID for follower catalog manager: success
I20260207 20:53:30.307540 10432 ts_tablet_manager.cc:1434] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b: Time spent starting tablet: real 0.046s user 0.006s sys 0.001s
I20260207 20:53:30.310546 10148 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7: acquiring CA information for follower catalog manager: success
I20260207 20:53:30.311926 10167 catalog_manager.cc:1269] Loaded cluster ID: 6f3397a72d9644239ec607f4d863a166
I20260207 20:53:30.312253 10167 catalog_manager.cc:1562] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28: loading cluster ID for follower catalog manager: success
I20260207 20:53:30.314869 10433 tablet_bootstrap.cc:492] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150: No bootstrap required, opened a new log
I20260207 20:53:30.315392 10433 ts_tablet_manager.cc:1403] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150: Time spent bootstrapping tablet: real 0.037s user 0.008s sys 0.009s
I20260207 20:53:30.318312 10433 raft_consensus.cc:359] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.318995 10432 tablet_bootstrap.cc:492] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b: Bootstrap starting.
I20260207 20:53:30.323534 10167 catalog_manager.cc:1584] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28: acquiring CA information for follower catalog manager: success
I20260207 20:53:30.319020 10433 raft_consensus.cc:385] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:30.326725 10433 raft_consensus.cc:740] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d15241a5ccf24545b175518887236150, State: Initialized, Role: FOLLOWER
I20260207 20:53:30.327528 10433 consensus_queue.cc:260] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.329537 10432 tablet_bootstrap.cc:654] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:30.331025 10437 tablet_bootstrap.cc:492] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022: No bootstrap required, opened a new log
I20260207 20:53:30.331598 10437 ts_tablet_manager.cc:1403] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022: Time spent bootstrapping tablet: real 0.118s user 0.009s sys 0.012s
I20260207 20:53:30.334739 10438 raft_consensus.cc:493] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:30.335382 10433 ts_tablet_manager.cc:1434] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150: Time spent starting tablet: real 0.020s user 0.004s sys 0.003s
I20260207 20:53:30.337838 10148 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:30.335268 10438 raft_consensus.cc:515] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.344913 10438 leader_election.cc:290] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ba2df3c03644d6e9e395cb8b703b51b (127.2.223.1:39675), b5b1c4fc6cac4c8abe1590470f391022 (127.2.223.3:36089)
I20260207 20:53:30.355424 10167 catalog_manager.cc:1612] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:30.356601 10437 raft_consensus.cc:359] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.362850 10437 raft_consensus.cc:385] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:30.363595 10437 raft_consensus.cc:740] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5b1c4fc6cac4c8abe1590470f391022, State: Initialized, Role: FOLLOWER
I20260207 20:53:30.364408 10437 consensus_queue.cc:260] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.365689 10432 tablet_bootstrap.cc:492] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b: No bootstrap required, opened a new log
I20260207 20:53:30.366272 10432 ts_tablet_manager.cc:1403] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b: Time spent bootstrapping tablet: real 0.048s user 0.014s sys 0.008s
I20260207 20:53:30.369273 10432 raft_consensus.cc:359] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.370064 10432 raft_consensus.cc:385] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:30.370348 10432 raft_consensus.cc:740] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba2df3c03644d6e9e395cb8b703b51b, State: Initialized, Role: FOLLOWER
I20260207 20:53:30.371089 10432 consensus_queue.cc:260] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.374440 10432 ts_tablet_manager.cc:1434] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260207 20:53:30.383252 10437 ts_tablet_manager.cc:1434] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022: Time spent starting tablet: real 0.051s user 0.009s sys 0.004s
I20260207 20:53:30.392104 10437 tablet_bootstrap.cc:492] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022: Bootstrap starting.
I20260207 20:53:30.409246 10437 tablet_bootstrap.cc:654] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:30.419626 10228 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3912c85ca7be4dd4ab01773129f7155b" candidate_uuid: "d15241a5ccf24545b175518887236150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" is_pre_election: true
I20260207 20:53:30.421523 10386 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3912c85ca7be4dd4ab01773129f7155b" candidate_uuid: "d15241a5ccf24545b175518887236150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5b1c4fc6cac4c8abe1590470f391022" is_pre_election: true
I20260207 20:53:30.421823 10228 raft_consensus.cc:2468] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d15241a5ccf24545b175518887236150 in term 0.
I20260207 20:53:30.423069 10274 leader_election.cc:304] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba2df3c03644d6e9e395cb8b703b51b, d15241a5ccf24545b175518887236150; no voters:
I20260207 20:53:30.423848 10438 raft_consensus.cc:2804] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260207 20:53:30.423941 10274 leader_election.cc:343] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5b1c4fc6cac4c8abe1590470f391022 (127.2.223.3:36089): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:53:30.424289 10438 raft_consensus.cc:493] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:30.424664 10438 raft_consensus.cc:3060] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:30.431034 10438 raft_consensus.cc:515] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.435372 10438 leader_election.cc:290] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [CANDIDATE]: Term 1 election: Requested vote from peers 0ba2df3c03644d6e9e395cb8b703b51b (127.2.223.1:39675), b5b1c4fc6cac4c8abe1590470f391022 (127.2.223.3:36089)
I20260207 20:53:30.438726 10228 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3912c85ca7be4dd4ab01773129f7155b" candidate_uuid: "d15241a5ccf24545b175518887236150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba2df3c03644d6e9e395cb8b703b51b"
I20260207 20:53:30.439357 10228 raft_consensus.cc:3060] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:30.439805 10386 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3912c85ca7be4dd4ab01773129f7155b" candidate_uuid: "d15241a5ccf24545b175518887236150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5b1c4fc6cac4c8abe1590470f391022"
I20260207 20:53:30.444371 10445 raft_consensus.cc:493] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:30.444864 10445 raft_consensus.cc:515] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.446385 10228 raft_consensus.cc:2468] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d15241a5ccf24545b175518887236150 in term 1.
I20260207 20:53:30.449434 10437 tablet_bootstrap.cc:492] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022: No bootstrap required, opened a new log
I20260207 20:53:30.450011 10437 ts_tablet_manager.cc:1403] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022: Time spent bootstrapping tablet: real 0.058s user 0.009s sys 0.006s
I20260207 20:53:30.453047 10437 raft_consensus.cc:359] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.455000 10437 raft_consensus.cc:385] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:30.455312 10437 raft_consensus.cc:740] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5b1c4fc6cac4c8abe1590470f391022, State: Initialized, Role: FOLLOWER
I20260207 20:53:30.458022 10437 consensus_queue.cc:260] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.467119 10445 leader_election.cc:290] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ba2df3c03644d6e9e395cb8b703b51b (127.2.223.1:39675), d15241a5ccf24545b175518887236150 (127.2.223.2:42109)
W20260207 20:53:30.472035 10274 leader_election.cc:343] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5b1c4fc6cac4c8abe1590470f391022 (127.2.223.3:36089): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:53:30.472833 10274 leader_election.cc:304] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ba2df3c03644d6e9e395cb8b703b51b, d15241a5ccf24545b175518887236150; no voters: b5b1c4fc6cac4c8abe1590470f391022
I20260207 20:53:30.473747 10438 raft_consensus.cc:2804] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:30.496866 10438 raft_consensus.cc:697] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [term 1 LEADER]: Becoming Leader. State: Replica: d15241a5ccf24545b175518887236150, State: Running, Role: LEADER
I20260207 20:53:30.497766 10438 consensus_queue.cc:237] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.520531 10025 catalog_manager.cc:5654] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 reported cstate change: term changed from 0 to 1, leader changed from <none> to d15241a5ccf24545b175518887236150 (127.2.223.2). New cstate: current_term: 1 leader_uuid: "d15241a5ccf24545b175518887236150" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } health_report { overall_health: UNKNOWN } } }
I20260207 20:53:30.546111 10228 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9882ec51f4704e2ba6de28f834b35ac8" candidate_uuid: "b5b1c4fc6cac4c8abe1590470f391022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" is_pre_election: true
I20260207 20:53:30.546808 10228 raft_consensus.cc:2468] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5b1c4fc6cac4c8abe1590470f391022 in term 0.
I20260207 20:53:30.548178 10308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9882ec51f4704e2ba6de28f834b35ac8" candidate_uuid: "b5b1c4fc6cac4c8abe1590470f391022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d15241a5ccf24545b175518887236150" is_pre_election: true
I20260207 20:53:30.548830 10308 raft_consensus.cc:2468] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5b1c4fc6cac4c8abe1590470f391022 in term 0.
I20260207 20:53:30.549865 10352 leader_election.cc:304] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba2df3c03644d6e9e395cb8b703b51b, b5b1c4fc6cac4c8abe1590470f391022; no voters:
I20260207 20:53:30.552119 10437 ts_tablet_manager.cc:1434] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022: Time spent starting tablet: real 0.102s user 0.037s sys 0.050s
I20260207 20:53:30.553282 10437 tablet_bootstrap.cc:492] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022: Bootstrap starting.
I20260207 20:53:30.557906 10450 raft_consensus.cc:2804] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:30.558372 10450 raft_consensus.cc:493] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:30.558728 10450 raft_consensus.cc:3060] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:30.561980 10437 tablet_bootstrap.cc:654] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:30.587078 10450 raft_consensus.cc:515] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.600124 10437 tablet_bootstrap.cc:492] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022: No bootstrap required, opened a new log
I20260207 20:53:30.600164 10228 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9882ec51f4704e2ba6de28f834b35ac8" candidate_uuid: "b5b1c4fc6cac4c8abe1590470f391022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba2df3c03644d6e9e395cb8b703b51b"
I20260207 20:53:30.600872 10437 ts_tablet_manager.cc:1403] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022: Time spent bootstrapping tablet: real 0.048s user 0.007s sys 0.007s
I20260207 20:53:30.600924 10228 raft_consensus.cc:3060] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:30.603901 10437 raft_consensus.cc:359] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.604656 10437 raft_consensus.cc:385] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:30.604941 10437 raft_consensus.cc:740] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5b1c4fc6cac4c8abe1590470f391022, State: Initialized, Role: FOLLOWER
I20260207 20:53:30.605720 10437 consensus_queue.cc:260] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.609169 10437 ts_tablet_manager.cc:1434] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260207 20:53:30.611802 10228 raft_consensus.cc:2468] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5b1c4fc6cac4c8abe1590470f391022 in term 1.
I20260207 20:53:30.613329 10352 leader_election.cc:304] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba2df3c03644d6e9e395cb8b703b51b, b5b1c4fc6cac4c8abe1590470f391022; no voters:
I20260207 20:53:30.614285 10445 raft_consensus.cc:2804] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:30.629244 10450 leader_election.cc:290] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [CANDIDATE]: Term 1 election: Requested vote from peers 0ba2df3c03644d6e9e395cb8b703b51b (127.2.223.1:39675), d15241a5ccf24545b175518887236150 (127.2.223.2:42109)
I20260207 20:53:30.630432 10308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9882ec51f4704e2ba6de28f834b35ac8" candidate_uuid: "b5b1c4fc6cac4c8abe1590470f391022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d15241a5ccf24545b175518887236150"
I20260207 20:53:30.631930 10308 raft_consensus.cc:3060] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:30.635298 10445 raft_consensus.cc:697] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [term 1 LEADER]: Becoming Leader. State: Replica: b5b1c4fc6cac4c8abe1590470f391022, State: Running, Role: LEADER
I20260207 20:53:30.636358 10445 consensus_queue.cc:237] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.642078 10308 raft_consensus.cc:2468] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5b1c4fc6cac4c8abe1590470f391022 in term 1.
I20260207 20:53:30.644721 10438 raft_consensus.cc:493] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:30.645282 10438 raft_consensus.cc:515] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.647431 10438 leader_election.cc:290] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ba2df3c03644d6e9e395cb8b703b51b (127.2.223.1:39675), b5b1c4fc6cac4c8abe1590470f391022 (127.2.223.3:36089)
I20260207 20:53:30.650230 10228 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f2c862d5de141a8b3147359bb72edc4" candidate_uuid: "d15241a5ccf24545b175518887236150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" is_pre_election: true
I20260207 20:53:30.650959 10228 raft_consensus.cc:2468] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d15241a5ccf24545b175518887236150 in term 0.
I20260207 20:53:30.651908 10386 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f2c862d5de141a8b3147359bb72edc4" candidate_uuid: "d15241a5ccf24545b175518887236150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5b1c4fc6cac4c8abe1590470f391022" is_pre_election: true
I20260207 20:53:30.652587 10386 raft_consensus.cc:2468] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d15241a5ccf24545b175518887236150 in term 0.
I20260207 20:53:30.654381 10274 leader_election.cc:304] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5b1c4fc6cac4c8abe1590470f391022, d15241a5ccf24545b175518887236150; no voters:
I20260207 20:53:30.655265 10438 raft_consensus.cc:2804] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:30.655704 10438 raft_consensus.cc:493] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:30.656042 10438 raft_consensus.cc:3060] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:30.668288 10438 raft_consensus.cc:515] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.671581 10438 leader_election.cc:290] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [CANDIDATE]: Term 1 election: Requested vote from peers 0ba2df3c03644d6e9e395cb8b703b51b (127.2.223.1:39675), b5b1c4fc6cac4c8abe1590470f391022 (127.2.223.3:36089)
I20260207 20:53:30.672277 10228 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f2c862d5de141a8b3147359bb72edc4" candidate_uuid: "d15241a5ccf24545b175518887236150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba2df3c03644d6e9e395cb8b703b51b"
I20260207 20:53:30.672967 10228 raft_consensus.cc:3060] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:30.674999 10386 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f2c862d5de141a8b3147359bb72edc4" candidate_uuid: "d15241a5ccf24545b175518887236150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5b1c4fc6cac4c8abe1590470f391022"
I20260207 20:53:30.675693 10386 raft_consensus.cc:3060] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Advancing to term 1
W20260207 20:53:30.689219 10014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.223.62:33625, user_credentials={real_user=slave}} blocked reactor thread for 96342.2us
I20260207 20:53:30.691963 10228 raft_consensus.cc:2468] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d15241a5ccf24545b175518887236150 in term 1.
I20260207 20:53:30.693233 10274 leader_election.cc:304] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba2df3c03644d6e9e395cb8b703b51b, d15241a5ccf24545b175518887236150; no voters:
I20260207 20:53:30.694168 10438 raft_consensus.cc:2804] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:30.694728 10438 raft_consensus.cc:697] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [term 1 LEADER]: Becoming Leader. State: Replica: d15241a5ccf24545b175518887236150, State: Running, Role: LEADER
I20260207 20:53:30.695611 10438 consensus_queue.cc:237] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.702505 10386 raft_consensus.cc:2468] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d15241a5ccf24545b175518887236150 in term 1.
W20260207 20:53:30.715912 10015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.223.60:45135, user_credentials={real_user=slave}} blocked reactor thread for 122360us
I20260207 20:53:30.731174 10026 catalog_manager.cc:5654] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 reported cstate change: term changed from 0 to 1, leader changed from <none> to d15241a5ccf24545b175518887236150 (127.2.223.2). New cstate: current_term: 1 leader_uuid: "d15241a5ccf24545b175518887236150" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } health_report { overall_health: UNKNOWN } } }
I20260207 20:53:30.728384 10025 catalog_manager.cc:5654] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5b1c4fc6cac4c8abe1590470f391022 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "b5b1c4fc6cac4c8abe1590470f391022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:30.861917 10445 raft_consensus.cc:493] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:30.862401 10025 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60464:
table { table_name: "ksck-test-table" } modify_external_catalogs: true
I20260207 20:53:30.862483 10445 raft_consensus.cc:515] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39675 } } peers { permanent_uuid: "d15241a5ccf24545b175518887236150" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42109 } } peers { permanent_uuid: "b5b1c4fc6cac4c8abe1590470f391022" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36089 } }
I20260207 20:53:30.863292 10025 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60464:
table { table_name: "ksck-test-table" } modify_external_catalogs: true
I20260207 20:53:30.864642 10445 leader_election.cc:290] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ba2df3c03644d6e9e395cb8b703b51b (127.2.223.1:39675), d15241a5ccf24545b175518887236150 (127.2.223.2:42109)
I20260207 20:53:30.867815 10228 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3912c85ca7be4dd4ab01773129f7155b" candidate_uuid: "b5b1c4fc6cac4c8abe1590470f391022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba2df3c03644d6e9e395cb8b703b51b" is_pre_election: true
I20260207 20:53:30.868369 10308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3912c85ca7be4dd4ab01773129f7155b" candidate_uuid: "b5b1c4fc6cac4c8abe1590470f391022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d15241a5ccf24545b175518887236150" is_pre_election: true
I20260207 20:53:30.868579 10228 raft_consensus.cc:2393] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5b1c4fc6cac4c8abe1590470f391022 in current term 1: Already voted for candidate d15241a5ccf24545b175518887236150 in this term.
I20260207 20:53:30.871549 10352 leader_election.cc:304] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5b1c4fc6cac4c8abe1590470f391022; no voters: 0ba2df3c03644d6e9e395cb8b703b51b, d15241a5ccf24545b175518887236150
I20260207 20:53:30.872975 10445 raft_consensus.cc:3060] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:30.883939 10445 raft_consensus.cc:2749] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:53:30.898952 10025 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6: Sending DeleteTablet for 3 replicas of tablet 3912c85ca7be4dd4ab01773129f7155b
I20260207 20:53:30.901062 10025 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6: Sending DeleteTablet for 3 replicas of tablet 9f2c862d5de141a8b3147359bb72edc4
I20260207 20:53:30.901561 10297 tablet_service.cc:1552] Processing DeleteTablet for tablet 3912c85ca7be4dd4ab01773129f7155b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-07 20:53:30 UTC) from {username='slave'} at 127.0.0.1:37944
I20260207 20:53:30.902876 10217 tablet_service.cc:1552] Processing DeleteTablet for tablet 3912c85ca7be4dd4ab01773129f7155b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-07 20:53:30 UTC) from {username='slave'} at 127.0.0.1:39292
I20260207 20:53:30.904212 10296 tablet_service.cc:1552] Processing DeleteTablet for tablet 9f2c862d5de141a8b3147359bb72edc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-07 20:53:30 UTC) from {username='slave'} at 127.0.0.1:37944
I20260207 20:53:30.904347 10376 tablet_service.cc:1552] Processing DeleteTablet for tablet 3912c85ca7be4dd4ab01773129f7155b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-07 20:53:30 UTC) from {username='slave'} at 127.0.0.1:48126
I20260207 20:53:30.905566 10025 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6: Sending DeleteTablet for 3 replicas of tablet 9882ec51f4704e2ba6de28f834b35ac8
I20260207 20:53:30.907585 10374 tablet_service.cc:1552] Processing DeleteTablet for tablet 9f2c862d5de141a8b3147359bb72edc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-07 20:53:30 UTC) from {username='slave'} at 127.0.0.1:48126
I20260207 20:53:30.908018 10296 tablet_service.cc:1552] Processing DeleteTablet for tablet 9882ec51f4704e2ba6de28f834b35ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-07 20:53:30 UTC) from {username='slave'} at 127.0.0.1:37944
I20260207 20:53:30.910655 10374 tablet_service.cc:1552] Processing DeleteTablet for tablet 9882ec51f4704e2ba6de28f834b35ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-07 20:53:30 UTC) from {username='slave'} at 127.0.0.1:48126
I20260207 20:53:30.911381 10216 tablet_service.cc:1552] Processing DeleteTablet for tablet 9f2c862d5de141a8b3147359bb72edc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-07 20:53:30 UTC) from {username='slave'} at 127.0.0.1:39292
I20260207 20:53:30.912662 10216 tablet_service.cc:1552] Processing DeleteTablet for tablet 9882ec51f4704e2ba6de28f834b35ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-02-07 20:53:30 UTC) from {username='slave'} at 127.0.0.1:39292
I20260207 20:53:30.941658 10474 tablet_replica.cc:333] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150: stopping tablet replica
I20260207 20:53:30.947602 10476 tablet_replica.cc:333] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022: stopping tablet replica
I20260207 20:53:30.948810 10475 tablet_replica.cc:333] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b: stopping tablet replica
I20260207 20:53:30.964910 10475 raft_consensus.cc:2243] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260207 20:53:30.961457 10274 consensus_peers.cc:597] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 -> Peer b5b1c4fc6cac4c8abe1590470f391022 (127.2.223.3:36089): Couldn't send request to peer b5b1c4fc6cac4c8abe1590470f391022. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:30.963807 10476 raft_consensus.cc:2243] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:30.967447 10476 raft_consensus.cc:2272] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:30.949760 10474 raft_consensus.cc:2243] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:30.968972 10474 pending_rounds.cc:70] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150: Trying to abort 1 pending ops.
I20260207 20:53:30.969810 10474 pending_rounds.cc:77] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7251958212611796992 op_type: NO_OP noop_request { }
I20260207 20:53:30.969457 10475 raft_consensus.cc:2272] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:30.970357 10474 raft_consensus.cc:2889] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260207 20:53:30.979914 10474 raft_consensus.cc:2272] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:30.984053 10474 ts_tablet_manager.cc:1916] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:53:30.985443 10476 ts_tablet_manager.cc:1916] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:53:30.997099 10475 ts_tablet_manager.cc:1916] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:53:31.044764 10475 ts_tablet_manager.cc:1929] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260207 20:53:31.045248 10475 log.cc:1199] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-0-root/wals/3912c85ca7be4dd4ab01773129f7155b
I20260207 20:53:31.054284 10475 ts_tablet_manager.cc:1950] T 3912c85ca7be4dd4ab01773129f7155b P 0ba2df3c03644d6e9e395cb8b703b51b: Deleting consensus metadata
I20260207 20:53:31.058665 10476 ts_tablet_manager.cc:1929] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260207 20:53:31.059123 10476 log.cc:1199] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-2-root/wals/3912c85ca7be4dd4ab01773129f7155b
I20260207 20:53:31.059631 10476 ts_tablet_manager.cc:1950] T 3912c85ca7be4dd4ab01773129f7155b P b5b1c4fc6cac4c8abe1590470f391022: Deleting consensus metadata
I20260207 20:53:31.060348 10015 catalog_manager.cc:4985] TS 0ba2df3c03644d6e9e395cb8b703b51b (127.2.223.1:39675): tablet 3912c85ca7be4dd4ab01773129f7155b (table ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]) successfully deleted
I20260207 20:53:31.061429 10475 tablet_replica.cc:333] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b: stopping tablet replica
I20260207 20:53:31.062424 10475 raft_consensus.cc:2243] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:31.062527 10015 catalog_manager.cc:4985] TS b5b1c4fc6cac4c8abe1590470f391022 (127.2.223.3:36089): tablet 3912c85ca7be4dd4ab01773129f7155b (table ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]) successfully deleted
I20260207 20:53:31.063090 10475 raft_consensus.cc:2272] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:31.074644 10475 ts_tablet_manager.cc:1916] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:53:31.071471 10474 ts_tablet_manager.cc:1929] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260207 20:53:31.077371 10474 log.cc:1199] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-1-root/wals/3912c85ca7be4dd4ab01773129f7155b
I20260207 20:53:31.078130 10474 ts_tablet_manager.cc:1950] T 3912c85ca7be4dd4ab01773129f7155b P d15241a5ccf24545b175518887236150: Deleting consensus metadata
I20260207 20:53:31.065675 10476 tablet_replica.cc:333] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022: stopping tablet replica
I20260207 20:53:31.081068 10474 tablet_replica.cc:333] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150: stopping tablet replica
I20260207 20:53:31.081282 10476 raft_consensus.cc:2243] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:31.081868 10476 raft_consensus.cc:2272] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:31.084134 10476 ts_tablet_manager.cc:1916] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:53:31.085659 10013 catalog_manager.cc:4985] TS d15241a5ccf24545b175518887236150 (127.2.223.2:42109): tablet 3912c85ca7be4dd4ab01773129f7155b (table ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]) successfully deleted
I20260207 20:53:31.100658 10476 ts_tablet_manager.cc:1929] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260207 20:53:31.101136 10476 log.cc:1199] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-2-root/wals/9f2c862d5de141a8b3147359bb72edc4
I20260207 20:53:31.101789 10476 ts_tablet_manager.cc:1950] T 9f2c862d5de141a8b3147359bb72edc4 P b5b1c4fc6cac4c8abe1590470f391022: Deleting consensus metadata
I20260207 20:53:31.104576 10015 catalog_manager.cc:4985] TS b5b1c4fc6cac4c8abe1590470f391022 (127.2.223.3:36089): tablet 9f2c862d5de141a8b3147359bb72edc4 (table ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]) successfully deleted
I20260207 20:53:31.105584 10476 tablet_replica.cc:333] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022: stopping tablet replica
I20260207 20:53:31.106392 10476 raft_consensus.cc:2243] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:31.107256 10476 pending_rounds.cc:70] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022: Trying to abort 1 pending ops.
I20260207 20:53:31.107506 10476 pending_rounds.cc:77] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7251958213177761792 op_type: NO_OP noop_request { }
I20260207 20:53:31.107854 10476 raft_consensus.cc:2889] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260207 20:53:31.108224 10476 raft_consensus.cc:2272] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:31.081929 10474 raft_consensus.cc:2243] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:31.111372 10474 pending_rounds.cc:70] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150: Trying to abort 1 pending ops.
I20260207 20:53:31.111653 10474 pending_rounds.cc:77] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7251958213422575616 op_type: NO_OP noop_request { }
I20260207 20:53:31.112003 10474 raft_consensus.cc:2889] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260207 20:53:31.112365 10474 raft_consensus.cc:2272] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:31.116915 10476 ts_tablet_manager.cc:1916] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:53:31.118290 10474 ts_tablet_manager.cc:1916] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:53:31.140785 10476 ts_tablet_manager.cc:1929] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260207 20:53:31.141355 10476 log.cc:1199] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-2-root/wals/9882ec51f4704e2ba6de28f834b35ac8
I20260207 20:53:31.142140 10476 ts_tablet_manager.cc:1950] T 9882ec51f4704e2ba6de28f834b35ac8 P b5b1c4fc6cac4c8abe1590470f391022: Deleting consensus metadata
I20260207 20:53:31.145386 10015 catalog_manager.cc:4985] TS b5b1c4fc6cac4c8abe1590470f391022 (127.2.223.3:36089): tablet 9882ec51f4704e2ba6de28f834b35ac8 (table ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]) successfully deleted
I20260207 20:53:31.162292 10474 ts_tablet_manager.cc:1929] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260207 20:53:31.162802 10474 log.cc:1199] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-1-root/wals/9f2c862d5de141a8b3147359bb72edc4
I20260207 20:53:31.163522 10474 ts_tablet_manager.cc:1950] T 9f2c862d5de141a8b3147359bb72edc4 P d15241a5ccf24545b175518887236150: Deleting consensus metadata
I20260207 20:53:31.168895 10475 ts_tablet_manager.cc:1929] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260207 20:53:31.169445 10475 log.cc:1199] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-0-root/wals/9f2c862d5de141a8b3147359bb72edc4
I20260207 20:53:31.179003 10475 ts_tablet_manager.cc:1950] T 9f2c862d5de141a8b3147359bb72edc4 P 0ba2df3c03644d6e9e395cb8b703b51b: Deleting consensus metadata
I20260207 20:53:31.175748 10474 tablet_replica.cc:333] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150: stopping tablet replica
I20260207 20:53:31.176429 10013 catalog_manager.cc:4985] TS d15241a5ccf24545b175518887236150 (127.2.223.2:42109): tablet 9f2c862d5de141a8b3147359bb72edc4 (table ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]) successfully deleted
I20260207 20:53:31.182281 10475 tablet_replica.cc:333] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b: stopping tablet replica
I20260207 20:53:31.181766 10015 catalog_manager.cc:4985] TS 0ba2df3c03644d6e9e395cb8b703b51b (127.2.223.1:39675): tablet 9f2c862d5de141a8b3147359bb72edc4 (table ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]) successfully deleted
I20260207 20:53:31.185101 10475 raft_consensus.cc:2243] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:31.186740 10475 raft_consensus.cc:2272] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:31.189298 10475 ts_tablet_manager.cc:1916] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:53:31.189443 10474 raft_consensus.cc:2243] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:31.190315 10474 raft_consensus.cc:2272] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:31.197731 10474 ts_tablet_manager.cc:1916] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:53:31.214282 10475 ts_tablet_manager.cc:1929] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260207 20:53:31.214871 10475 log.cc:1199] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-0-root/wals/9882ec51f4704e2ba6de28f834b35ac8
I20260207 20:53:31.215597 10475 ts_tablet_manager.cc:1950] T 9882ec51f4704e2ba6de28f834b35ac8 P 0ba2df3c03644d6e9e395cb8b703b51b: Deleting consensus metadata
I20260207 20:53:31.218827 10015 catalog_manager.cc:4985] TS 0ba2df3c03644d6e9e395cb8b703b51b (127.2.223.1:39675): tablet 9882ec51f4704e2ba6de28f834b35ac8 (table ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]) successfully deleted
I20260207 20:53:31.244659 10474 ts_tablet_manager.cc:1929] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260207 20:53:31.246829 10474 log.cc:1199] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNoTableCluster.1770497537224219-2940-0/minicluster-data/ts-1-root/wals/9882ec51f4704e2ba6de28f834b35ac8
I20260207 20:53:31.247531 10474 ts_tablet_manager.cc:1950] T 9882ec51f4704e2ba6de28f834b35ac8 P d15241a5ccf24545b175518887236150: Deleting consensus metadata
I20260207 20:53:31.251513 10013 catalog_manager.cc:4985] TS d15241a5ccf24545b175518887236150 (127.2.223.2:42109): tablet 9882ec51f4704e2ba6de28f834b35ac8 (table ksck-test-table [id=615c00411b9c4cd39fe1306697117ef4]) successfully deleted
I20260207 20:53:31.634137 10297 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:53:31.656999 10217 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:53:31.666469 10376 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:53:31.995019 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:53:32.047149 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:32.056370 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:53:32.072028 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:53:32.099550 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:32.116017 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:53:32.128665 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:53:32.153577 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:32.168978 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:53:32.179906 2940 master.cc:561] Master@127.2.223.62:33625 shutting down...
I20260207 20:53:32.202270 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:32.202832 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:32.203142 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 04d7170b7e70481f8b4a3370d10831f7: stopping tablet replica
I20260207 20:53:32.221554 2940 master.cc:583] Master@127.2.223.62:33625 shutdown complete.
I20260207 20:53:32.235685 2940 master.cc:561] Master@127.2.223.61:45057 shutting down...
I20260207 20:53:32.253723 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:32.254766 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:32.255208 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 29960e03455f4cd7b7ecaa8f531a55b6: stopping tablet replica
I20260207 20:53:32.275905 2940 master.cc:583] Master@127.2.223.61:45057 shutdown complete.
I20260207 20:53:32.289439 2940 master.cc:561] Master@127.2.223.60:45135 shutting down...
I20260207 20:53:32.305392 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:32.305896 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:32.306191 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P df6374c492a14a89ae9d20a07237ee28: stopping tablet replica
I20260207 20:53:32.324424 2940 master.cc:583] Master@127.2.223.60:45135 shutdown complete.
[ OK ] RemoteKsckTest.TestFilterOnNoTableCluster (3483 ms)
[ RUN ] RemoteKsckTest.TestNonMatchingTableFilter
I20260207 20:53:32.351481 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:43147,127.2.223.61:40687,127.2.223.60:36521
I20260207 20:53:32.352756 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:32.357618 10512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:32.357646 10513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:32.359170 10515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:32.359782 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:32.360438 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:32.360601 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:32.360720 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497612360709 us; error 0 us; skew 500 ppm
I20260207 20:53:32.361145 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:32.363333 2940 webserver.cc:492] Webserver started at http://127.2.223.62:38807/ using document root <none> and password file <none>
I20260207 20:53:32.363785 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:32.363947 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:32.364152 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:32.365139 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "2d4546720d7e4ae89fe44644c3e7da4b"
format_stamp: "Formatted at 2026-02-07 20:53:32 on dist-test-slave-kqw4"
I20260207 20:53:32.369711 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:53:32.372852 10520 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:32.373543 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:53:32.373807 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "2d4546720d7e4ae89fe44644c3e7da4b"
format_stamp: "Formatted at 2026-02-07 20:53:32 on dist-test-slave-kqw4"
I20260207 20:53:32.374063 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:32.383582 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:32.384711 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:32.419768 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:43147
I20260207 20:53:32.419871 10571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:43147 every 8 connection(s)
I20260207 20:53:32.423377 10572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:32.423542 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:32.428586 10574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:32.430023 10575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:32.431129 10572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:32.432508 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:32.432471 10577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:32.433635 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:32.433832 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:32.434031 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497612434009 us; error 0 us; skew 500 ppm
I20260207 20:53:32.434737 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:32.437525 2940 webserver.cc:492] Webserver started at http://127.2.223.61:41503/ using document root <none> and password file <none>
I20260207 20:53:32.438169 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:32.438408 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:32.438719 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:32.439719 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "a6407e0a4dc744479e89790441868989"
format_stamp: "Formatted at 2026-02-07 20:53:32 on dist-test-slave-kqw4"
I20260207 20:53:32.445178 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260207 20:53:32.445564 10572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:32.449230 10584 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:32.450210 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260207 20:53:32.450562 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "a6407e0a4dc744479e89790441868989"
format_stamp: "Formatted at 2026-02-07 20:53:32 on dist-test-slave-kqw4"
I20260207 20:53:32.450948 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:53:32.452951 10572 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:40687: Network error: Client connection negotiation failed: client connection to 127.2.223.61:40687: connect: Connection refused (error 111)
I20260207 20:53:32.472277 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:32.473423 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:32.487594 10572 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } attempt: 1
W20260207 20:53:32.492832 10572 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:40687: Network error: Client connection negotiation failed: client connection to 127.2.223.61:40687: connect: Connection refused (error 111)
I20260207 20:53:32.511030 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:40687
I20260207 20:53:32.511123 10636 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:40687 every 8 connection(s)
I20260207 20:53:32.514722 10637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:32.514808 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:32.519764 10639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:32.520465 10640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:32.522500 10637 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:32.523059 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:32.523725 10643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:32.524720 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:32.525063 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:32.525271 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497612525255 us; error 0 us; skew 500 ppm
I20260207 20:53:32.525796 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:32.528189 2940 webserver.cc:492] Webserver started at http://127.2.223.60:42791/ using document root <none> and password file <none>
I20260207 20:53:32.528650 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:32.528824 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:32.529060 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:32.530019 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "6c472825eca34837a1cf5a01f1b93777"
format_stamp: "Formatted at 2026-02-07 20:53:32 on dist-test-slave-kqw4"
I20260207 20:53:32.530572 10572 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } attempt: 2
I20260207 20:53:32.534977 10637 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:32.538190 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.002s sys 0.005s
I20260207 20:53:32.542618 10650 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:32.543702 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260207 20:53:32.543880 10572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:32.544044 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "6c472825eca34837a1cf5a01f1b93777"
format_stamp: "Formatted at 2026-02-07 20:53:32 on dist-test-slave-kqw4"
I20260207 20:53:32.544463 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:32.547325 10637 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:32.549599 10572 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:36521: Network error: Client connection negotiation failed: client connection to 127.2.223.60:36521: connect: Connection refused (error 111)
W20260207 20:53:32.553460 10637 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:36521: Network error: Client connection negotiation failed: client connection to 127.2.223.60:36521: connect: Connection refused (error 111)
I20260207 20:53:32.567250 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:32.568481 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:32.571115 10572 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } attempt: 1
W20260207 20:53:32.575404 10572 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:36521: Network error: Client connection negotiation failed: client connection to 127.2.223.60:36521: connect: Connection refused (error 111)
I20260207 20:53:32.588923 10637 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } attempt: 1
W20260207 20:53:32.593906 10637 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:36521: Network error: Client connection negotiation failed: client connection to 127.2.223.60:36521: connect: Connection refused (error 111)
I20260207 20:53:32.607120 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:36521
I20260207 20:53:32.607220 10702 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:36521 every 8 connection(s)
I20260207 20:53:32.609987 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:53:32.610797 10703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:32.616657 10703 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:32.626696 10703 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:32.632869 10572 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } attempt: 2
I20260207 20:53:32.635581 10703 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:32.649857 10572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b: Bootstrap starting.
I20260207 20:53:32.654809 10572 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:32.656785 10703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777: Bootstrap starting.
I20260207 20:53:32.657356 10637 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } attempt: 2
I20260207 20:53:32.659313 10572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b: No bootstrap required, opened a new log
I20260207 20:53:32.661972 10572 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } }
I20260207 20:53:32.662496 10572 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:32.662772 10572 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4546720d7e4ae89fe44644c3e7da4b, State: Initialized, Role: FOLLOWER
I20260207 20:53:32.663187 10703 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:32.663374 10572 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } }
I20260207 20:53:32.665253 10709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } } }
I20260207 20:53:32.666046 10709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:32.666930 10572 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:32.669533 10703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777: No bootstrap required, opened a new log
I20260207 20:53:32.672219 10703 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } }
I20260207 20:53:32.673007 10703 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:32.673350 10703 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c472825eca34837a1cf5a01f1b93777, State: Initialized, Role: FOLLOWER
I20260207 20:53:32.674003 10703 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } }
I20260207 20:53:32.676373 10717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } } }
I20260207 20:53:32.677130 10717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:32.678158 10637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989: Bootstrap starting.
I20260207 20:53:32.678228 10703 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:32.681875 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:53:32.684473 10637 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989: Neither blocks nor log segments found. Creating new log.
W20260207 20:53:32.686178 10722 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:32.686501 10722 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:32.689157 10637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989: No bootstrap required, opened a new log
I20260207 20:53:32.691977 10637 raft_consensus.cc:359] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } }
I20260207 20:53:32.692682 10637 raft_consensus.cc:385] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:32.692956 10637 raft_consensus.cc:740] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6407e0a4dc744479e89790441868989, State: Initialized, Role: FOLLOWER
I20260207 20:53:32.693666 10637 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } }
I20260207 20:53:32.695544 10735 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } } }
I20260207 20:53:32.696069 10735 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [sys.catalog]: This master's current role is: FOLLOWER
W20260207 20:53:32.696130 10734 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:32.696527 10734 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:32.697204 10637 sys_catalog.cc:565] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:32.706741 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:53:32.708099 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:32.709555 10746 catalog_manager.cc:1568] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:32.709848 10746 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:53:32.713948 10747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:32.714936 10748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:32.716118 10750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:32.716764 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:32.717463 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:32.717653 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:32.717806 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497612717790 us; error 0 us; skew 500 ppm
I20260207 20:53:32.718387 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:32.720490 2940 webserver.cc:492] Webserver started at http://127.2.223.1:45743/ using document root <none> and password file <none>
I20260207 20:53:32.720937 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:32.721107 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:32.721341 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:32.722352 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "e80d19442ec24e58bfc9a8c447d95f13"
format_stamp: "Formatted at 2026-02-07 20:53:32 on dist-test-slave-kqw4"
I20260207 20:53:32.726325 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260207 20:53:32.729326 10755 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:32.730046 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:53:32.730306 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "e80d19442ec24e58bfc9a8c447d95f13"
format_stamp: "Formatted at 2026-02-07 20:53:32 on dist-test-slave-kqw4"
I20260207 20:53:32.730561 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:32.743973 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:32.744918 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:32.746279 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:32.748383 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:32.748567 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:32.748809 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:32.748963 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:32.785599 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:39255
I20260207 20:53:32.785701 10817 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:39255 every 8 connection(s)
I20260207 20:53:32.799479 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:32.804787 10818 heartbeater.cc:344] Connected to a master server at 127.2.223.61:40687
I20260207 20:53:32.805224 10818 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:32.806054 10818 heartbeater.cc:507] Master 127.2.223.61:40687 requested a full tablet report, sending...
I20260207 20:53:32.806794 10819 heartbeater.cc:344] Connected to a master server at 127.2.223.60:36521
I20260207 20:53:32.807155 10819 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:32.807987 10819 heartbeater.cc:507] Master 127.2.223.60:36521 requested a full tablet report, sending...
W20260207 20:53:32.808645 10825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:32.809428 10602 ts_manager.cc:194] Registered new tserver with Master: e80d19442ec24e58bfc9a8c447d95f13 (127.2.223.1:39255)
I20260207 20:53:32.810833 10668 ts_manager.cc:194] Registered new tserver with Master: e80d19442ec24e58bfc9a8c447d95f13 (127.2.223.1:39255)
I20260207 20:53:32.813000 10820 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43147
I20260207 20:53:32.813367 10820 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:32.814234 10820 heartbeater.cc:507] Master 127.2.223.62:43147 requested a full tablet report, sending...
W20260207 20:53:32.815083 10826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:32.817044 10537 ts_manager.cc:194] Registered new tserver with Master: e80d19442ec24e58bfc9a8c447d95f13 (127.2.223.1:39255)
I20260207 20:53:32.817044 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:32.818058 10828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:32.819010 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:32.819211 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:32.819382 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497612819364 us; error 0 us; skew 500 ppm
I20260207 20:53:32.819852 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:32.822425 2940 webserver.cc:492] Webserver started at http://127.2.223.2:34345/ using document root <none> and password file <none>
I20260207 20:53:32.823065 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:32.823272 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:32.823511 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:32.824784 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "d37ceeaadbfd469492ce84c1a0273e06"
format_stamp: "Formatted at 2026-02-07 20:53:32 on dist-test-slave-kqw4"
I20260207 20:53:32.829193 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260207 20:53:32.832973 10833 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:32.833701 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:53:32.833990 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "d37ceeaadbfd469492ce84c1a0273e06"
format_stamp: "Formatted at 2026-02-07 20:53:32 on dist-test-slave-kqw4"
I20260207 20:53:32.834247 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:32.847437 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:32.848424 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:32.850071 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:32.852571 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:32.852802 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:32.853022 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:32.853163 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:32.899686 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:41053
I20260207 20:53:32.899773 10895 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:41053 every 8 connection(s)
I20260207 20:53:32.912142 10717 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:32.912750 10717 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } }
I20260207 20:53:32.915925 10547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c472825eca34837a1cf5a01f1b93777" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" is_pre_election: true
I20260207 20:53:32.916633 10547 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c472825eca34837a1cf5a01f1b93777 in term 0.
I20260207 20:53:32.917896 10651 leader_election.cc:304] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4546720d7e4ae89fe44644c3e7da4b, 6c472825eca34837a1cf5a01f1b93777; no voters:
I20260207 20:53:32.917218 10612 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c472825eca34837a1cf5a01f1b93777" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6407e0a4dc744479e89790441868989" is_pre_election: true
I20260207 20:53:32.922027 10612 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c472825eca34837a1cf5a01f1b93777 in term 0.
I20260207 20:53:32.916011 10717 leader_election.cc:290] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d4546720d7e4ae89fe44644c3e7da4b (127.2.223.62:43147), a6407e0a4dc744479e89790441868989 (127.2.223.61:40687)
I20260207 20:53:32.924461 10717 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:32.924894 10717 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:32.925282 10717 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:32.932072 10896 heartbeater.cc:344] Connected to a master server at 127.2.223.61:40687
I20260207 20:53:32.932559 10896 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:32.933511 10896 heartbeater.cc:507] Master 127.2.223.61:40687 requested a full tablet report, sending...
I20260207 20:53:32.937647 10717 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } }
I20260207 20:53:32.938102 10602 ts_manager.cc:194] Registered new tserver with Master: d37ceeaadbfd469492ce84c1a0273e06 (127.2.223.2:41053)
I20260207 20:53:32.942092 10547 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c472825eca34837a1cf5a01f1b93777" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4546720d7e4ae89fe44644c3e7da4b"
I20260207 20:53:32.942723 10547 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:32.949538 10547 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c472825eca34837a1cf5a01f1b93777 in term 1.
I20260207 20:53:32.950350 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:32.950513 10897 heartbeater.cc:344] Connected to a master server at 127.2.223.60:36521
I20260207 20:53:32.951381 10897 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:32.952219 10897 heartbeater.cc:507] Master 127.2.223.60:36521 requested a full tablet report, sending...
I20260207 20:53:32.956637 10717 leader_election.cc:290] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [CANDIDATE]: Term 1 election: Requested vote from peers 2d4546720d7e4ae89fe44644c3e7da4b (127.2.223.62:43147), a6407e0a4dc744479e89790441868989 (127.2.223.61:40687)
I20260207 20:53:32.958041 10651 leader_election.cc:304] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4546720d7e4ae89fe44644c3e7da4b, 6c472825eca34837a1cf5a01f1b93777; no voters:
I20260207 20:53:32.958231 10612 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c472825eca34837a1cf5a01f1b93777" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6407e0a4dc744479e89790441868989"
I20260207 20:53:32.958901 10612 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:32.960412 10668 ts_manager.cc:194] Registered new tserver with Master: d37ceeaadbfd469492ce84c1a0273e06 (127.2.223.2:41053)
I20260207 20:53:32.961143 10898 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43147
I20260207 20:53:32.961561 10898 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:32.962476 10898 heartbeater.cc:507] Master 127.2.223.62:43147 requested a full tablet report, sending...
W20260207 20:53:32.963496 10904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:32.964504 10717 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:32.965062 10537 ts_manager.cc:194] Registered new tserver with Master: d37ceeaadbfd469492ce84c1a0273e06 (127.2.223.2:41053)
I20260207 20:53:32.967555 10612 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c472825eca34837a1cf5a01f1b93777 in term 1.
I20260207 20:53:32.965083 10717 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [term 1 LEADER]: Becoming Leader. State: Replica: 6c472825eca34837a1cf5a01f1b93777, State: Running, Role: LEADER
I20260207 20:53:32.970407 10717 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } }
W20260207 20:53:32.974378 10905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:32.975327 10907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:32.975652 10903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c472825eca34837a1cf5a01f1b93777. Latest consensus state: current_term: 1 leader_uuid: "6c472825eca34837a1cf5a01f1b93777" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } } }
I20260207 20:53:32.976362 10903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:32.978039 10910 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:53:32.978549 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:32.979593 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:32.979859 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:32.980090 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497612980072 us; error 0 us; skew 500 ppm
I20260207 20:53:32.980770 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:32.988026 10910 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:53:32.988742 2940 webserver.cc:492] Webserver started at http://127.2.223.3:34761/ using document root <none> and password file <none>
I20260207 20:53:32.989413 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:32.989653 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:32.990046 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:32.991436 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "09825ebb10a54a35b8ef459b7db2d82f"
format_stamp: "Formatted at 2026-02-07 20:53:32 on dist-test-slave-kqw4"
I20260207 20:53:33.001632 10612 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [term 1 FOLLOWER]: Refusing update from remote peer 6c472825eca34837a1cf5a01f1b93777: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:33.003098 10547 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [term 1 FOLLOWER]: Refusing update from remote peer 6c472825eca34837a1cf5a01f1b93777: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:33.004115 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.012s user 0.012s sys 0.000s
I20260207 20:53:33.005064 10717 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:33.006659 10903 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:33.017741 10709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c472825eca34837a1cf5a01f1b93777. Latest consensus state: current_term: 1 leader_uuid: "6c472825eca34837a1cf5a01f1b93777" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } } }
I20260207 20:53:33.018561 10709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:33.030548 10917 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:33.031879 2940 fs_manager.cc:730] Time spent opening block manager: real 0.025s user 0.010s sys 0.008s
I20260207 20:53:33.032334 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "09825ebb10a54a35b8ef459b7db2d82f"
format_stamp: "Formatted at 2026-02-07 20:53:32 on dist-test-slave-kqw4"
I20260207 20:53:33.032701 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:33.036485 10709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6c472825eca34837a1cf5a01f1b93777" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } } }
I20260207 20:53:33.037289 10709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:33.046170 10903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6c472825eca34837a1cf5a01f1b93777" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } } }
I20260207 20:53:33.046849 10903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:33.048825 10910 catalog_manager.cc:1357] Generated new cluster ID: 73837f88bcb94f50a547ff7a8ef0b992
I20260207 20:53:33.049149 10910 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:53:33.059206 10735 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c472825eca34837a1cf5a01f1b93777. Latest consensus state: current_term: 1 leader_uuid: "6c472825eca34837a1cf5a01f1b93777" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } } }
I20260207 20:53:33.059957 10735 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:33.069334 10903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6c472825eca34837a1cf5a01f1b93777" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } } }
I20260207 20:53:33.070078 10903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:33.084120 10735 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6c472825eca34837a1cf5a01f1b93777" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4546720d7e4ae89fe44644c3e7da4b" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43147 } } peers { permanent_uuid: "a6407e0a4dc744479e89790441868989" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40687 } } peers { permanent_uuid: "6c472825eca34837a1cf5a01f1b93777" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 36521 } } }
I20260207 20:53:33.084836 10735 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:33.088887 10910 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:53:33.090691 10910 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:53:33.092432 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:33.094203 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:33.095937 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:33.102792 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:33.103065 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:33.103341 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:33.103556 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:33.118054 10910 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777: Generated new TSK 0
I20260207 20:53:33.118883 10910 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:53:33.132822 10668 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60890
I20260207 20:53:33.136739 10667 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60892
I20260207 20:53:33.152799 10897 heartbeater.cc:499] Master 127.2.223.60:36521 was elected leader, sending a full tablet report...
I20260207 20:53:33.153259 10819 heartbeater.cc:499] Master 127.2.223.60:36521 was elected leader, sending a full tablet report...
I20260207 20:53:33.190728 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:36137
I20260207 20:53:33.190869 10985 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:36137 every 8 connection(s)
I20260207 20:53:33.219677 10986 heartbeater.cc:344] Connected to a master server at 127.2.223.61:40687
I20260207 20:53:33.220134 10986 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:33.221084 10986 heartbeater.cc:507] Master 127.2.223.61:40687 requested a full tablet report, sending...
I20260207 20:53:33.223793 10601 ts_manager.cc:194] Registered new tserver with Master: 09825ebb10a54a35b8ef459b7db2d82f (127.2.223.3:36137)
I20260207 20:53:33.226935 10987 heartbeater.cc:344] Connected to a master server at 127.2.223.60:36521
I20260207 20:53:33.227396 10987 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:33.228329 10987 heartbeater.cc:507] Master 127.2.223.60:36521 requested a full tablet report, sending...
I20260207 20:53:33.231757 10667 ts_manager.cc:194] Registered new tserver with Master: 09825ebb10a54a35b8ef459b7db2d82f (127.2.223.3:36137)
I20260207 20:53:33.233736 10667 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60894
I20260207 20:53:33.242946 10988 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43147
I20260207 20:53:33.243350 10988 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:33.243916 10988 heartbeater.cc:507] Master 127.2.223.62:43147 requested a full tablet report, sending...
I20260207 20:53:33.246362 10536 ts_manager.cc:194] Registered new tserver with Master: 09825ebb10a54a35b8ef459b7db2d82f (127.2.223.3:36137)
I20260207 20:53:33.247406 10987 heartbeater.cc:499] Master 127.2.223.60:36521 was elected leader, sending a full tablet report...
I20260207 20:53:33.246995 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.010582704s
I20260207 20:53:33.312093 10667 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60910:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:53:33.317313 10667 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:53:33.400949 10951 tablet_service.cc:1505] Processing CreateTablet for tablet 1e16f206a3954c0fa3033a1371a02b9d (DEFAULT_TABLE table=ksck-test-table [id=cfde486e01b14699a08920055f8d2af4]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:33.402288 10951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e16f206a3954c0fa3033a1371a02b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:33.412230 10861 tablet_service.cc:1505] Processing CreateTablet for tablet 1e16f206a3954c0fa3033a1371a02b9d (DEFAULT_TABLE table=ksck-test-table [id=cfde486e01b14699a08920055f8d2af4]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:33.413576 10861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e16f206a3954c0fa3033a1371a02b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:33.415433 10860 tablet_service.cc:1505] Processing CreateTablet for tablet f0a7af1f0dd148ab907572017497d038 (DEFAULT_TABLE table=ksck-test-table [id=cfde486e01b14699a08920055f8d2af4]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:33.415282 10950 tablet_service.cc:1505] Processing CreateTablet for tablet f0a7af1f0dd148ab907572017497d038 (DEFAULT_TABLE table=ksck-test-table [id=cfde486e01b14699a08920055f8d2af4]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:33.416805 10950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0a7af1f0dd148ab907572017497d038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:33.423482 10949 tablet_service.cc:1505] Processing CreateTablet for tablet ee0e5d63f2d54b94b2db03ff73a5239f (DEFAULT_TABLE table=ksck-test-table [id=cfde486e01b14699a08920055f8d2af4]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:33.424814 10949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0e5d63f2d54b94b2db03ff73a5239f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:33.426775 10859 tablet_service.cc:1505] Processing CreateTablet for tablet ee0e5d63f2d54b94b2db03ff73a5239f (DEFAULT_TABLE table=ksck-test-table [id=cfde486e01b14699a08920055f8d2af4]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:33.416805 10860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0a7af1f0dd148ab907572017497d038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:33.428337 10859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0e5d63f2d54b94b2db03ff73a5239f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:33.461696 11006 tablet_bootstrap.cc:492] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06: Bootstrap starting.
I20260207 20:53:33.466805 10783 tablet_service.cc:1505] Processing CreateTablet for tablet 1e16f206a3954c0fa3033a1371a02b9d (DEFAULT_TABLE table=ksck-test-table [id=cfde486e01b14699a08920055f8d2af4]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:33.468143 10783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e16f206a3954c0fa3033a1371a02b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:33.476707 11006 tablet_bootstrap.cc:654] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:33.481032 10782 tablet_service.cc:1505] Processing CreateTablet for tablet f0a7af1f0dd148ab907572017497d038 (DEFAULT_TABLE table=ksck-test-table [id=cfde486e01b14699a08920055f8d2af4]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:33.482538 10782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0a7af1f0dd148ab907572017497d038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:33.488054 10781 tablet_service.cc:1505] Processing CreateTablet for tablet ee0e5d63f2d54b94b2db03ff73a5239f (DEFAULT_TABLE table=ksck-test-table [id=cfde486e01b14699a08920055f8d2af4]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:33.489347 10781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0e5d63f2d54b94b2db03ff73a5239f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:33.499023 11005 tablet_bootstrap.cc:492] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f: Bootstrap starting.
I20260207 20:53:33.514094 11005 tablet_bootstrap.cc:654] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:33.538105 11005 tablet_bootstrap.cc:492] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f: No bootstrap required, opened a new log
I20260207 20:53:33.538760 11005 ts_tablet_manager.cc:1403] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f: Time spent bootstrapping tablet: real 0.040s user 0.017s sys 0.005s
I20260207 20:53:33.540786 11006 tablet_bootstrap.cc:492] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06: No bootstrap required, opened a new log
I20260207 20:53:33.541326 11006 ts_tablet_manager.cc:1403] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06: Time spent bootstrapping tablet: real 0.080s user 0.004s sys 0.020s
I20260207 20:53:33.541425 11005 raft_consensus.cc:359] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } }
I20260207 20:53:33.542183 11005 raft_consensus.cc:385] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:33.542503 11005 raft_consensus.cc:740] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09825ebb10a54a35b8ef459b7db2d82f, State: Initialized, Role: FOLLOWER
I20260207 20:53:33.543291 11005 consensus_queue.cc:260] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } }
I20260207 20:53:33.545004 11009 tablet_bootstrap.cc:492] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13: Bootstrap starting.
I20260207 20:53:33.559643 11006 raft_consensus.cc:359] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.579670 11006 raft_consensus.cc:385] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:33.575004 11005 ts_tablet_manager.cc:1434] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f: Time spent starting tablet: real 0.036s user 0.027s sys 0.008s
I20260207 20:53:33.580140 11006 raft_consensus.cc:740] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d37ceeaadbfd469492ce84c1a0273e06, State: Initialized, Role: FOLLOWER
I20260207 20:53:33.581218 11005 tablet_bootstrap.cc:492] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f: Bootstrap starting.
I20260207 20:53:33.580989 11006 consensus_queue.cc:260] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.588894 11005 tablet_bootstrap.cc:654] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:33.599030 11009 tablet_bootstrap.cc:654] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:33.599578 11005 tablet_bootstrap.cc:492] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f: No bootstrap required, opened a new log
I20260207 20:53:33.602015 11005 ts_tablet_manager.cc:1403] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f: Time spent bootstrapping tablet: real 0.021s user 0.012s sys 0.004s
I20260207 20:53:33.605805 11005 raft_consensus.cc:359] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.606737 11005 raft_consensus.cc:385] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:33.607087 11005 raft_consensus.cc:740] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09825ebb10a54a35b8ef459b7db2d82f, State: Initialized, Role: FOLLOWER
I20260207 20:53:33.607968 11005 consensus_queue.cc:260] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.610224 11005 ts_tablet_manager.cc:1434] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f: Time spent starting tablet: real 0.008s user 0.001s sys 0.004s
I20260207 20:53:33.610291 11006 ts_tablet_manager.cc:1434] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06: Time spent starting tablet: real 0.069s user 0.001s sys 0.005s
I20260207 20:53:33.611482 11005 tablet_bootstrap.cc:492] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f: Bootstrap starting.
I20260207 20:53:33.612859 11006 tablet_bootstrap.cc:492] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06: Bootstrap starting.
I20260207 20:53:33.618899 11005 tablet_bootstrap.cc:654] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:33.619045 11006 tablet_bootstrap.cc:654] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:33.634708 11005 tablet_bootstrap.cc:492] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f: No bootstrap required, opened a new log
I20260207 20:53:33.635036 11006 tablet_bootstrap.cc:492] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06: No bootstrap required, opened a new log
I20260207 20:53:33.635227 11005 ts_tablet_manager.cc:1403] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f: Time spent bootstrapping tablet: real 0.024s user 0.012s sys 0.004s
I20260207 20:53:33.635587 11006 ts_tablet_manager.cc:1403] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.000s
I20260207 20:53:33.638993 11005 raft_consensus.cc:359] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.639748 11005 raft_consensus.cc:385] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:33.640030 11005 raft_consensus.cc:740] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09825ebb10a54a35b8ef459b7db2d82f, State: Initialized, Role: FOLLOWER
I20260207 20:53:33.640365 11009 tablet_bootstrap.cc:492] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13: No bootstrap required, opened a new log
I20260207 20:53:33.640861 11009 ts_tablet_manager.cc:1403] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13: Time spent bootstrapping tablet: real 0.104s user 0.008s sys 0.008s
I20260207 20:53:33.640734 11005 consensus_queue.cc:260] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.643618 11009 raft_consensus.cc:359] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.644318 11009 raft_consensus.cc:385] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:33.644598 11009 raft_consensus.cc:740] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d19442ec24e58bfc9a8c447d95f13, State: Initialized, Role: FOLLOWER
I20260207 20:53:33.645304 11009 consensus_queue.cc:260] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.645248 11005 ts_tablet_manager.cc:1434] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260207 20:53:33.647930 11006 raft_consensus.cc:359] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } }
I20260207 20:53:33.656716 11006 raft_consensus.cc:385] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:33.657058 11006 raft_consensus.cc:740] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d37ceeaadbfd469492ce84c1a0273e06, State: Initialized, Role: FOLLOWER
I20260207 20:53:33.657840 11006 consensus_queue.cc:260] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } }
I20260207 20:53:33.660131 11006 ts_tablet_manager.cc:1434] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06: Time spent starting tablet: real 0.024s user 0.006s sys 0.001s
I20260207 20:53:33.662813 11006 tablet_bootstrap.cc:492] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06: Bootstrap starting.
I20260207 20:53:33.661713 11009 ts_tablet_manager.cc:1434] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13: Time spent starting tablet: real 0.020s user 0.004s sys 0.001s
I20260207 20:53:33.666682 11009 tablet_bootstrap.cc:492] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13: Bootstrap starting.
I20260207 20:53:33.676033 11006 tablet_bootstrap.cc:654] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:33.678056 11009 tablet_bootstrap.cc:654] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:33.689136 11006 tablet_bootstrap.cc:492] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06: No bootstrap required, opened a new log
I20260207 20:53:33.689671 11006 ts_tablet_manager.cc:1403] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.002s
I20260207 20:53:33.690943 10722 catalog_manager.cc:1269] Loaded cluster ID: 73837f88bcb94f50a547ff7a8ef0b992
I20260207 20:53:33.691298 10722 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b: loading cluster ID for follower catalog manager: success
I20260207 20:53:33.692343 11006 raft_consensus.cc:359] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.693042 11006 raft_consensus.cc:385] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:33.696995 11006 raft_consensus.cc:740] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d37ceeaadbfd469492ce84c1a0273e06, State: Initialized, Role: FOLLOWER
I20260207 20:53:33.697799 11006 consensus_queue.cc:260] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.696273 11009 tablet_bootstrap.cc:492] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13: No bootstrap required, opened a new log
I20260207 20:53:33.698982 11009 ts_tablet_manager.cc:1403] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13: Time spent bootstrapping tablet: real 0.033s user 0.009s sys 0.002s
I20260207 20:53:33.701581 11009 raft_consensus.cc:359] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.704213 11009 raft_consensus.cc:385] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:33.704559 11009 raft_consensus.cc:740] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d19442ec24e58bfc9a8c447d95f13, State: Initialized, Role: FOLLOWER
I20260207 20:53:33.705318 11009 consensus_queue.cc:260] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.707686 11009 ts_tablet_manager.cc:1434] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13: Time spent starting tablet: real 0.008s user 0.004s sys 0.002s
I20260207 20:53:33.708778 11009 tablet_bootstrap.cc:492] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13: Bootstrap starting.
I20260207 20:53:33.712800 10722 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b: acquiring CA information for follower catalog manager: success
I20260207 20:53:33.714977 10746 catalog_manager.cc:1269] Loaded cluster ID: 73837f88bcb94f50a547ff7a8ef0b992
I20260207 20:53:33.715431 10746 catalog_manager.cc:1562] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989: loading cluster ID for follower catalog manager: success
I20260207 20:53:33.703853 11006 ts_tablet_manager.cc:1434] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260207 20:53:33.722087 10722 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:33.727139 10746 catalog_manager.cc:1584] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989: acquiring CA information for follower catalog manager: success
I20260207 20:53:33.732124 10746 catalog_manager.cc:1612] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:33.732577 11009 tablet_bootstrap.cc:654] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:33.740163 11016 raft_consensus.cc:493] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:33.740568 11016 raft_consensus.cc:515] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.742741 11016 leader_election.cc:290] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d37ceeaadbfd469492ce84c1a0273e06 (127.2.223.2:41053), 09825ebb10a54a35b8ef459b7db2d82f (127.2.223.3:36137)
I20260207 20:53:33.744076 11009 tablet_bootstrap.cc:492] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13: No bootstrap required, opened a new log
I20260207 20:53:33.744601 11009 ts_tablet_manager.cc:1403] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13: Time spent bootstrapping tablet: real 0.036s user 0.011s sys 0.003s
I20260207 20:53:33.749346 11009 raft_consensus.cc:359] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } }
I20260207 20:53:33.760025 11009 raft_consensus.cc:385] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:33.761178 11009 raft_consensus.cc:740] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d19442ec24e58bfc9a8c447d95f13, State: Initialized, Role: FOLLOWER
I20260207 20:53:33.761997 11009 consensus_queue.cc:260] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } }
I20260207 20:53:33.764325 11009 ts_tablet_manager.cc:1434] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13: Time spent starting tablet: real 0.019s user 0.008s sys 0.000s
I20260207 20:53:33.769032 10871 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0a7af1f0dd148ab907572017497d038" candidate_uuid: "e80d19442ec24e58bfc9a8c447d95f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37ceeaadbfd469492ce84c1a0273e06" is_pre_election: true
I20260207 20:53:33.769740 10871 raft_consensus.cc:2468] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e80d19442ec24e58bfc9a8c447d95f13 in term 0.
I20260207 20:53:33.771852 10756 leader_election.cc:304] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d37ceeaadbfd469492ce84c1a0273e06, e80d19442ec24e58bfc9a8c447d95f13; no voters:
I20260207 20:53:33.773103 11016 raft_consensus.cc:2804] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:33.773476 11016 raft_consensus.cc:493] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:33.773811 11016 raft_consensus.cc:3060] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:33.777154 10961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0a7af1f0dd148ab907572017497d038" candidate_uuid: "e80d19442ec24e58bfc9a8c447d95f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09825ebb10a54a35b8ef459b7db2d82f" is_pre_election: true
I20260207 20:53:33.777838 10961 raft_consensus.cc:2468] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e80d19442ec24e58bfc9a8c447d95f13 in term 0.
I20260207 20:53:33.784296 11016 raft_consensus.cc:515] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.785912 11016 leader_election.cc:290] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [CANDIDATE]: Term 1 election: Requested vote from peers d37ceeaadbfd469492ce84c1a0273e06 (127.2.223.2:41053), 09825ebb10a54a35b8ef459b7db2d82f (127.2.223.3:36137)
I20260207 20:53:33.786815 10961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0a7af1f0dd148ab907572017497d038" candidate_uuid: "e80d19442ec24e58bfc9a8c447d95f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09825ebb10a54a35b8ef459b7db2d82f"
I20260207 20:53:33.787024 10871 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0a7af1f0dd148ab907572017497d038" candidate_uuid: "e80d19442ec24e58bfc9a8c447d95f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37ceeaadbfd469492ce84c1a0273e06"
I20260207 20:53:33.787372 10961 raft_consensus.cc:3060] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:33.787571 10871 raft_consensus.cc:3060] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:33.794052 11010 raft_consensus.cc:493] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:33.795853 11010 raft_consensus.cc:515] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } }
I20260207 20:53:33.798187 10961 raft_consensus.cc:2468] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d19442ec24e58bfc9a8c447d95f13 in term 1.
I20260207 20:53:33.798579 10871 raft_consensus.cc:2468] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d19442ec24e58bfc9a8c447d95f13 in term 1.
I20260207 20:53:33.799294 11010 leader_election.cc:290] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d37ceeaadbfd469492ce84c1a0273e06 (127.2.223.2:41053), e80d19442ec24e58bfc9a8c447d95f13 (127.2.223.1:39255)
I20260207 20:53:33.800998 10759 leader_election.cc:304] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09825ebb10a54a35b8ef459b7db2d82f, e80d19442ec24e58bfc9a8c447d95f13; no voters:
I20260207 20:53:33.810506 11016 raft_consensus.cc:2804] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:33.815289 11016 raft_consensus.cc:697] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [term 1 LEADER]: Becoming Leader. State: Replica: e80d19442ec24e58bfc9a8c447d95f13, State: Running, Role: LEADER
I20260207 20:53:33.816252 11016 consensus_queue.cc:237] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.830529 11016 raft_consensus.cc:493] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:33.831174 11016 raft_consensus.cc:515] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } }
I20260207 20:53:33.841017 10793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1e16f206a3954c0fa3033a1371a02b9d" candidate_uuid: "09825ebb10a54a35b8ef459b7db2d82f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d19442ec24e58bfc9a8c447d95f13" is_pre_election: true
I20260207 20:53:33.841765 10793 raft_consensus.cc:2468] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09825ebb10a54a35b8ef459b7db2d82f in term 0.
I20260207 20:53:33.842641 10667 catalog_manager.cc:5654] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 reported cstate change: term changed from 0 to 1, leader changed from <none> to e80d19442ec24e58bfc9a8c447d95f13 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "e80d19442ec24e58bfc9a8c447d95f13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } health_report { overall_health: UNKNOWN } } }
I20260207 20:53:33.844635 10925 leader_election.cc:304] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09825ebb10a54a35b8ef459b7db2d82f, e80d19442ec24e58bfc9a8c447d95f13; no voters:
I20260207 20:53:33.845534 11010 raft_consensus.cc:2804] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:33.845892 11010 raft_consensus.cc:493] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:33.845894 10871 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1e16f206a3954c0fa3033a1371a02b9d" candidate_uuid: "09825ebb10a54a35b8ef459b7db2d82f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37ceeaadbfd469492ce84c1a0273e06" is_pre_election: true
I20260207 20:53:33.846455 11010 raft_consensus.cc:3060] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:33.846927 10871 raft_consensus.cc:2468] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09825ebb10a54a35b8ef459b7db2d82f in term 0.
I20260207 20:53:33.850751 10961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1e16f206a3954c0fa3033a1371a02b9d" candidate_uuid: "e80d19442ec24e58bfc9a8c447d95f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09825ebb10a54a35b8ef459b7db2d82f" is_pre_election: true
I20260207 20:53:33.854905 11010 raft_consensus.cc:515] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } }
I20260207 20:53:33.858093 10961 raft_consensus.cc:2393] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e80d19442ec24e58bfc9a8c447d95f13 in current term 1: Already voted for candidate 09825ebb10a54a35b8ef459b7db2d82f in this term.
I20260207 20:53:33.855353 11016 leader_election.cc:290] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09825ebb10a54a35b8ef459b7db2d82f (127.2.223.3:36137), d37ceeaadbfd469492ce84c1a0273e06 (127.2.223.2:41053)
I20260207 20:53:33.856421 10871 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1e16f206a3954c0fa3033a1371a02b9d" candidate_uuid: "e80d19442ec24e58bfc9a8c447d95f13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37ceeaadbfd469492ce84c1a0273e06" is_pre_election: true
I20260207 20:53:33.865283 11010 leader_election.cc:290] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [CANDIDATE]: Term 1 election: Requested vote from peers d37ceeaadbfd469492ce84c1a0273e06 (127.2.223.2:41053), e80d19442ec24e58bfc9a8c447d95f13 (127.2.223.1:39255)
I20260207 20:53:33.865756 10871 raft_consensus.cc:2468] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e80d19442ec24e58bfc9a8c447d95f13 in term 0.
I20260207 20:53:33.866793 10793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1e16f206a3954c0fa3033a1371a02b9d" candidate_uuid: "09825ebb10a54a35b8ef459b7db2d82f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d19442ec24e58bfc9a8c447d95f13"
I20260207 20:53:33.867347 10793 raft_consensus.cc:3060] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:33.871044 10756 leader_election.cc:304] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d37ceeaadbfd469492ce84c1a0273e06, e80d19442ec24e58bfc9a8c447d95f13; no voters: 09825ebb10a54a35b8ef459b7db2d82f
I20260207 20:53:33.873193 10871 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1e16f206a3954c0fa3033a1371a02b9d" candidate_uuid: "09825ebb10a54a35b8ef459b7db2d82f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d37ceeaadbfd469492ce84c1a0273e06"
I20260207 20:53:33.873641 10871 raft_consensus.cc:3060] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:33.874802 11011 raft_consensus.cc:493] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:33.875316 11011 raft_consensus.cc:515] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.877774 11011 leader_election.cc:290] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d19442ec24e58bfc9a8c447d95f13 (127.2.223.1:39255), 09825ebb10a54a35b8ef459b7db2d82f (127.2.223.3:36137)
I20260207 20:53:33.880415 10793 raft_consensus.cc:2468] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09825ebb10a54a35b8ef459b7db2d82f in term 1.
I20260207 20:53:33.881892 11016 raft_consensus.cc:2764] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260207 20:53:33.882534 10925 leader_election.cc:304] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09825ebb10a54a35b8ef459b7db2d82f, e80d19442ec24e58bfc9a8c447d95f13; no voters:
I20260207 20:53:33.883848 11010 raft_consensus.cc:2804] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:33.884584 10871 raft_consensus.cc:2468] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09825ebb10a54a35b8ef459b7db2d82f in term 1.
I20260207 20:53:33.893409 11010 raft_consensus.cc:697] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [term 1 LEADER]: Becoming Leader. State: Replica: 09825ebb10a54a35b8ef459b7db2d82f, State: Running, Role: LEADER
I20260207 20:53:33.894457 11010 consensus_queue.cc:237] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } }
I20260207 20:53:33.902164 10793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee0e5d63f2d54b94b2db03ff73a5239f" candidate_uuid: "d37ceeaadbfd469492ce84c1a0273e06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d19442ec24e58bfc9a8c447d95f13" is_pre_election: true
I20260207 20:53:33.903302 10793 raft_consensus.cc:2468] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d37ceeaadbfd469492ce84c1a0273e06 in term 0.
I20260207 20:53:33.905344 10836 leader_election.cc:304] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d37ceeaadbfd469492ce84c1a0273e06, e80d19442ec24e58bfc9a8c447d95f13; no voters:
I20260207 20:53:33.907842 11011 raft_consensus.cc:2804] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:33.908313 11011 raft_consensus.cc:493] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:33.908762 11011 raft_consensus.cc:3060] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:33.915647 10667 catalog_manager.cc:5654] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f reported cstate change: term changed from 0 to 1, leader changed from <none> to 09825ebb10a54a35b8ef459b7db2d82f (127.2.223.3). New cstate: current_term: 1 leader_uuid: "09825ebb10a54a35b8ef459b7db2d82f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } health_report { overall_health: UNKNOWN } } }
I20260207 20:53:33.918720 10961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee0e5d63f2d54b94b2db03ff73a5239f" candidate_uuid: "d37ceeaadbfd469492ce84c1a0273e06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09825ebb10a54a35b8ef459b7db2d82f" is_pre_election: true
I20260207 20:53:33.919384 10961 raft_consensus.cc:2468] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d37ceeaadbfd469492ce84c1a0273e06 in term 0.
I20260207 20:53:33.921707 11011 raft_consensus.cc:515] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.924284 10793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee0e5d63f2d54b94b2db03ff73a5239f" candidate_uuid: "d37ceeaadbfd469492ce84c1a0273e06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d19442ec24e58bfc9a8c447d95f13"
I20260207 20:53:33.924816 10793 raft_consensus.cc:3060] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:33.930496 10793 raft_consensus.cc:2468] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37ceeaadbfd469492ce84c1a0273e06 in term 1.
I20260207 20:53:33.931813 10836 leader_election.cc:304] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d37ceeaadbfd469492ce84c1a0273e06, e80d19442ec24e58bfc9a8c447d95f13; no voters:
I20260207 20:53:33.933840 11011 leader_election.cc:290] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [CANDIDATE]: Term 1 election: Requested vote from peers e80d19442ec24e58bfc9a8c447d95f13 (127.2.223.1:39255), 09825ebb10a54a35b8ef459b7db2d82f (127.2.223.3:36137)
I20260207 20:53:33.934841 11011 raft_consensus.cc:2804] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:33.934165 10961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee0e5d63f2d54b94b2db03ff73a5239f" candidate_uuid: "d37ceeaadbfd469492ce84c1a0273e06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09825ebb10a54a35b8ef459b7db2d82f"
I20260207 20:53:33.936157 10961 raft_consensus.cc:3060] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:33.943029 10961 raft_consensus.cc:2468] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d37ceeaadbfd469492ce84c1a0273e06 in term 1.
I20260207 20:53:33.943852 11011 raft_consensus.cc:697] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [term 1 LEADER]: Becoming Leader. State: Replica: d37ceeaadbfd469492ce84c1a0273e06, State: Running, Role: LEADER
I20260207 20:53:33.945156 11011 consensus_queue.cc:237] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } }
I20260207 20:53:33.968961 10667 catalog_manager.cc:5654] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 reported cstate change: term changed from 0 to 1, leader changed from <none> to d37ceeaadbfd469492ce84c1a0273e06 (127.2.223.2). New cstate: current_term: 1 leader_uuid: "d37ceeaadbfd469492ce84c1a0273e06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 } health_report { overall_health: UNKNOWN } } }
I20260207 20:53:34.258011 11016 consensus_queue.cc:1048] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:34.288475 11010 consensus_queue.cc:1048] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:34.348062 11011 consensus_queue.cc:1048] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:34.399464 11048 consensus_queue.cc:1048] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d37ceeaadbfd469492ce84c1a0273e06" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 41053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:34.431519 11054 consensus_queue.cc:1048] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d19442ec24e58bfc9a8c447d95f13" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 39255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:34.502331 11032 consensus_queue.cc:1048] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09825ebb10a54a35b8ef459b7db2d82f" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:34.873996 10781 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:53:34.877784 10950 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:53:34.878424 10860 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:53:35.295207 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:53:35.342459 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260207 20:53:35.342832 10836 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260207 20:53:35.344973 2940 tablet_replica.cc:333] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13: stopping tablet replica
W20260207 20:53:35.346540 10836 consensus_peers.cc:597] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 -> Peer e80d19442ec24e58bfc9a8c447d95f13 (127.2.223.1:39255): Couldn't send request to peer e80d19442ec24e58bfc9a8c447d95f13. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:35.347815 2940 raft_consensus.cc:2243] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:35.348454 2940 raft_consensus.cc:2272] T 1e16f206a3954c0fa3033a1371a02b9d P e80d19442ec24e58bfc9a8c447d95f13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:35.351730 2940 tablet_replica.cc:333] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13: stopping tablet replica
W20260207 20:53:35.351634 10925 consensus_peers.cc:597] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f -> Peer e80d19442ec24e58bfc9a8c447d95f13 (127.2.223.1:39255): Couldn't send request to peer e80d19442ec24e58bfc9a8c447d95f13. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:35.352461 2940 raft_consensus.cc:2243] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:35.353648 2940 raft_consensus.cc:2272] T f0a7af1f0dd148ab907572017497d038 P e80d19442ec24e58bfc9a8c447d95f13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:35.356287 2940 tablet_replica.cc:333] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13: stopping tablet replica
I20260207 20:53:35.356726 2940 raft_consensus.cc:2243] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:35.357105 2940 raft_consensus.cc:2272] T ee0e5d63f2d54b94b2db03ff73a5239f P e80d19442ec24e58bfc9a8c447d95f13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:35.383442 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:53:35.397590 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:53:35.435806 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:35.436470 2940 tablet_replica.cc:333] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06: stopping tablet replica
I20260207 20:53:35.437216 2940 raft_consensus.cc:2243] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:35.437800 2940 raft_consensus.cc:2272] T f0a7af1f0dd148ab907572017497d038 P d37ceeaadbfd469492ce84c1a0273e06 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260207 20:53:35.438273 10921 consensus_peers.cc:597] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f -> Peer d37ceeaadbfd469492ce84c1a0273e06 (127.2.223.2:41053): Couldn't send request to peer d37ceeaadbfd469492ce84c1a0273e06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:35.442044 2940 tablet_replica.cc:333] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06: stopping tablet replica
I20260207 20:53:35.442641 2940 raft_consensus.cc:2243] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:35.443179 2940 raft_consensus.cc:2272] T 1e16f206a3954c0fa3033a1371a02b9d P d37ceeaadbfd469492ce84c1a0273e06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:35.445292 2940 tablet_replica.cc:333] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06: stopping tablet replica
I20260207 20:53:35.445741 2940 raft_consensus.cc:2243] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:35.446480 2940 raft_consensus.cc:2272] T ee0e5d63f2d54b94b2db03ff73a5239f P d37ceeaadbfd469492ce84c1a0273e06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:35.460949 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:53:35.474354 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:53:35.502832 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:35.503379 2940 tablet_replica.cc:333] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f: stopping tablet replica
I20260207 20:53:35.503894 2940 raft_consensus.cc:2243] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:35.504288 2940 raft_consensus.cc:2272] T f0a7af1f0dd148ab907572017497d038 P 09825ebb10a54a35b8ef459b7db2d82f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:35.505996 2940 tablet_replica.cc:333] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f: stopping tablet replica
I20260207 20:53:35.506444 2940 raft_consensus.cc:2243] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:35.506830 2940 raft_consensus.cc:2272] T ee0e5d63f2d54b94b2db03ff73a5239f P 09825ebb10a54a35b8ef459b7db2d82f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:35.508894 2940 tablet_replica.cc:333] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f: stopping tablet replica
I20260207 20:53:35.509325 2940 raft_consensus.cc:2243] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:35.510008 2940 raft_consensus.cc:2272] T 1e16f206a3954c0fa3033a1371a02b9d P 09825ebb10a54a35b8ef459b7db2d82f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:35.530117 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:53:35.542829 2940 master.cc:561] Master@127.2.223.62:43147 shutting down...
I20260207 20:53:35.561075 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:35.561594 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:35.561893 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2d4546720d7e4ae89fe44644c3e7da4b: stopping tablet replica
W20260207 20:53:35.567274 10524 connection.cc:441] server connection from 127.0.0.1:53478 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53478 (request call id 23) could send its response
W20260207 20:53:35.568114 10651 consensus_peers.cc:597] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 -> Peer 2d4546720d7e4ae89fe44644c3e7da4b (127.2.223.62:43147): Couldn't send request to peer 2d4546720d7e4ae89fe44644c3e7da4b. Status: Network error: recv got EOF from 127.2.223.62:43147 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:35.571182 2940 master.cc:583] Master@127.2.223.62:43147 shutdown complete.
I20260207 20:53:35.584712 2940 master.cc:561] Master@127.2.223.61:40687 shutting down...
I20260207 20:53:35.601248 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:35.601787 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:35.602083 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P a6407e0a4dc744479e89790441868989: stopping tablet replica
I20260207 20:53:35.620554 2940 master.cc:583] Master@127.2.223.61:40687 shutdown complete.
I20260207 20:53:35.632036 2940 master.cc:561] Master@127.2.223.60:36521 shutting down...
I20260207 20:53:35.647048 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:35.647852 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:35.648171 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6c472825eca34837a1cf5a01f1b93777: stopping tablet replica
I20260207 20:53:35.667464 2940 master.cc:583] Master@127.2.223.60:36521 shutdown complete.
[ OK ] RemoteKsckTest.TestNonMatchingTableFilter (3344 ms)
[ RUN ] RemoteKsckTest.TestMatchingTableFilter
I20260207 20:53:35.696597 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:43487,127.2.223.61:43987,127.2.223.60:38499
I20260207 20:53:35.697855 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:35.702740 11096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:35.702930 11097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:35.703991 11099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:35.705117 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:35.705929 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:35.706100 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:35.706246 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497615706230 us; error 0 us; skew 500 ppm
I20260207 20:53:35.706801 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:35.708992 2940 webserver.cc:492] Webserver started at http://127.2.223.62:35369/ using document root <none> and password file <none>
I20260207 20:53:35.709435 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:35.709599 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:35.709847 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:35.710942 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "2328ff42e29e46778cdc824f3c97b102"
format_stamp: "Formatted at 2026-02-07 20:53:35 on dist-test-slave-kqw4"
I20260207 20:53:35.715113 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260207 20:53:35.718148 11104 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:35.718909 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260207 20:53:35.719166 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "2328ff42e29e46778cdc824f3c97b102"
format_stamp: "Formatted at 2026-02-07 20:53:35 on dist-test-slave-kqw4"
I20260207 20:53:35.719427 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:35.728267 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:35.729180 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:35.762171 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:43487
I20260207 20:53:35.762266 11155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:43487 every 8 connection(s)
I20260207 20:53:35.765786 11156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:35.765949 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:35.770893 11158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:35.771868 11159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:35.773281 11156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:35.773878 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:35.774283 11161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:35.775360 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:35.775673 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:35.775875 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497615775858 us; error 0 us; skew 500 ppm
I20260207 20:53:35.776595 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:35.779402 2940 webserver.cc:492] Webserver started at http://127.2.223.61:43831/ using document root <none> and password file <none>
I20260207 20:53:35.780036 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:35.780261 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:35.780555 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:35.781689 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "858f4df45e154ff19efa971d0b619ccb"
format_stamp: "Formatted at 2026-02-07 20:53:35 on dist-test-slave-kqw4"
I20260207 20:53:35.786376 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:53:35.789269 11156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:35.791267 11168 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:35.792011 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260207 20:53:35.792273 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "858f4df45e154ff19efa971d0b619ccb"
format_stamp: "Formatted at 2026-02-07 20:53:35 on dist-test-slave-kqw4"
I20260207 20:53:35.792522 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:53:35.794816 11156 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:43987: Network error: Client connection negotiation failed: client connection to 127.2.223.61:43987: connect: Connection refused (error 111)
I20260207 20:53:35.805366 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:35.806403 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:35.822360 11156 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } attempt: 1
W20260207 20:53:35.827287 11156 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:43987: Network error: Client connection negotiation failed: client connection to 127.2.223.61:43987: connect: Connection refused (error 111)
I20260207 20:53:35.842734 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:43987
I20260207 20:53:35.842828 11220 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:43987 every 8 connection(s)
I20260207 20:53:35.846519 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:35.846712 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:35.852532 11223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:35.852634 11224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:35.855039 11221 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:35.855144 11226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:35.855986 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:35.857035 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:35.857290 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:35.857488 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497615857472 us; error 0 us; skew 500 ppm
I20260207 20:53:35.858070 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:35.860666 2940 webserver.cc:492] Webserver started at http://127.2.223.60:33923/ using document root <none> and password file <none>
I20260207 20:53:35.861127 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:35.861302 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:35.861536 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:35.862502 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "4b61611da3034cec95601675841de45e"
format_stamp: "Formatted at 2026-02-07 20:53:35 on dist-test-slave-kqw4"
I20260207 20:53:35.866357 11221 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:35.867193 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260207 20:53:35.868731 11156 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } attempt: 2
I20260207 20:53:35.879618 11221 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:35.879621 11234 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:35.881034 2940 fs_manager.cc:730] Time spent opening block manager: real 0.011s user 0.005s sys 0.001s
I20260207 20:53:35.881453 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "4b61611da3034cec95601675841de45e"
format_stamp: "Formatted at 2026-02-07 20:53:35 on dist-test-slave-kqw4"
I20260207 20:53:35.881820 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:35.884766 11156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:35.885928 11221 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38499: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38499: connect: Connection refused (error 111)
W20260207 20:53:35.889328 11156 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38499: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38499: connect: Connection refused (error 111)
I20260207 20:53:35.904461 11221 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } attempt: 1
I20260207 20:53:35.907187 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:35.908141 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260207 20:53:35.908422 11221 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38499: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38499: connect: Connection refused (error 111)
I20260207 20:53:35.917865 11156 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } attempt: 1
W20260207 20:53:35.922753 11156 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38499: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38499: connect: Connection refused (error 111)
I20260207 20:53:35.942956 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:38499
I20260207 20:53:35.943041 11286 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:38499 every 8 connection(s)
I20260207 20:53:35.945896 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:53:35.946568 11287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:35.952667 11287 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:35.962494 11287 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:35.971329 11287 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:35.986907 11287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e: Bootstrap starting.
I20260207 20:53:35.988878 11221 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } attempt: 2
I20260207 20:53:35.991643 11287 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:35.996215 11287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e: No bootstrap required, opened a new log
I20260207 20:53:35.996265 11156 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } attempt: 2
I20260207 20:53:35.999294 11287 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } }
I20260207 20:53:36.000083 11287 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:36.000324 11287 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b61611da3034cec95601675841de45e, State: Initialized, Role: FOLLOWER
I20260207 20:53:36.000909 11287 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } }
I20260207 20:53:36.002763 11292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } } }
I20260207 20:53:36.003547 11292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:36.004390 11287 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:36.007679 11221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb: Bootstrap starting.
I20260207 20:53:36.013669 11221 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:36.015776 11156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102: Bootstrap starting.
I20260207 20:53:36.020501 11221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb: No bootstrap required, opened a new log
W20260207 20:53:36.021157 11304 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:36.021488 11304 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:36.021955 11156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:36.023311 11221 raft_consensus.cc:359] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } }
I20260207 20:53:36.024050 11221 raft_consensus.cc:385] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:36.024348 11221 raft_consensus.cc:740] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858f4df45e154ff19efa971d0b619ccb, State: Initialized, Role: FOLLOWER
I20260207 20:53:36.025024 11221 consensus_queue.cc:260] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } }
I20260207 20:53:36.026692 11156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102: No bootstrap required, opened a new log
I20260207 20:53:36.026773 11306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } } }
I20260207 20:53:36.027451 11306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:36.028554 11221 sys_catalog.cc:565] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:36.029488 11156 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } }
I20260207 20:53:36.030194 11156 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:36.030462 11156 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2328ff42e29e46778cdc824f3c97b102, State: Initialized, Role: FOLLOWER
I20260207 20:53:36.031333 11156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } }
I20260207 20:53:36.033316 11309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } } }
I20260207 20:53:36.034003 11309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:36.035215 11156 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [sys.catalog]: configured and running, proceeding with master startup.
W20260207 20:53:36.044689 11322 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:36.045035 11322 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:36.047447 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:53:36.047799 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:53:36.049528 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:36.051427 11329 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:36.051772 11329 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:53:36.056275 11330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:36.056620 11331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:36.059245 11333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:36.059278 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:36.060293 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:36.060492 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:36.060645 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497616060630 us; error 0 us; skew 500 ppm
I20260207 20:53:36.061147 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:36.063321 2940 webserver.cc:492] Webserver started at http://127.2.223.1:45261/ using document root <none> and password file <none>
I20260207 20:53:36.063762 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:36.063926 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:36.064152 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:36.065132 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "e75012de8f40435c968d0036151436cc"
format_stamp: "Formatted at 2026-02-07 20:53:36 on dist-test-slave-kqw4"
I20260207 20:53:36.069106 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260207 20:53:36.072079 11338 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:36.072753 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260207 20:53:36.073022 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "e75012de8f40435c968d0036151436cc"
format_stamp: "Formatted at 2026-02-07 20:53:36 on dist-test-slave-kqw4"
I20260207 20:53:36.073267 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:36.093151 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:36.094205 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:36.095599 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:36.097762 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:36.097959 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:36.098170 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:36.098320 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:36.134650 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:41433
I20260207 20:53:36.134747 11400 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:41433 every 8 connection(s)
I20260207 20:53:36.152940 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:36.155969 11402 heartbeater.cc:344] Connected to a master server at 127.2.223.61:43987
I20260207 20:53:36.156028 11401 heartbeater.cc:344] Connected to a master server at 127.2.223.60:38499
I20260207 20:53:36.156154 11403 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43487
I20260207 20:53:36.156656 11402 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:36.156765 11401 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:36.156810 11403 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:36.157557 11402 heartbeater.cc:507] Master 127.2.223.61:43987 requested a full tablet report, sending...
I20260207 20:53:36.157886 11401 heartbeater.cc:507] Master 127.2.223.60:38499 requested a full tablet report, sending...
I20260207 20:53:36.157848 11403 heartbeater.cc:507] Master 127.2.223.62:43487 requested a full tablet report, sending...
I20260207 20:53:36.160712 11186 ts_manager.cc:194] Registered new tserver with Master: e75012de8f40435c968d0036151436cc (127.2.223.1:41433)
I20260207 20:53:36.160990 11121 ts_manager.cc:194] Registered new tserver with Master: e75012de8f40435c968d0036151436cc (127.2.223.1:41433)
W20260207 20:53:36.162972 11408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:36.163055 11252 ts_manager.cc:194] Registered new tserver with Master: e75012de8f40435c968d0036151436cc (127.2.223.1:41433)
W20260207 20:53:36.164722 11409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:36.167112 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:36.167593 11412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:36.168397 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:36.168592 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:36.168730 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497616168718 us; error 0 us; skew 500 ppm
I20260207 20:53:36.169200 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:36.171387 2940 webserver.cc:492] Webserver started at http://127.2.223.2:42465/ using document root <none> and password file <none>
I20260207 20:53:36.171829 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:36.172019 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:36.172236 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:36.173338 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "e94bb28bf4e040b990e71854c9e3519e"
format_stamp: "Formatted at 2026-02-07 20:53:36 on dist-test-slave-kqw4"
I20260207 20:53:36.178833 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260207 20:53:36.181907 11416 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:36.182646 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:53:36.182961 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "e94bb28bf4e040b990e71854c9e3519e"
format_stamp: "Formatted at 2026-02-07 20:53:36 on dist-test-slave-kqw4"
I20260207 20:53:36.183214 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:36.205159 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:36.206228 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:36.207598 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:36.209738 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:36.209951 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:36.210166 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:36.210318 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:36.231920 11306 raft_consensus.cc:493] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:36.232455 11306 raft_consensus.cc:515] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } }
I20260207 20:53:36.234192 11306 leader_election.cc:290] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2328ff42e29e46778cdc824f3c97b102 (127.2.223.62:43487), 4b61611da3034cec95601675841de45e (127.2.223.60:38499)
I20260207 20:53:36.234872 11131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "858f4df45e154ff19efa971d0b619ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2328ff42e29e46778cdc824f3c97b102" is_pre_election: true
I20260207 20:53:36.235576 11131 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858f4df45e154ff19efa971d0b619ccb in term 0.
I20260207 20:53:36.235798 11262 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "858f4df45e154ff19efa971d0b619ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b61611da3034cec95601675841de45e" is_pre_election: true
I20260207 20:53:36.236449 11262 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858f4df45e154ff19efa971d0b619ccb in term 0.
I20260207 20:53:36.236994 11170 leader_election.cc:304] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2328ff42e29e46778cdc824f3c97b102, 858f4df45e154ff19efa971d0b619ccb; no voters:
I20260207 20:53:36.237883 11306 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:36.238215 11306 raft_consensus.cc:493] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:36.238517 11306 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:36.246423 11306 raft_consensus.cc:515] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } }
I20260207 20:53:36.249105 11131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "858f4df45e154ff19efa971d0b619ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2328ff42e29e46778cdc824f3c97b102"
I20260207 20:53:36.249801 11131 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:36.250022 11262 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "858f4df45e154ff19efa971d0b619ccb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b61611da3034cec95601675841de45e"
I20260207 20:53:36.250658 11262 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:36.254725 11306 leader_election.cc:290] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [CANDIDATE]: Term 1 election: Requested vote from peers 2328ff42e29e46778cdc824f3c97b102 (127.2.223.62:43487), 4b61611da3034cec95601675841de45e (127.2.223.60:38499)
I20260207 20:53:36.255674 11262 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858f4df45e154ff19efa971d0b619ccb in term 1.
I20260207 20:53:36.258163 11173 leader_election.cc:304] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b61611da3034cec95601675841de45e, 858f4df45e154ff19efa971d0b619ccb; no voters:
I20260207 20:53:36.258526 11131 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858f4df45e154ff19efa971d0b619ccb in term 1.
I20260207 20:53:36.259094 11306 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:36.262290 11306 raft_consensus.cc:697] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [term 1 LEADER]: Becoming Leader. State: Replica: 858f4df45e154ff19efa971d0b619ccb, State: Running, Role: LEADER
I20260207 20:53:36.263084 11306 consensus_queue.cc:237] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } }
I20260207 20:53:36.267840 11458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 858f4df45e154ff19efa971d0b619ccb. Latest consensus state: current_term: 1 leader_uuid: "858f4df45e154ff19efa971d0b619ccb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } } }
I20260207 20:53:36.268456 11458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:36.275758 11468 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:53:36.280392 11468 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:53:36.287187 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:45927
I20260207 20:53:36.287290 11481 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:45927 every 8 connection(s)
I20260207 20:53:36.291445 11262 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [term 1 FOLLOWER]: Refusing update from remote peer 858f4df45e154ff19efa971d0b619ccb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:36.291589 11131 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [term 1 FOLLOWER]: Refusing update from remote peer 858f4df45e154ff19efa971d0b619ccb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:36.293030 11458 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:36.294369 11306 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:36.309419 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:36.319202 11292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 858f4df45e154ff19efa971d0b619ccb. Latest consensus state: current_term: 1 leader_uuid: "858f4df45e154ff19efa971d0b619ccb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } } }
I20260207 20:53:36.320024 11292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [sys.catalog]: This master's current role is: FOLLOWER
W20260207 20:53:36.323771 11492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:36.326957 11484 heartbeater.cc:344] Connected to a master server at 127.2.223.61:43987
I20260207 20:53:36.327409 11484 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:36.328336 11484 heartbeater.cc:507] Master 127.2.223.61:43987 requested a full tablet report, sending...
W20260207 20:53:36.329563 11494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:36.333707 11306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "858f4df45e154ff19efa971d0b619ccb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } } }
I20260207 20:53:36.334293 11306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:36.334753 11186 ts_manager.cc:194] Registered new tserver with Master: e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927)
I20260207 20:53:36.337349 11468 catalog_manager.cc:1357] Generated new cluster ID: 427f7f9b079242bab4fac0a6d1e61b01
I20260207 20:53:36.337669 11468 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:53:36.340205 11292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "858f4df45e154ff19efa971d0b619ccb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } } }
I20260207 20:53:36.340936 11485 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43487
I20260207 20:53:36.341359 11485 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:36.342201 11485 heartbeater.cc:507] Master 127.2.223.62:43487 requested a full tablet report, sending...
I20260207 20:53:36.340958 11292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:36.358966 11483 heartbeater.cc:344] Connected to a master server at 127.2.223.60:38499
I20260207 20:53:36.359460 11483 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:36.363765 11483 heartbeater.cc:507] Master 127.2.223.60:38499 requested a full tablet report, sending...
I20260207 20:53:36.380656 11252 ts_manager.cc:194] Registered new tserver with Master: e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927)
I20260207 20:53:36.392457 11468 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:53:36.392223 11309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 858f4df45e154ff19efa971d0b619ccb. Latest consensus state: current_term: 1 leader_uuid: "858f4df45e154ff19efa971d0b619ccb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } } }
I20260207 20:53:36.393314 11309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:36.395293 11120 ts_manager.cc:194] Registered new tserver with Master: e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927)
I20260207 20:53:36.399398 11468 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:53:36.405360 11306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "858f4df45e154ff19efa971d0b619ccb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } } }
I20260207 20:53:36.406109 11306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:36.413117 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:36.417747 11499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:36.419025 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:36.419389 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:36.419652 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497616419633 us; error 0 us; skew 500 ppm
I20260207 20:53:36.420480 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:36.423419 11309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "858f4df45e154ff19efa971d0b619ccb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2328ff42e29e46778cdc824f3c97b102" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 43487 } } peers { permanent_uuid: "858f4df45e154ff19efa971d0b619ccb" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 43987 } } peers { permanent_uuid: "4b61611da3034cec95601675841de45e" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38499 } } }
I20260207 20:53:36.424211 11309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:36.436832 11468 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb: Generated new TSK 0
I20260207 20:53:36.437724 11468 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:53:36.437878 2940 webserver.cc:492] Webserver started at http://127.2.223.3:36831/ using document root <none> and password file <none>
I20260207 20:53:36.438555 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:36.438831 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:36.439138 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:36.440516 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d"
format_stamp: "Formatted at 2026-02-07 20:53:36 on dist-test-slave-kqw4"
I20260207 20:53:36.452487 11186 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34484
I20260207 20:53:36.453711 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.012s user 0.009s sys 0.000s
I20260207 20:53:36.458171 11506 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:36.460539 2940 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260207 20:53:36.460934 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d"
format_stamp: "Formatted at 2026-02-07 20:53:36 on dist-test-slave-kqw4"
I20260207 20:53:36.461336 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTableFilter.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:36.462499 11186 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34478
I20260207 20:53:36.465382 11484 heartbeater.cc:499] Master 127.2.223.61:43987 was elected leader, sending a full tablet report...
I20260207 20:53:36.475270 11402 heartbeater.cc:499] Master 127.2.223.61:43987 was elected leader, sending a full tablet report...
I20260207 20:53:36.484920 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:36.486289 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:36.487756 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:36.490463 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:36.490777 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260207 20:53:36.491063 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:36.491268 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:36.555099 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:45591
I20260207 20:53:36.555207 11568 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:45591 every 8 connection(s)
I20260207 20:53:36.584491 11569 heartbeater.cc:344] Connected to a master server at 127.2.223.60:38499
I20260207 20:53:36.584925 11569 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:36.585777 11569 heartbeater.cc:507] Master 127.2.223.60:38499 requested a full tablet report, sending...
I20260207 20:53:36.589049 11252 ts_manager.cc:194] Registered new tserver with Master: b4d9c112d3e1479c9c257a3e4ef37b5d (127.2.223.3:45591)
I20260207 20:53:36.592382 11570 heartbeater.cc:344] Connected to a master server at 127.2.223.61:43987
I20260207 20:53:36.592851 11570 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:36.593731 11570 heartbeater.cc:507] Master 127.2.223.61:43987 requested a full tablet report, sending...
I20260207 20:53:36.595853 11185 ts_manager.cc:194] Registered new tserver with Master: b4d9c112d3e1479c9c257a3e4ef37b5d (127.2.223.3:45591)
I20260207 20:53:36.595923 11572 heartbeater.cc:344] Connected to a master server at 127.2.223.62:43487
I20260207 20:53:36.596529 11572 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:36.597404 11572 heartbeater.cc:507] Master 127.2.223.62:43487 requested a full tablet report, sending...
I20260207 20:53:36.597610 11185 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34490
I20260207 20:53:36.599900 11120 ts_manager.cc:194] Registered new tserver with Master: b4d9c112d3e1479c9c257a3e4ef37b5d (127.2.223.3:45591)
I20260207 20:53:36.601516 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01987986s
I20260207 20:53:36.610855 11570 heartbeater.cc:499] Master 127.2.223.61:43987 was elected leader, sending a full tablet report...
I20260207 20:53:36.658862 11186 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34498:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:53:36.662160 11186 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:53:36.762234 11444 tablet_service.cc:1505] Processing CreateTablet for tablet e69305c4aab1448995403a4dc6272025 (DEFAULT_TABLE table=ksck-test-table [id=f1447d9dea124ff1a3242121d1e5ae0d]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:36.762410 11534 tablet_service.cc:1505] Processing CreateTablet for tablet e69305c4aab1448995403a4dc6272025 (DEFAULT_TABLE table=ksck-test-table [id=f1447d9dea124ff1a3242121d1e5ae0d]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:36.762893 11533 tablet_service.cc:1505] Processing CreateTablet for tablet a5755912cae74ec8a689e3085dafc8da (DEFAULT_TABLE table=ksck-test-table [id=f1447d9dea124ff1a3242121d1e5ae0d]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:36.763806 11534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69305c4aab1448995403a4dc6272025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:36.764487 11533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5755912cae74ec8a689e3085dafc8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:36.766530 11443 tablet_service.cc:1505] Processing CreateTablet for tablet a5755912cae74ec8a689e3085dafc8da (DEFAULT_TABLE table=ksck-test-table [id=f1447d9dea124ff1a3242121d1e5ae0d]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:36.763720 11444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69305c4aab1448995403a4dc6272025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:36.772612 11443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5755912cae74ec8a689e3085dafc8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:36.774062 11532 tablet_service.cc:1505] Processing CreateTablet for tablet d4723af3dcb14dcbb5844c09f599216f (DEFAULT_TABLE table=ksck-test-table [id=f1447d9dea124ff1a3242121d1e5ae0d]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:36.775470 11532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4723af3dcb14dcbb5844c09f599216f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:36.782930 11442 tablet_service.cc:1505] Processing CreateTablet for tablet d4723af3dcb14dcbb5844c09f599216f (DEFAULT_TABLE table=ksck-test-table [id=f1447d9dea124ff1a3242121d1e5ae0d]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:36.784394 11442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4723af3dcb14dcbb5844c09f599216f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:36.797797 11366 tablet_service.cc:1505] Processing CreateTablet for tablet e69305c4aab1448995403a4dc6272025 (DEFAULT_TABLE table=ksck-test-table [id=f1447d9dea124ff1a3242121d1e5ae0d]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:36.806579 11365 tablet_service.cc:1505] Processing CreateTablet for tablet a5755912cae74ec8a689e3085dafc8da (DEFAULT_TABLE table=ksck-test-table [id=f1447d9dea124ff1a3242121d1e5ae0d]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:36.807726 11366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69305c4aab1448995403a4dc6272025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:36.808357 11365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5755912cae74ec8a689e3085dafc8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:36.809413 11590 tablet_bootstrap.cc:492] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e: Bootstrap starting.
I20260207 20:53:36.815196 11589 tablet_bootstrap.cc:492] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d: Bootstrap starting.
I20260207 20:53:36.822342 11590 tablet_bootstrap.cc:654] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:36.825863 11364 tablet_service.cc:1505] Processing CreateTablet for tablet d4723af3dcb14dcbb5844c09f599216f (DEFAULT_TABLE table=ksck-test-table [id=f1447d9dea124ff1a3242121d1e5ae0d]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:36.827204 11364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4723af3dcb14dcbb5844c09f599216f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:36.828580 11589 tablet_bootstrap.cc:654] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:36.891453 11590 tablet_bootstrap.cc:492] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e: No bootstrap required, opened a new log
I20260207 20:53:36.891992 11590 ts_tablet_manager.cc:1403] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e: Time spent bootstrapping tablet: real 0.083s user 0.021s sys 0.018s
I20260207 20:53:36.894687 11590 raft_consensus.cc:359] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:36.895373 11590 raft_consensus.cc:385] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:36.895684 11590 raft_consensus.cc:740] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e94bb28bf4e040b990e71854c9e3519e, State: Initialized, Role: FOLLOWER
I20260207 20:53:36.897810 11593 tablet_bootstrap.cc:492] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc: Bootstrap starting.
I20260207 20:53:36.896346 11590 consensus_queue.cc:260] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:36.899904 11589 tablet_bootstrap.cc:492] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d: No bootstrap required, opened a new log
I20260207 20:53:36.900492 11589 ts_tablet_manager.cc:1403] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d: Time spent bootstrapping tablet: real 0.086s user 0.019s sys 0.020s
I20260207 20:53:36.903420 11589 raft_consensus.cc:359] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:36.910326 11589 raft_consensus.cc:385] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:36.910717 11589 raft_consensus.cc:740] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4d9c112d3e1479c9c257a3e4ef37b5d, State: Initialized, Role: FOLLOWER
I20260207 20:53:36.911633 11589 consensus_queue.cc:260] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:36.912815 11593 tablet_bootstrap.cc:654] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:36.928171 11590 ts_tablet_manager.cc:1434] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e: Time spent starting tablet: real 0.036s user 0.007s sys 0.013s
I20260207 20:53:36.929278 11590 tablet_bootstrap.cc:492] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e: Bootstrap starting.
I20260207 20:53:36.941596 11590 tablet_bootstrap.cc:654] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:36.954836 11593 tablet_bootstrap.cc:492] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc: No bootstrap required, opened a new log
I20260207 20:53:36.955370 11593 ts_tablet_manager.cc:1403] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc: Time spent bootstrapping tablet: real 0.058s user 0.017s sys 0.020s
I20260207 20:53:36.958324 11589 ts_tablet_manager.cc:1434] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d: Time spent starting tablet: real 0.057s user 0.005s sys 0.008s
I20260207 20:53:36.959033 11593 raft_consensus.cc:359] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:36.959560 11589 tablet_bootstrap.cc:492] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d: Bootstrap starting.
I20260207 20:53:36.959798 11593 raft_consensus.cc:385] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:36.960129 11593 raft_consensus.cc:740] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e75012de8f40435c968d0036151436cc, State: Initialized, Role: FOLLOWER
I20260207 20:53:36.960948 11593 consensus_queue.cc:260] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:36.965528 11590 tablet_bootstrap.cc:492] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e: No bootstrap required, opened a new log
I20260207 20:53:36.966059 11590 ts_tablet_manager.cc:1403] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e: Time spent bootstrapping tablet: real 0.037s user 0.009s sys 0.002s
I20260207 20:53:36.974239 11589 tablet_bootstrap.cc:654] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:36.977738 11593 ts_tablet_manager.cc:1434] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc: Time spent starting tablet: real 0.022s user 0.008s sys 0.005s
I20260207 20:53:36.981194 11593 tablet_bootstrap.cc:492] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc: Bootstrap starting.
I20260207 20:53:36.973941 11590 raft_consensus.cc:359] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } }
I20260207 20:53:36.991873 11590 raft_consensus.cc:385] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:36.992257 11590 raft_consensus.cc:740] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e94bb28bf4e040b990e71854c9e3519e, State: Initialized, Role: FOLLOWER
I20260207 20:53:36.992812 11590 consensus_queue.cc:260] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } }
I20260207 20:53:36.994833 11590 ts_tablet_manager.cc:1434] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e: Time spent starting tablet: real 0.028s user 0.005s sys 0.003s
I20260207 20:53:36.995888 11590 tablet_bootstrap.cc:492] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e: Bootstrap starting.
I20260207 20:53:36.996292 11593 tablet_bootstrap.cc:654] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:37.004066 11589 tablet_bootstrap.cc:492] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d: No bootstrap required, opened a new log
I20260207 20:53:37.004747 11589 ts_tablet_manager.cc:1403] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.012s
I20260207 20:53:37.011142 11590 tablet_bootstrap.cc:654] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:37.011508 11589 raft_consensus.cc:359] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:37.012482 11589 raft_consensus.cc:385] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:37.012837 11589 raft_consensus.cc:740] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4d9c112d3e1479c9c257a3e4ef37b5d, State: Initialized, Role: FOLLOWER
I20260207 20:53:37.014396 11593 tablet_bootstrap.cc:492] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc: No bootstrap required, opened a new log
I20260207 20:53:37.014963 11593 ts_tablet_manager.cc:1403] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc: Time spent bootstrapping tablet: real 0.034s user 0.007s sys 0.010s
I20260207 20:53:37.013700 11589 consensus_queue.cc:260] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:37.027802 11304 catalog_manager.cc:1269] Loaded cluster ID: 427f7f9b079242bab4fac0a6d1e61b01
I20260207 20:53:37.028158 11304 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e: loading cluster ID for follower catalog manager: success
I20260207 20:53:37.028851 11589 ts_tablet_manager.cc:1434] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d: Time spent starting tablet: real 0.024s user 0.005s sys 0.002s
I20260207 20:53:37.029896 11594 raft_consensus.cc:493] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:37.030432 11594 raft_consensus.cc:515] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } }
I20260207 20:53:37.032910 11594 leader_election.cc:290] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4d9c112d3e1479c9c257a3e4ef37b5d (127.2.223.3:45591), e75012de8f40435c968d0036151436cc (127.2.223.1:41433)
I20260207 20:53:37.036602 11589 tablet_bootstrap.cc:492] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d: Bootstrap starting.
I20260207 20:53:37.042557 11589 tablet_bootstrap.cc:654] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:37.045476 11593 raft_consensus.cc:359] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:37.046257 11593 raft_consensus.cc:385] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:37.046540 11593 raft_consensus.cc:740] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e75012de8f40435c968d0036151436cc, State: Initialized, Role: FOLLOWER
I20260207 20:53:37.049958 11593 consensus_queue.cc:260] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:37.053180 11304 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e: acquiring CA information for follower catalog manager: success
I20260207 20:53:37.057024 11329 catalog_manager.cc:1269] Loaded cluster ID: 427f7f9b079242bab4fac0a6d1e61b01
I20260207 20:53:37.057371 11329 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102: loading cluster ID for follower catalog manager: success
I20260207 20:53:37.066956 11304 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:37.072789 11589 tablet_bootstrap.cc:492] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d: No bootstrap required, opened a new log
I20260207 20:53:37.073457 11589 ts_tablet_manager.cc:1403] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d: Time spent bootstrapping tablet: real 0.037s user 0.011s sys 0.006s
I20260207 20:53:37.069615 11329 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102: acquiring CA information for follower catalog manager: success
I20260207 20:53:37.078488 11589 raft_consensus.cc:359] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } }
I20260207 20:53:37.079566 11589 raft_consensus.cc:385] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:37.079934 11589 raft_consensus.cc:740] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4d9c112d3e1479c9c257a3e4ef37b5d, State: Initialized, Role: FOLLOWER
I20260207 20:53:37.080750 11589 consensus_queue.cc:260] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } }
I20260207 20:53:37.084250 11595 raft_consensus.cc:493] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:37.084734 11595 raft_consensus.cc:515] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:37.081760 11590 tablet_bootstrap.cc:492] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e: No bootstrap required, opened a new log
I20260207 20:53:37.086524 11590 ts_tablet_manager.cc:1403] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e: Time spent bootstrapping tablet: real 0.091s user 0.005s sys 0.018s
I20260207 20:53:37.088622 11593 ts_tablet_manager.cc:1434] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc: Time spent starting tablet: real 0.073s user 0.007s sys 0.000s
I20260207 20:53:37.089186 11590 raft_consensus.cc:359] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:37.089775 11590 raft_consensus.cc:385] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:37.089996 11590 raft_consensus.cc:740] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e94bb28bf4e040b990e71854c9e3519e, State: Initialized, Role: FOLLOWER
I20260207 20:53:37.091631 11595 leader_election.cc:290] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e75012de8f40435c968d0036151436cc (127.2.223.1:41433), e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927)
I20260207 20:53:37.098081 11589 ts_tablet_manager.cc:1434] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d: Time spent starting tablet: real 0.024s user 0.005s sys 0.000s
I20260207 20:53:37.100183 11593 tablet_bootstrap.cc:492] T e69305c4aab1448995403a4dc6272025 P e75012de8f40435c968d0036151436cc: Bootstrap starting.
I20260207 20:53:37.090610 11590 consensus_queue.cc:260] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:37.110682 11590 ts_tablet_manager.cc:1434] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e: Time spent starting tablet: real 0.024s user 0.006s sys 0.000s
I20260207 20:53:37.131752 11329 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:37.136309 11593 tablet_bootstrap.cc:654] T e69305c4aab1448995403a4dc6272025 P e75012de8f40435c968d0036151436cc: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:37.138455 11544 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e69305c4aab1448995403a4dc6272025" candidate_uuid: "e94bb28bf4e040b990e71854c9e3519e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" is_pre_election: true
I20260207 20:53:37.138847 11376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e69305c4aab1448995403a4dc6272025" candidate_uuid: "e94bb28bf4e040b990e71854c9e3519e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e75012de8f40435c968d0036151436cc" is_pre_election: true
I20260207 20:53:37.139233 11544 raft_consensus.cc:2468] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e94bb28bf4e040b990e71854c9e3519e in term 0.
I20260207 20:53:37.140792 11376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4723af3dcb14dcbb5844c09f599216f" candidate_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e75012de8f40435c968d0036151436cc" is_pre_election: true
I20260207 20:53:37.141405 11376 raft_consensus.cc:2468] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4d9c112d3e1479c9c257a3e4ef37b5d in term 0.
W20260207 20:53:37.142624 11417 leader_election.cc:343] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e75012de8f40435c968d0036151436cc (127.2.223.1:41433): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:53:37.142838 11507 leader_election.cc:304] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4d9c112d3e1479c9c257a3e4ef37b5d, e75012de8f40435c968d0036151436cc; no voters:
I20260207 20:53:37.143325 11417 leader_election.cc:304] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4d9c112d3e1479c9c257a3e4ef37b5d, e94bb28bf4e040b990e71854c9e3519e; no voters: e75012de8f40435c968d0036151436cc
I20260207 20:53:37.143766 11595 raft_consensus.cc:2804] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:37.144097 11594 raft_consensus.cc:2804] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:37.144551 11594 raft_consensus.cc:493] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:37.144865 11594 raft_consensus.cc:3060] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:37.144146 11595 raft_consensus.cc:493] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:37.150210 11595 raft_consensus.cc:3060] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:37.153064 11594 raft_consensus.cc:515] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } }
I20260207 20:53:37.155076 11594 leader_election.cc:290] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [CANDIDATE]: Term 1 election: Requested vote from peers b4d9c112d3e1479c9c257a3e4ef37b5d (127.2.223.3:45591), e75012de8f40435c968d0036151436cc (127.2.223.1:41433)
I20260207 20:53:37.155620 11594 raft_consensus.cc:493] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:37.156049 11594 raft_consensus.cc:515] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:37.157763 11594 leader_election.cc:290] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e75012de8f40435c968d0036151436cc (127.2.223.1:41433), b4d9c112d3e1479c9c257a3e4ef37b5d (127.2.223.3:45591)
I20260207 20:53:37.159516 11544 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e69305c4aab1448995403a4dc6272025" candidate_uuid: "e94bb28bf4e040b990e71854c9e3519e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d"
I20260207 20:53:37.160135 11544 raft_consensus.cc:3060] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:37.160733 11595 raft_consensus.cc:515] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:37.163444 11376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4723af3dcb14dcbb5844c09f599216f" candidate_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e75012de8f40435c968d0036151436cc"
I20260207 20:53:37.164044 11376 raft_consensus.cc:3060] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:37.167656 11375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e69305c4aab1448995403a4dc6272025" candidate_uuid: "e94bb28bf4e040b990e71854c9e3519e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e75012de8f40435c968d0036151436cc"
I20260207 20:53:37.168792 11543 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4723af3dcb14dcbb5844c09f599216f" candidate_uuid: "e94bb28bf4e040b990e71854c9e3519e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" is_pre_election: true
I20260207 20:53:37.168876 11374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4723af3dcb14dcbb5844c09f599216f" candidate_uuid: "e94bb28bf4e040b990e71854c9e3519e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e75012de8f40435c968d0036151436cc" is_pre_election: true
I20260207 20:53:37.169694 11543 raft_consensus.cc:2393] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e94bb28bf4e040b990e71854c9e3519e in current term 1: Already voted for candidate b4d9c112d3e1479c9c257a3e4ef37b5d in this term.
I20260207 20:53:37.171902 11544 raft_consensus.cc:2468] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e94bb28bf4e040b990e71854c9e3519e in term 1.
I20260207 20:53:37.174760 11595 leader_election.cc:290] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 1 election: Requested vote from peers e75012de8f40435c968d0036151436cc (127.2.223.1:41433), e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927)
I20260207 20:53:37.175346 11595 raft_consensus.cc:493] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:37.175806 11595 raft_consensus.cc:515] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:37.178740 11453 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4723af3dcb14dcbb5844c09f599216f" candidate_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e94bb28bf4e040b990e71854c9e3519e"
I20260207 20:53:37.178627 11417 leader_election.cc:304] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4d9c112d3e1479c9c257a3e4ef37b5d, e94bb28bf4e040b990e71854c9e3519e; no voters:
I20260207 20:53:37.179409 11453 raft_consensus.cc:3060] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:37.180202 11594 raft_consensus.cc:2804] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:37.180675 11594 raft_consensus.cc:697] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [term 1 LEADER]: Becoming Leader. State: Replica: e94bb28bf4e040b990e71854c9e3519e, State: Running, Role: LEADER
I20260207 20:53:37.181535 11594 consensus_queue.cc:237] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } }
I20260207 20:53:37.178295 11376 raft_consensus.cc:2468] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4d9c112d3e1479c9c257a3e4ef37b5d in term 1.
I20260207 20:53:37.178222 11454 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4723af3dcb14dcbb5844c09f599216f" candidate_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e94bb28bf4e040b990e71854c9e3519e" is_pre_election: true
I20260207 20:53:37.187147 11595 leader_election.cc:290] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e75012de8f40435c968d0036151436cc (127.2.223.1:41433), e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927)
W20260207 20:53:37.188855 11417 leader_election.cc:343] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e75012de8f40435c968d0036151436cc (127.2.223.1:41433): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:53:37.191285 11454 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5755912cae74ec8a689e3085dafc8da" candidate_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e94bb28bf4e040b990e71854c9e3519e" is_pre_election: true
I20260207 20:53:37.191952 11454 raft_consensus.cc:2468] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4d9c112d3e1479c9c257a3e4ef37b5d in term 0.
I20260207 20:53:37.193581 11507 leader_election.cc:304] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4d9c112d3e1479c9c257a3e4ef37b5d, e94bb28bf4e040b990e71854c9e3519e; no voters:
I20260207 20:53:37.199499 11417 leader_election.cc:304] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e94bb28bf4e040b990e71854c9e3519e; no voters: b4d9c112d3e1479c9c257a3e4ef37b5d, e75012de8f40435c968d0036151436cc
I20260207 20:53:37.210801 11453 raft_consensus.cc:2468] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4d9c112d3e1479c9c257a3e4ef37b5d in term 1.
I20260207 20:53:37.213274 11607 raft_consensus.cc:2749] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:53:37.214308 11507 leader_election.cc:304] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4d9c112d3e1479c9c257a3e4ef37b5d, e75012de8f40435c968d0036151436cc; no voters:
I20260207 20:53:37.216511 11376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5755912cae74ec8a689e3085dafc8da" candidate_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e75012de8f40435c968d0036151436cc" is_pre_election: true
I20260207 20:53:37.217217 11376 raft_consensus.cc:2468] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4d9c112d3e1479c9c257a3e4ef37b5d in term 0.
I20260207 20:53:37.197216 11595 raft_consensus.cc:2804] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:37.218098 11595 raft_consensus.cc:493] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:37.218479 11595 raft_consensus.cc:3060] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:37.215389 11608 raft_consensus.cc:2804] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Leader election won for term 1
W20260207 20:53:37.265002 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.223.1:41433, user_credentials={real_user=slave}} blocked reactor thread for 62707.2us
I20260207 20:53:37.294222 11593 tablet_bootstrap.cc:492] T e69305c4aab1448995403a4dc6272025 P e75012de8f40435c968d0036151436cc: No bootstrap required, opened a new log
I20260207 20:53:37.294893 11593 ts_tablet_manager.cc:1403] T e69305c4aab1448995403a4dc6272025 P e75012de8f40435c968d0036151436cc: Time spent bootstrapping tablet: real 0.195s user 0.013s sys 0.009s
I20260207 20:53:37.299160 11608 raft_consensus.cc:697] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 LEADER]: Becoming Leader. State: Replica: b4d9c112d3e1479c9c257a3e4ef37b5d, State: Running, Role: LEADER
I20260207 20:53:37.303330 11608 consensus_queue.cc:237] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:37.304744 11595 raft_consensus.cc:515] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:37.297564 11593 raft_consensus.cc:359] T e69305c4aab1448995403a4dc6272025 P e75012de8f40435c968d0036151436cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } }
I20260207 20:53:37.307180 11593 raft_consensus.cc:385] T e69305c4aab1448995403a4dc6272025 P e75012de8f40435c968d0036151436cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:37.307529 11593 raft_consensus.cc:740] T e69305c4aab1448995403a4dc6272025 P e75012de8f40435c968d0036151436cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e75012de8f40435c968d0036151436cc, State: Initialized, Role: FOLLOWER
I20260207 20:53:37.308269 11593 consensus_queue.cc:260] T e69305c4aab1448995403a4dc6272025 P e75012de8f40435c968d0036151436cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } }
I20260207 20:53:37.309698 11595 leader_election.cc:290] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 1 election: Requested vote from peers e75012de8f40435c968d0036151436cc (127.2.223.1:41433), e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927)
I20260207 20:53:37.311965 11453 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5755912cae74ec8a689e3085dafc8da" candidate_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e94bb28bf4e040b990e71854c9e3519e"
I20260207 20:53:37.312781 11453 raft_consensus.cc:3060] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:37.319402 11593 ts_tablet_manager.cc:1434] T e69305c4aab1448995403a4dc6272025 P e75012de8f40435c968d0036151436cc: Time spent starting tablet: real 0.024s user 0.005s sys 0.002s
I20260207 20:53:37.930001 11374 raft_consensus.cc:3060] T e69305c4aab1448995403a4dc6272025 P e75012de8f40435c968d0036151436cc [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:37.939426 11613 consensus_queue.cc:1048] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260207 20:53:38.028105 11453 consensus_meta.cc:287] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e: Time spent flushing consensus metadata: real 0.715s user 0.010s sys 0.000s
I20260207 20:53:38.028470 11453 raft_consensus.cc:2468] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4d9c112d3e1479c9c257a3e4ef37b5d in term 1.
I20260207 20:53:38.029014 11376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5755912cae74ec8a689e3085dafc8da" candidate_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e75012de8f40435c968d0036151436cc"
I20260207 20:53:38.029664 11376 raft_consensus.cc:3060] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:38.029680 11507 leader_election.cc:304] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4d9c112d3e1479c9c257a3e4ef37b5d, e94bb28bf4e040b990e71854c9e3519e; no voters:
I20260207 20:53:38.034942 11619 raft_consensus.cc:2804] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:38.038091 11376 raft_consensus.cc:2468] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4d9c112d3e1479c9c257a3e4ef37b5d in term 1.
I20260207 20:53:38.039790 11619 raft_consensus.cc:697] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 LEADER]: Becoming Leader. State: Replica: b4d9c112d3e1479c9c257a3e4ef37b5d, State: Running, Role: LEADER
I20260207 20:53:38.040967 11619 consensus_queue.cc:237] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } }
I20260207 20:53:38.057480 11594 consensus_queue.cc:1048] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:38.064781 11622 consensus_queue.cc:1048] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:38.066143 11622 consensus_queue.cc:1048] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:38.075198 11183 catalog_manager.cc:5654] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d reported cstate change: term changed from 0 to 1, leader changed from <none> to b4d9c112d3e1479c9c257a3e4ef37b5d (127.2.223.3). New cstate: current_term: 1 leader_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:38.080972 11184 catalog_manager.cc:5654] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e reported cstate change: term changed from 0 to 1, leader changed from <none> to e94bb28bf4e040b990e71854c9e3519e (127.2.223.2). New cstate: current_term: 1 leader_uuid: "e94bb28bf4e040b990e71854c9e3519e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:38.078933 11183 catalog_manager.cc:5654] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d reported cstate change: term changed from 0 to 1, leader changed from <none> to b4d9c112d3e1479c9c257a3e4ef37b5d (127.2.223.3). New cstate: current_term: 1 leader_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:38.244360 2940 ksck_remote-test.cc:683] Generating row writes...
I20260207 20:53:38.327596 11453 raft_consensus.cc:1275] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e [term 1 FOLLOWER]: Refusing update from remote peer b4d9c112d3e1479c9c257a3e4ef37b5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:38.331785 11374 raft_consensus.cc:1275] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc [term 1 FOLLOWER]: Refusing update from remote peer b4d9c112d3e1479c9c257a3e4ef37b5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:38.345425 11622 consensus_queue.cc:1048] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:38.346833 11619 consensus_queue.cc:1048] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260207 20:53:38.468003 11651 log.cc:927] Time spent T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc: Append to log took a long time: real 0.076s user 0.000s sys 0.000s
W20260207 20:53:38.745301 11478 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2f20 after lost signal to thread 2943
W20260207 20:53:38.749266 11478 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3040 after lost signal to thread 11400
I20260207 20:53:39.578085 11364 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:53:39.579262 11534 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260207 20:53:39.620143 11443 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260207 20:53:40.173005 11637 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Checksum -> {remote=127.2.223.3:45591, user_credentials={real_user=slave}} blocked reactor thread for 81933.8us
W20260207 20:53:40.191814 11637 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down.
I20260207 20:53:40.193382 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:53:40.274364 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:40.275207 2940 tablet_replica.cc:333] T e69305c4aab1448995403a4dc6272025 P e75012de8f40435c968d0036151436cc: stopping tablet replica
I20260207 20:53:40.276135 2940 raft_consensus.cc:2243] T e69305c4aab1448995403a4dc6272025 P e75012de8f40435c968d0036151436cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:40.277340 2940 raft_consensus.cc:2272] T e69305c4aab1448995403a4dc6272025 P e75012de8f40435c968d0036151436cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:40.281867 2940 tablet_replica.cc:333] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc: stopping tablet replica
I20260207 20:53:40.282701 2940 raft_consensus.cc:2243] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:40.283674 2940 raft_consensus.cc:2272] T a5755912cae74ec8a689e3085dafc8da P e75012de8f40435c968d0036151436cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:40.286715 2940 tablet_replica.cc:333] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc: stopping tablet replica
I20260207 20:53:40.287360 2940 raft_consensus.cc:2243] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:40.288066 2940 raft_consensus.cc:2272] T d4723af3dcb14dcbb5844c09f599216f P e75012de8f40435c968d0036151436cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:40.306432 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:53:40.329412 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
W20260207 20:53:40.354730 11507 consensus_peers.cc:597] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d -> Peer e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927): Couldn't send request to peer e94bb28bf4e040b990e71854c9e3519e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:40.395228 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:40.396171 2940 tablet_replica.cc:333] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e: stopping tablet replica
I20260207 20:53:40.397033 2940 raft_consensus.cc:2243] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:40.397910 2940 raft_consensus.cc:2272] T a5755912cae74ec8a689e3085dafc8da P e94bb28bf4e040b990e71854c9e3519e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:40.402544 2940 tablet_replica.cc:333] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e: stopping tablet replica
I20260207 20:53:40.403288 2940 raft_consensus.cc:2243] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:40.404371 2940 raft_consensus.cc:2272] T e69305c4aab1448995403a4dc6272025 P e94bb28bf4e040b990e71854c9e3519e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:40.407223 2940 tablet_replica.cc:333] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e: stopping tablet replica
I20260207 20:53:40.407970 2940 raft_consensus.cc:2243] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:40.408679 2940 raft_consensus.cc:2272] T d4723af3dcb14dcbb5844c09f599216f P e94bb28bf4e040b990e71854c9e3519e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260207 20:53:40.496891 11507 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.223.1:41433: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20260207 20:53:40.499274 11507 consensus_peers.cc:597] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d -> Peer e75012de8f40435c968d0036151436cc (127.2.223.1:41433): Couldn't send request to peer e75012de8f40435c968d0036151436cc. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:41433: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260207 20:53:40.573240 11507 consensus_peers.cc:597] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d -> Peer e75012de8f40435c968d0036151436cc (127.2.223.1:41433): Couldn't send request to peer e75012de8f40435c968d0036151436cc. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:41433: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260207 20:53:40.782883 11507 consensus_peers.cc:597] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d -> Peer e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927): Couldn't send request to peer e94bb28bf4e040b990e71854c9e3519e. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.2:45927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260207 20:53:41.424571 2940 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11478)
I20260207 20:53:41.832513 11622 raft_consensus.cc:493] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e94bb28bf4e040b990e71854c9e3519e)
I20260207 20:53:41.833160 11622 raft_consensus.cc:515] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } }
I20260207 20:53:41.835187 11622 leader_election.cc:290] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927), e75012de8f40435c968d0036151436cc (127.2.223.1:41433)
W20260207 20:53:41.842015 11507 leader_election.cc:336] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927): Network error: Client connection negotiation failed: client connection to 127.2.223.2:45927: connect: Connection refused (error 111)
W20260207 20:53:41.842620 11507 leader_election.cc:336] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e75012de8f40435c968d0036151436cc (127.2.223.1:41433): Network error: Client connection negotiation failed: client connection to 127.2.223.1:41433: connect: Connection refused (error 111)
I20260207 20:53:41.842929 11507 leader_election.cc:304] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4d9c112d3e1479c9c257a3e4ef37b5d; no voters: e75012de8f40435c968d0036151436cc, e94bb28bf4e040b990e71854c9e3519e
I20260207 20:53:41.843473 11622 raft_consensus.cc:2749] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260207 20:53:42.425034 2940 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 11478)
W20260207 20:53:42.729782 11507 consensus_peers.cc:597] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d -> Peer e75012de8f40435c968d0036151436cc (127.2.223.1:41433): Couldn't send request to peer e75012de8f40435c968d0036151436cc. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:41433: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260207 20:53:42.813347 11507 consensus_peers.cc:597] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d -> Peer e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927): Couldn't send request to peer e94bb28bf4e040b990e71854c9e3519e. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.2:45927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260207 20:53:43.183014 11507 consensus_peers.cc:597] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d -> Peer e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927): Couldn't send request to peer e94bb28bf4e040b990e71854c9e3519e. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.2:45927: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260207 20:53:43.208954 11507 consensus_peers.cc:597] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d -> Peer e75012de8f40435c968d0036151436cc (127.2.223.1:41433): Couldn't send request to peer e75012de8f40435c968d0036151436cc. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:41433: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260207 20:53:43.425509 2940 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 11478)
I20260207 20:53:43.888200 11622 raft_consensus.cc:493] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e94bb28bf4e040b990e71854c9e3519e)
I20260207 20:53:43.888695 11622 raft_consensus.cc:515] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4d9c112d3e1479c9c257a3e4ef37b5d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 45591 } } peers { permanent_uuid: "e94bb28bf4e040b990e71854c9e3519e" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 45927 } } peers { permanent_uuid: "e75012de8f40435c968d0036151436cc" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41433 } }
I20260207 20:53:43.890223 11622 leader_election.cc:290] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927), e75012de8f40435c968d0036151436cc (127.2.223.1:41433)
W20260207 20:53:43.894173 11507 leader_election.cc:336] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e94bb28bf4e040b990e71854c9e3519e (127.2.223.2:45927): Network error: Client connection negotiation failed: client connection to 127.2.223.2:45927: connect: Connection refused (error 111)
W20260207 20:53:43.895946 11507 leader_election.cc:336] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e75012de8f40435c968d0036151436cc (127.2.223.1:41433): Network error: Client connection negotiation failed: client connection to 127.2.223.1:41433: connect: Connection refused (error 111)
I20260207 20:53:43.896415 11507 leader_election.cc:304] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4d9c112d3e1479c9c257a3e4ef37b5d; no voters: e75012de8f40435c968d0036151436cc, e94bb28bf4e040b990e71854c9e3519e
I20260207 20:53:43.897258 11622 raft_consensus.cc:2749] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260207 20:53:44.455356 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:53:44.472535 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:53:44.504145 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:44.504988 2940 tablet_replica.cc:333] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d: stopping tablet replica
I20260207 20:53:44.505622 2940 raft_consensus.cc:2243] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:44.506090 2940 raft_consensus.cc:2272] T e69305c4aab1448995403a4dc6272025 P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:44.508338 2940 tablet_replica.cc:333] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d: stopping tablet replica
I20260207 20:53:44.508782 2940 raft_consensus.cc:2243] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:44.509492 2940 raft_consensus.cc:2272] T d4723af3dcb14dcbb5844c09f599216f P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:44.511461 2940 tablet_replica.cc:333] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d: stopping tablet replica
I20260207 20:53:44.511881 2940 raft_consensus.cc:2243] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:44.512549 2940 raft_consensus.cc:2272] T a5755912cae74ec8a689e3085dafc8da P b4d9c112d3e1479c9c257a3e4ef37b5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:44.533952 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:53:44.549309 2940 master.cc:561] Master@127.2.223.62:43487 shutting down...
I20260207 20:53:44.571507 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:44.572115 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:44.572444 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2328ff42e29e46778cdc824f3c97b102: stopping tablet replica
I20260207 20:53:44.592693 2940 master.cc:583] Master@127.2.223.62:43487 shutdown complete.
I20260207 20:53:44.607333 2940 master.cc:561] Master@127.2.223.61:43987 shutting down...
I20260207 20:53:44.627935 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:44.628826 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:44.629168 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 858f4df45e154ff19efa971d0b619ccb: stopping tablet replica
I20260207 20:53:44.648789 2940 master.cc:583] Master@127.2.223.61:43987 shutdown complete.
I20260207 20:53:44.663561 2940 master.cc:561] Master@127.2.223.60:38499 shutting down...
I20260207 20:53:44.682526 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:44.683143 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:44.683426 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4b61611da3034cec95601675841de45e: stopping tablet replica
I20260207 20:53:44.701961 2940 master.cc:583] Master@127.2.223.60:38499 shutdown complete.
[ OK ] RemoteKsckTest.TestMatchingTableFilter (9038 ms)
[ RUN ] RemoteKsckTest.TestFilterOnNotabletTable
I20260207 20:53:44.735631 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:34671,127.2.223.61:34643,127.2.223.60:38865
I20260207 20:53:44.737028 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:44.742357 11707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:44.742482 11708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:44.743657 11710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:44.743934 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:44.744810 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:44.744984 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:44.745116 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497624745101 us; error 0 us; skew 500 ppm
I20260207 20:53:44.745575 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:44.747661 2940 webserver.cc:492] Webserver started at http://127.2.223.62:43157/ using document root <none> and password file <none>
I20260207 20:53:44.748111 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:44.748277 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:44.748502 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:44.749537 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "4a1f924420f9406f895bf7466f02f4be"
format_stamp: "Formatted at 2026-02-07 20:53:44 on dist-test-slave-kqw4"
I20260207 20:53:44.753569 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260207 20:53:44.756611 11715 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:44.757273 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260207 20:53:44.757517 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "4a1f924420f9406f895bf7466f02f4be"
format_stamp: "Formatted at 2026-02-07 20:53:44 on dist-test-slave-kqw4"
I20260207 20:53:44.757762 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:44.765846 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:44.766955 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:44.802264 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:34671
I20260207 20:53:44.802371 11766 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:34671 every 8 connection(s)
I20260207 20:53:44.805884 11767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:44.806103 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:44.811233 11769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:44.812824 11770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:44.814442 11772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:44.814347 11767 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:44.817940 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:44.819157 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:44.819401 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:44.819576 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497624819559 us; error 0 us; skew 500 ppm
I20260207 20:53:44.820187 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:44.822952 2940 webserver.cc:492] Webserver started at http://127.2.223.61:44793/ using document root <none> and password file <none>
I20260207 20:53:44.823487 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:44.823720 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:44.824074 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:44.825158 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "f53df85887f04ef6abcd4e737082b30c"
format_stamp: "Formatted at 2026-02-07 20:53:44 on dist-test-slave-kqw4"
I20260207 20:53:44.829866 11767 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:44.830240 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260207 20:53:44.834234 11780 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20260207 20:53:44.834756 11767 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:34643: Network error: Client connection negotiation failed: client connection to 127.2.223.61:34643: connect: Connection refused (error 111)
I20260207 20:53:44.834973 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260207 20:53:44.835314 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "f53df85887f04ef6abcd4e737082b30c"
format_stamp: "Formatted at 2026-02-07 20:53:44 on dist-test-slave-kqw4"
I20260207 20:53:44.835562 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:44.850643 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:44.851781 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:44.885409 11767 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } attempt: 1
I20260207 20:53:44.889809 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:34643
I20260207 20:53:44.889922 11831 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:34643 every 8 connection(s)
W20260207 20:53:44.890413 11767 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:34643: Network error: Client connection negotiation failed: client connection to 127.2.223.61:34643: connect: Connection refused (error 111)
I20260207 20:53:44.893625 11832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:44.893740 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:44.899049 11834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:44.900393 11835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:44.902120 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:44.902019 11832 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:44.902782 11837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:44.903630 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:44.903892 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:44.904100 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497624904083 us; error 0 us; skew 500 ppm
I20260207 20:53:44.904618 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:44.907327 2940 webserver.cc:492] Webserver started at http://127.2.223.60:40377/ using document root <none> and password file <none>
I20260207 20:53:44.907972 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:44.908198 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:44.908484 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:44.909641 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "ab6da7c48aa449b3b88f219df1a171ef"
format_stamp: "Formatted at 2026-02-07 20:53:44 on dist-test-slave-kqw4"
I20260207 20:53:44.913408 11832 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:44.915159 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260207 20:53:44.919301 11844 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:44.920131 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260207 20:53:44.920465 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "ab6da7c48aa449b3b88f219df1a171ef"
format_stamp: "Formatted at 2026-02-07 20:53:44 on dist-test-slave-kqw4"
I20260207 20:53:44.920787 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:44.925525 11832 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:44.931028 11832 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38865: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38865: connect: Connection refused (error 111)
I20260207 20:53:44.943892 11767 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } attempt: 2
I20260207 20:53:44.951813 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:44.953250 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:44.953694 11767 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:44.958272 11767 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38865: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38865: connect: Connection refused (error 111)
I20260207 20:53:44.972438 11832 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } attempt: 1
W20260207 20:53:44.977370 11832 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38865: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38865: connect: Connection refused (error 111)
I20260207 20:53:44.985721 11767 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } attempt: 1
W20260207 20:53:44.990291 11767 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:38865: Network error: Client connection negotiation failed: client connection to 127.2.223.60:38865: connect: Connection refused (error 111)
I20260207 20:53:44.994931 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:38865
I20260207 20:53:44.995045 11896 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:38865 every 8 connection(s)
I20260207 20:53:44.998067 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:53:44.998916 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:45.005003 11897 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:45.015439 11897 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:45.023908 11897 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:45.039320 11897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef: Bootstrap starting.
I20260207 20:53:45.041821 11767 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } attempt: 2
I20260207 20:53:45.042848 11832 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } attempt: 2
I20260207 20:53:45.044574 11897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:45.050060 11897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef: No bootstrap required, opened a new log
I20260207 20:53:45.052999 11897 raft_consensus.cc:359] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } }
I20260207 20:53:45.053685 11897 raft_consensus.cc:385] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:45.053975 11897 raft_consensus.cc:740] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab6da7c48aa449b3b88f219df1a171ef, State: Initialized, Role: FOLLOWER
I20260207 20:53:45.054697 11897 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } }
I20260207 20:53:45.056875 11903 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } } }
I20260207 20:53:45.057720 11903 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:45.058542 11897 sys_catalog.cc:565] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:45.059993 11767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be: Bootstrap starting.
I20260207 20:53:45.061041 11832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c: Bootstrap starting.
I20260207 20:53:45.066699 11767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:45.066743 11832 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:45.072316 11832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c: No bootstrap required, opened a new log
I20260207 20:53:45.073784 11767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be: No bootstrap required, opened a new log
I20260207 20:53:45.074908 11832 raft_consensus.cc:359] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } }
I20260207 20:53:45.075595 11832 raft_consensus.cc:385] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:45.075911 11832 raft_consensus.cc:740] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f53df85887f04ef6abcd4e737082b30c, State: Initialized, Role: FOLLOWER
I20260207 20:53:45.075984 11767 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } }
I20260207 20:53:45.076632 11767 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:45.076911 11767 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a1f924420f9406f895bf7466f02f4be, State: Initialized, Role: FOLLOWER
I20260207 20:53:45.076721 11832 consensus_queue.cc:260] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } }
I20260207 20:53:45.077564 11767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } }
W20260207 20:53:45.077984 11916 catalog_manager.cc:1568] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:45.078382 11916 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:45.079182 11917 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } } }
I20260207 20:53:45.079564 11918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } } }
I20260207 20:53:45.079978 11917 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:45.080317 11918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:45.080781 11832 sys_catalog.cc:565] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:45.081037 11767 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:45.093793 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:53:45.094434 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:53:45.096304 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:45.097098 11939 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:45.097390 11939 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:53:45.098537 11940 catalog_manager.cc:1568] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:45.098910 11940 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:53:45.103114 11941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:45.103946 11942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:45.105664 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:45.106382 11944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:45.107241 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:45.107470 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:45.107616 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497625107605 us; error 0 us; skew 500 ppm
I20260207 20:53:45.108074 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:45.110226 2940 webserver.cc:492] Webserver started at http://127.2.223.1:33681/ using document root <none> and password file <none>
I20260207 20:53:45.110718 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:45.110898 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:45.111111 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:45.112080 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "dc4191dfab5d46e883b3251b034c1479"
format_stamp: "Formatted at 2026-02-07 20:53:45 on dist-test-slave-kqw4"
I20260207 20:53:45.116431 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260207 20:53:45.119637 11949 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:45.120458 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260207 20:53:45.120743 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "dc4191dfab5d46e883b3251b034c1479"
format_stamp: "Formatted at 2026-02-07 20:53:45 on dist-test-slave-kqw4"
I20260207 20:53:45.121008 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:45.130515 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:45.131672 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:45.133069 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:45.135281 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:45.135469 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:45.135701 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:45.135848 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:45.173985 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:34165
I20260207 20:53:45.174115 12011 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:34165 every 8 connection(s)
I20260207 20:53:45.181886 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:45.195515 12012 heartbeater.cc:344] Connected to a master server at 127.2.223.60:38865
W20260207 20:53:45.196132 12019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:45.196125 12012 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:45.196693 12013 heartbeater.cc:344] Connected to a master server at 127.2.223.61:34643
I20260207 20:53:45.197129 12013 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:45.197639 12012 heartbeater.cc:507] Master 127.2.223.60:38865 requested a full tablet report, sending...
I20260207 20:53:45.197901 12013 heartbeater.cc:507] Master 127.2.223.61:34643 requested a full tablet report, sending...
I20260207 20:53:45.226871 11797 ts_manager.cc:194] Registered new tserver with Master: dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165)
I20260207 20:53:45.227563 11862 ts_manager.cc:194] Registered new tserver with Master: dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165)
I20260207 20:53:45.228791 12014 heartbeater.cc:344] Connected to a master server at 127.2.223.62:34671
I20260207 20:53:45.229211 12014 heartbeater.cc:461] Registering TS with master...
W20260207 20:53:45.229616 12020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:45.230157 12014 heartbeater.cc:507] Master 127.2.223.62:34671 requested a full tablet report, sending...
W20260207 20:53:45.232189 12022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:45.232446 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:45.233175 11732 ts_manager.cc:194] Registered new tserver with Master: dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165)
I20260207 20:53:45.233472 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:45.233754 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:45.233963 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497625233945 us; error 0 us; skew 500 ppm
I20260207 20:53:45.234673 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:45.236856 2940 webserver.cc:492] Webserver started at http://127.2.223.2:38423/ using document root <none> and password file <none>
I20260207 20:53:45.237416 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:45.237576 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:45.237777 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:45.238746 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "5987c8087bb8442b8ea62b8378c89606"
format_stamp: "Formatted at 2026-02-07 20:53:45 on dist-test-slave-kqw4"
I20260207 20:53:45.243712 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260207 20:53:45.247159 12027 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:45.247912 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:53:45.248178 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "5987c8087bb8442b8ea62b8378c89606"
format_stamp: "Formatted at 2026-02-07 20:53:45 on dist-test-slave-kqw4"
I20260207 20:53:45.248420 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:45.258987 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:45.260329 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:45.261482 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:45.263551 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:45.263749 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:45.263952 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:45.264099 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:45.292454 11917 raft_consensus.cc:493] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:45.293067 11917 raft_consensus.cc:515] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } }
I20260207 20:53:45.295331 11917 leader_election.cc:290] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a1f924420f9406f895bf7466f02f4be (127.2.223.62:34671), ab6da7c48aa449b3b88f219df1a171ef (127.2.223.60:38865)
I20260207 20:53:45.296958 11742 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f53df85887f04ef6abcd4e737082b30c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1f924420f9406f895bf7466f02f4be" is_pre_election: true
I20260207 20:53:45.297866 11742 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f53df85887f04ef6abcd4e737082b30c in term 0.
I20260207 20:53:45.298329 11872 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f53df85887f04ef6abcd4e737082b30c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab6da7c48aa449b3b88f219df1a171ef" is_pre_election: true
I20260207 20:53:45.299321 11783 leader_election.cc:304] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a1f924420f9406f895bf7466f02f4be, f53df85887f04ef6abcd4e737082b30c; no voters:
I20260207 20:53:45.299089 11872 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f53df85887f04ef6abcd4e737082b30c in term 0.
I20260207 20:53:45.301625 11917 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:45.302084 11917 raft_consensus.cc:493] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:45.302407 11917 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:45.310998 11917 raft_consensus.cc:515] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } }
I20260207 20:53:45.315835 11742 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f53df85887f04ef6abcd4e737082b30c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1f924420f9406f895bf7466f02f4be"
I20260207 20:53:45.316053 11872 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f53df85887f04ef6abcd4e737082b30c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab6da7c48aa449b3b88f219df1a171ef"
I20260207 20:53:45.316424 11742 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:45.316567 11872 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:45.318719 11917 leader_election.cc:290] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [CANDIDATE]: Term 1 election: Requested vote from peers 4a1f924420f9406f895bf7466f02f4be (127.2.223.62:34671), ab6da7c48aa449b3b88f219df1a171ef (127.2.223.60:38865)
I20260207 20:53:45.320475 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:38621
I20260207 20:53:45.323071 12089 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:38621 every 8 connection(s)
I20260207 20:53:45.324026 11872 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f53df85887f04ef6abcd4e737082b30c in term 1.
I20260207 20:53:45.327622 11784 leader_election.cc:304] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab6da7c48aa449b3b88f219df1a171ef, f53df85887f04ef6abcd4e737082b30c; no voters:
I20260207 20:53:45.328521 11917 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:45.329310 11742 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f53df85887f04ef6abcd4e737082b30c in term 1.
I20260207 20:53:45.339591 11917 raft_consensus.cc:697] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [term 1 LEADER]: Becoming Leader. State: Replica: f53df85887f04ef6abcd4e737082b30c, State: Running, Role: LEADER
I20260207 20:53:45.340770 11917 consensus_queue.cc:237] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } }
I20260207 20:53:45.352025 12093 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f53df85887f04ef6abcd4e737082b30c. Latest consensus state: current_term: 1 leader_uuid: "f53df85887f04ef6abcd4e737082b30c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } } }
I20260207 20:53:45.352787 12093 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:45.357219 12097 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:53:45.357609 12090 heartbeater.cc:344] Connected to a master server at 127.2.223.60:38865
I20260207 20:53:45.357988 12090 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:45.358799 12090 heartbeater.cc:507] Master 127.2.223.60:38865 requested a full tablet report, sending...
I20260207 20:53:45.361560 11861 ts_manager.cc:194] Registered new tserver with Master: 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621)
I20260207 20:53:45.367624 12097 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:53:45.375012 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:45.377919 12091 heartbeater.cc:344] Connected to a master server at 127.2.223.61:34643
I20260207 20:53:45.378317 12091 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:45.379158 12091 heartbeater.cc:507] Master 127.2.223.61:34643 requested a full tablet report, sending...
I20260207 20:53:45.381450 11797 ts_manager.cc:194] Registered new tserver with Master: 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621)
W20260207 20:53:45.386056 12100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:45.393309 12103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:45.394771 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:45.395094 12095 heartbeater.cc:344] Connected to a master server at 127.2.223.62:34671
I20260207 20:53:45.395578 12095 heartbeater.cc:461] Registering TS with master...
W20260207 20:53:45.396082 12101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:45.396423 12095 heartbeater.cc:507] Master 127.2.223.62:34671 requested a full tablet report, sending...
I20260207 20:53:45.397302 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:45.397590 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:45.397805 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497625397788 us; error 0 us; skew 500 ppm
I20260207 20:53:45.398576 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:45.398746 11872 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [term 1 FOLLOWER]: Refusing update from remote peer f53df85887f04ef6abcd4e737082b30c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:45.399152 11732 ts_manager.cc:194] Registered new tserver with Master: 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621)
I20260207 20:53:45.400233 11742 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [term 1 FOLLOWER]: Refusing update from remote peer f53df85887f04ef6abcd4e737082b30c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:45.400456 12093 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:45.401628 11917 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:45.417485 11918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [sys.catalog]: SysCatalogTable state changed. Reason: New leader f53df85887f04ef6abcd4e737082b30c. Latest consensus state: current_term: 1 leader_uuid: "f53df85887f04ef6abcd4e737082b30c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } } }
I20260207 20:53:45.418231 11918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:45.425668 2940 webserver.cc:492] Webserver started at http://127.2.223.3:35815/ using document root <none> and password file <none>
I20260207 20:53:45.426513 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:45.426796 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:45.427132 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:45.432214 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "9b43b54cd6074804af60756cb25ffd26"
format_stamp: "Formatted at 2026-02-07 20:53:45 on dist-test-slave-kqw4"
I20260207 20:53:45.435040 12108 mvcc.cc:204] Tried to move back new op lower bound from 7251958273613897728 to 7251958273406541824. Current Snapshot: MvccSnapshot[applied={T|T < 7251958273613897728}]
I20260207 20:53:45.441198 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.002s sys 0.005s
I20260207 20:53:45.441416 11918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f53df85887f04ef6abcd4e737082b30c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } } }
I20260207 20:53:45.442232 11918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:45.446838 12097 catalog_manager.cc:1357] Generated new cluster ID: 7e4c411517b64475b9c86b6048eaa106
I20260207 20:53:45.447273 12114 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:45.448172 11917 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f53df85887f04ef6abcd4e737082b30c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } } }
I20260207 20:53:45.448935 11917 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:45.447228 12097 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:53:45.448625 2940 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.000s sys 0.004s
I20260207 20:53:45.450353 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "9b43b54cd6074804af60756cb25ffd26"
format_stamp: "Formatted at 2026-02-07 20:53:45 on dist-test-slave-kqw4"
I20260207 20:53:45.450672 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:45.452054 11903 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader f53df85887f04ef6abcd4e737082b30c. Latest consensus state: current_term: 1 leader_uuid: "f53df85887f04ef6abcd4e737082b30c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } } }
I20260207 20:53:45.452760 11903 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:45.457314 11917 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f53df85887f04ef6abcd4e737082b30c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } } }
I20260207 20:53:45.460474 11917 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:45.484382 12097 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:53:45.486084 12097 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:53:45.498430 11903 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f53df85887f04ef6abcd4e737082b30c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1f924420f9406f895bf7466f02f4be" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 34671 } } peers { permanent_uuid: "f53df85887f04ef6abcd4e737082b30c" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 34643 } } peers { permanent_uuid: "ab6da7c48aa449b3b88f219df1a171ef" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 38865 } } }
I20260207 20:53:45.499315 11903 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:45.527803 12097 catalog_manager.cc:6027] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c: Generated new TSK 0
I20260207 20:53:45.530547 12097 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:53:45.539901 11797 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47746
I20260207 20:53:45.548715 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:45.549896 11797 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47752
I20260207 20:53:45.550369 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:45.552695 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:45.553757 12013 heartbeater.cc:499] Master 127.2.223.61:34643 was elected leader, sending a full tablet report...
I20260207 20:53:45.555437 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:45.555722 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:45.555962 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:45.556102 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:45.562628 12091 heartbeater.cc:499] Master 127.2.223.61:34643 was elected leader, sending a full tablet report...
I20260207 20:53:45.629204 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:44319
I20260207 20:53:45.629294 12178 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:44319 every 8 connection(s)
I20260207 20:53:45.666548 12179 heartbeater.cc:344] Connected to a master server at 127.2.223.60:38865
I20260207 20:53:45.667090 12179 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:45.668071 12179 heartbeater.cc:507] Master 127.2.223.60:38865 requested a full tablet report, sending...
I20260207 20:53:45.672863 11862 ts_manager.cc:194] Registered new tserver with Master: 9b43b54cd6074804af60756cb25ffd26 (127.2.223.3:44319)
I20260207 20:53:45.675168 12180 heartbeater.cc:344] Connected to a master server at 127.2.223.61:34643
I20260207 20:53:45.675544 12180 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:45.676426 12180 heartbeater.cc:507] Master 127.2.223.61:34643 requested a full tablet report, sending...
I20260207 20:53:45.678336 11796 ts_manager.cc:194] Registered new tserver with Master: 9b43b54cd6074804af60756cb25ffd26 (127.2.223.3:44319)
I20260207 20:53:45.680143 11796 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47756
I20260207 20:53:45.684360 12181 heartbeater.cc:344] Connected to a master server at 127.2.223.62:34671
I20260207 20:53:45.684710 12181 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:45.685370 12181 heartbeater.cc:507] Master 127.2.223.62:34671 requested a full tablet report, sending...
I20260207 20:53:45.687969 11732 ts_manager.cc:194] Registered new tserver with Master: 9b43b54cd6074804af60756cb25ffd26 (127.2.223.3:44319)
I20260207 20:53:45.688252 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018915486s
I20260207 20:53:45.693262 12180 heartbeater.cc:499] Master 127.2.223.61:34643 was elected leader, sending a full tablet report...
I20260207 20:53:45.743471 11797 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47764:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:53:45.745972 11797 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:53:45.870963 11977 tablet_service.cc:1505] Processing CreateTablet for tablet 96dddbfc23d74701ba7e28f3579c04ba (DEFAULT_TABLE table=ksck-test-table [id=78eaa43096dc47529a9ec1d39bb181e3]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:45.871687 11976 tablet_service.cc:1505] Processing CreateTablet for tablet c9a765fb155142f49ceba92d7468fc02 (DEFAULT_TABLE table=ksck-test-table [id=78eaa43096dc47529a9ec1d39bb181e3]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:45.872431 11977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96dddbfc23d74701ba7e28f3579c04ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:45.872573 11975 tablet_service.cc:1505] Processing CreateTablet for tablet 52feb87fb4a84a0a9535925ca10abb19 (DEFAULT_TABLE table=ksck-test-table [id=78eaa43096dc47529a9ec1d39bb181e3]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:45.876047 11975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52feb87fb4a84a0a9535925ca10abb19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:45.881875 11976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a765fb155142f49ceba92d7468fc02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:45.899469 12144 tablet_service.cc:1505] Processing CreateTablet for tablet 96dddbfc23d74701ba7e28f3579c04ba (DEFAULT_TABLE table=ksck-test-table [id=78eaa43096dc47529a9ec1d39bb181e3]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:45.900643 12142 tablet_service.cc:1505] Processing CreateTablet for tablet 52feb87fb4a84a0a9535925ca10abb19 (DEFAULT_TABLE table=ksck-test-table [id=78eaa43096dc47529a9ec1d39bb181e3]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:45.901031 12144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96dddbfc23d74701ba7e28f3579c04ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:45.902004 12142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52feb87fb4a84a0a9535925ca10abb19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:45.899567 12143 tablet_service.cc:1505] Processing CreateTablet for tablet c9a765fb155142f49ceba92d7468fc02 (DEFAULT_TABLE table=ksck-test-table [id=78eaa43096dc47529a9ec1d39bb181e3]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:45.912400 12143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a765fb155142f49ceba92d7468fc02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:45.932204 12055 tablet_service.cc:1505] Processing CreateTablet for tablet 96dddbfc23d74701ba7e28f3579c04ba (DEFAULT_TABLE table=ksck-test-table [id=78eaa43096dc47529a9ec1d39bb181e3]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:45.933656 12055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96dddbfc23d74701ba7e28f3579c04ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:45.936656 12054 tablet_service.cc:1505] Processing CreateTablet for tablet c9a765fb155142f49ceba92d7468fc02 (DEFAULT_TABLE table=ksck-test-table [id=78eaa43096dc47529a9ec1d39bb181e3]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:45.938058 12054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a765fb155142f49ceba92d7468fc02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:45.939668 12053 tablet_service.cc:1505] Processing CreateTablet for tablet 52feb87fb4a84a0a9535925ca10abb19 (DEFAULT_TABLE table=ksck-test-table [id=78eaa43096dc47529a9ec1d39bb181e3]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:45.941008 12053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52feb87fb4a84a0a9535925ca10abb19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:46.003543 12200 tablet_bootstrap.cc:492] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479: Bootstrap starting.
I20260207 20:53:46.017520 12201 tablet_bootstrap.cc:492] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26: Bootstrap starting.
I20260207 20:53:46.024739 12202 tablet_bootstrap.cc:492] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606: Bootstrap starting.
I20260207 20:53:46.036598 12200 tablet_bootstrap.cc:654] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:46.051996 12200 tablet_bootstrap.cc:492] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479: No bootstrap required, opened a new log
I20260207 20:53:46.052572 12200 ts_tablet_manager.cc:1403] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.016s
I20260207 20:53:46.055228 12200 raft_consensus.cc:359] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } } peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } }
I20260207 20:53:46.055811 12202 tablet_bootstrap.cc:654] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:46.055962 12200 raft_consensus.cc:385] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:46.056404 12200 raft_consensus.cc:740] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc4191dfab5d46e883b3251b034c1479, State: Initialized, Role: FOLLOWER
I20260207 20:53:46.057219 12200 consensus_queue.cc:260] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } } peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } }
I20260207 20:53:46.067992 12200 ts_tablet_manager.cc:1434] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479: Time spent starting tablet: real 0.015s user 0.006s sys 0.007s
I20260207 20:53:46.071892 12200 tablet_bootstrap.cc:492] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479: Bootstrap starting.
I20260207 20:53:46.068044 12201 tablet_bootstrap.cc:654] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:46.080331 12200 tablet_bootstrap.cc:654] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:46.086972 11916 catalog_manager.cc:1269] Loaded cluster ID: 7e4c411517b64475b9c86b6048eaa106
I20260207 20:53:46.087332 11916 catalog_manager.cc:1562] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef: loading cluster ID for follower catalog manager: success
I20260207 20:53:46.097729 11916 catalog_manager.cc:1584] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef: acquiring CA information for follower catalog manager: success
I20260207 20:53:46.104060 11939 catalog_manager.cc:1269] Loaded cluster ID: 7e4c411517b64475b9c86b6048eaa106
I20260207 20:53:46.104394 11939 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be: loading cluster ID for follower catalog manager: success
I20260207 20:53:46.109381 11916 catalog_manager.cc:1612] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:46.112537 12200 tablet_bootstrap.cc:492] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479: No bootstrap required, opened a new log
I20260207 20:53:46.113103 12200 ts_tablet_manager.cc:1403] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479: Time spent bootstrapping tablet: real 0.041s user 0.009s sys 0.008s
I20260207 20:53:46.116119 12200 raft_consensus.cc:359] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.116783 12200 raft_consensus.cc:385] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:46.117055 12200 raft_consensus.cc:740] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc4191dfab5d46e883b3251b034c1479, State: Initialized, Role: FOLLOWER
I20260207 20:53:46.117980 11939 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be: acquiring CA information for follower catalog manager: success
I20260207 20:53:46.117712 12200 consensus_queue.cc:260] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.125501 12200 ts_tablet_manager.cc:1434] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479: Time spent starting tablet: real 0.012s user 0.004s sys 0.004s
I20260207 20:53:46.126719 12200 tablet_bootstrap.cc:492] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479: Bootstrap starting.
I20260207 20:53:46.127763 11939 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:46.131047 12202 tablet_bootstrap.cc:492] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606: No bootstrap required, opened a new log
I20260207 20:53:46.135532 12201 tablet_bootstrap.cc:492] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26: No bootstrap required, opened a new log
I20260207 20:53:46.136642 12201 ts_tablet_manager.cc:1403] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26: Time spent bootstrapping tablet: real 0.119s user 0.012s sys 0.011s
I20260207 20:53:46.131597 12202 ts_tablet_manager.cc:1403] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606: Time spent bootstrapping tablet: real 0.107s user 0.013s sys 0.000s
I20260207 20:53:46.140601 12202 raft_consensus.cc:359] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.141271 12202 raft_consensus.cc:385] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:46.141505 12202 raft_consensus.cc:740] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5987c8087bb8442b8ea62b8378c89606, State: Initialized, Role: FOLLOWER
I20260207 20:53:46.142082 12202 consensus_queue.cc:260] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.145360 12201 raft_consensus.cc:359] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } } peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } }
I20260207 20:53:46.146106 12201 raft_consensus.cc:385] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:46.146397 12201 raft_consensus.cc:740] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b43b54cd6074804af60756cb25ffd26, State: Initialized, Role: FOLLOWER
I20260207 20:53:46.147267 12201 consensus_queue.cc:260] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } } peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } }
I20260207 20:53:46.148213 12200 tablet_bootstrap.cc:654] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:46.157548 12202 ts_tablet_manager.cc:1434] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260207 20:53:46.161916 12201 ts_tablet_manager.cc:1434] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26: Time spent starting tablet: real 0.025s user 0.005s sys 0.007s
I20260207 20:53:46.165184 12201 tablet_bootstrap.cc:492] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26: Bootstrap starting.
I20260207 20:53:46.167464 12202 tablet_bootstrap.cc:492] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606: Bootstrap starting.
I20260207 20:53:46.176074 12201 tablet_bootstrap.cc:654] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:46.181161 12200 tablet_bootstrap.cc:492] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479: No bootstrap required, opened a new log
I20260207 20:53:46.181668 12200 ts_tablet_manager.cc:1403] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479: Time spent bootstrapping tablet: real 0.055s user 0.014s sys 0.012s
I20260207 20:53:46.181600 12202 tablet_bootstrap.cc:654] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:46.186633 12200 raft_consensus.cc:359] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.187350 12200 raft_consensus.cc:385] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:46.187625 12200 raft_consensus.cc:740] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc4191dfab5d46e883b3251b034c1479, State: Initialized, Role: FOLLOWER
I20260207 20:53:46.188084 12201 tablet_bootstrap.cc:492] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26: No bootstrap required, opened a new log
I20260207 20:53:46.188668 12201 ts_tablet_manager.cc:1403] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.003s
I20260207 20:53:46.188431 12200 consensus_queue.cc:260] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.193599 12209 raft_consensus.cc:493] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:46.194103 12209 raft_consensus.cc:515] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } } peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } }
I20260207 20:53:46.196542 12209 leader_election.cc:290] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165), 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621)
I20260207 20:53:46.205849 12200 ts_tablet_manager.cc:1434] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479: Time spent starting tablet: real 0.022s user 0.005s sys 0.001s
I20260207 20:53:46.206708 12204 raft_consensus.cc:493] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:46.207248 12204 raft_consensus.cc:515] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } } peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } }
I20260207 20:53:46.209240 12201 raft_consensus.cc:359] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.209749 12204 leader_election.cc:290] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b43b54cd6074804af60756cb25ffd26 (127.2.223.3:44319), 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621)
I20260207 20:53:46.210017 12201 raft_consensus.cc:385] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:46.210376 12201 raft_consensus.cc:740] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b43b54cd6074804af60756cb25ffd26, State: Initialized, Role: FOLLOWER
I20260207 20:53:46.211122 12201 consensus_queue.cc:260] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.213377 12201 ts_tablet_manager.cc:1434] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26: Time spent starting tablet: real 0.024s user 0.004s sys 0.000s
I20260207 20:53:46.214430 12201 tablet_bootstrap.cc:492] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26: Bootstrap starting.
I20260207 20:53:46.232967 12201 tablet_bootstrap.cc:654] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:46.256278 12201 tablet_bootstrap.cc:492] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26: No bootstrap required, opened a new log
I20260207 20:53:46.256804 12201 ts_tablet_manager.cc:1403] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26: Time spent bootstrapping tablet: real 0.043s user 0.012s sys 0.008s
I20260207 20:53:46.259680 11987 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96dddbfc23d74701ba7e28f3579c04ba" candidate_uuid: "9b43b54cd6074804af60756cb25ffd26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc4191dfab5d46e883b3251b034c1479" is_pre_election: true
I20260207 20:53:46.260392 11987 raft_consensus.cc:2468] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b43b54cd6074804af60756cb25ffd26 in term 0.
I20260207 20:53:46.261456 12201 raft_consensus.cc:359] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.264456 12201 raft_consensus.cc:385] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:46.268484 12119 leader_election.cc:304] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b43b54cd6074804af60756cb25ffd26, dc4191dfab5d46e883b3251b034c1479; no voters:
I20260207 20:53:46.268602 12065 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96dddbfc23d74701ba7e28f3579c04ba" candidate_uuid: "9b43b54cd6074804af60756cb25ffd26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5987c8087bb8442b8ea62b8378c89606" is_pre_election: true
I20260207 20:53:46.269474 12202 tablet_bootstrap.cc:492] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606: No bootstrap required, opened a new log
I20260207 20:53:46.269542 12209 raft_consensus.cc:2804] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:46.270618 12209 raft_consensus.cc:493] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:46.270988 12209 raft_consensus.cc:3060] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Advancing to term 1
W20260207 20:53:46.270790 12120 leader_election.cc:343] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:53:46.270192 12202 ts_tablet_manager.cc:1403] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606: Time spent bootstrapping tablet: real 0.103s user 0.011s sys 0.022s
I20260207 20:53:46.283423 12202 raft_consensus.cc:359] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.284164 12202 raft_consensus.cc:385] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:46.284480 12202 raft_consensus.cc:740] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5987c8087bb8442b8ea62b8378c89606, State: Initialized, Role: FOLLOWER
I20260207 20:53:46.285187 12202 consensus_queue.cc:260] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.288667 12209 raft_consensus.cc:515] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } } peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } }
I20260207 20:53:46.290567 12202 ts_tablet_manager.cc:1434] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260207 20:53:46.264736 12201 raft_consensus.cc:740] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b43b54cd6074804af60756cb25ffd26, State: Initialized, Role: FOLLOWER
I20260207 20:53:46.291694 12202 tablet_bootstrap.cc:492] T 96dddbfc23d74701ba7e28f3579c04ba P 5987c8087bb8442b8ea62b8378c89606: Bootstrap starting.
I20260207 20:53:46.292337 11987 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96dddbfc23d74701ba7e28f3579c04ba" candidate_uuid: "9b43b54cd6074804af60756cb25ffd26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc4191dfab5d46e883b3251b034c1479"
I20260207 20:53:46.292958 11987 raft_consensus.cc:3060] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:46.301944 11987 raft_consensus.cc:2468] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b43b54cd6074804af60756cb25ffd26 in term 1.
I20260207 20:53:46.302620 12202 tablet_bootstrap.cc:654] T 96dddbfc23d74701ba7e28f3579c04ba P 5987c8087bb8442b8ea62b8378c89606: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:46.307031 12154 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96dddbfc23d74701ba7e28f3579c04ba" candidate_uuid: "dc4191dfab5d46e883b3251b034c1479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b43b54cd6074804af60756cb25ffd26" is_pre_election: true
I20260207 20:53:46.308495 12154 raft_consensus.cc:2393] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dc4191dfab5d46e883b3251b034c1479 in current term 1: Already voted for candidate 9b43b54cd6074804af60756cb25ffd26 in this term.
I20260207 20:53:46.291778 12201 consensus_queue.cc:260] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.313429 12119 leader_election.cc:304] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b43b54cd6074804af60756cb25ffd26, dc4191dfab5d46e883b3251b034c1479; no voters:
I20260207 20:53:46.311542 12209 leader_election.cc:290] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 1 election: Requested vote from peers dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165), 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621)
I20260207 20:53:46.321676 12065 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96dddbfc23d74701ba7e28f3579c04ba" candidate_uuid: "9b43b54cd6074804af60756cb25ffd26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5987c8087bb8442b8ea62b8378c89606"
W20260207 20:53:46.323768 12120 leader_election.cc:343] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:53:46.326028 12065 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96dddbfc23d74701ba7e28f3579c04ba" candidate_uuid: "dc4191dfab5d46e883b3251b034c1479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5987c8087bb8442b8ea62b8378c89606" is_pre_election: true
W20260207 20:53:46.327392 11953 leader_election.cc:343] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:53:46.327873 11953 leader_election.cc:304] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc4191dfab5d46e883b3251b034c1479; no voters: 5987c8087bb8442b8ea62b8378c89606, 9b43b54cd6074804af60756cb25ffd26
I20260207 20:53:46.329767 12204 raft_consensus.cc:2749] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:53:46.334774 12201 ts_tablet_manager.cc:1434] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26: Time spent starting tablet: real 0.078s user 0.006s sys 0.016s
I20260207 20:53:46.321063 12209 raft_consensus.cc:2804] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:46.336527 12209 raft_consensus.cc:697] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [term 1 LEADER]: Becoming Leader. State: Replica: 9b43b54cd6074804af60756cb25ffd26, State: Running, Role: LEADER
I20260207 20:53:46.337414 12209 consensus_queue.cc:237] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } } peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } }
I20260207 20:53:46.350968 12202 tablet_bootstrap.cc:492] T 96dddbfc23d74701ba7e28f3579c04ba P 5987c8087bb8442b8ea62b8378c89606: No bootstrap required, opened a new log
I20260207 20:53:46.351543 12202 ts_tablet_manager.cc:1403] T 96dddbfc23d74701ba7e28f3579c04ba P 5987c8087bb8442b8ea62b8378c89606: Time spent bootstrapping tablet: real 0.060s user 0.009s sys 0.003s
I20260207 20:53:46.351166 11794 catalog_manager.cc:5654] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b43b54cd6074804af60756cb25ffd26 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "9b43b54cd6074804af60756cb25ffd26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260207 20:53:46.357635 12202 raft_consensus.cc:359] T 96dddbfc23d74701ba7e28f3579c04ba P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } } peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } }
I20260207 20:53:46.358378 12202 raft_consensus.cc:385] T 96dddbfc23d74701ba7e28f3579c04ba P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:46.358708 12202 raft_consensus.cc:740] T 96dddbfc23d74701ba7e28f3579c04ba P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5987c8087bb8442b8ea62b8378c89606, State: Initialized, Role: FOLLOWER
I20260207 20:53:46.359493 12202 consensus_queue.cc:260] T 96dddbfc23d74701ba7e28f3579c04ba P 5987c8087bb8442b8ea62b8378c89606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } } peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } }
I20260207 20:53:46.361730 12202 ts_tablet_manager.cc:1434] T 96dddbfc23d74701ba7e28f3579c04ba P 5987c8087bb8442b8ea62b8378c89606: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260207 20:53:46.409089 12209 raft_consensus.cc:493] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:46.409611 12209 raft_consensus.cc:515] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.415480 12065 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "52feb87fb4a84a0a9535925ca10abb19" candidate_uuid: "9b43b54cd6074804af60756cb25ffd26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5987c8087bb8442b8ea62b8378c89606" is_pre_election: true
I20260207 20:53:46.416170 12065 raft_consensus.cc:2468] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b43b54cd6074804af60756cb25ffd26 in term 0.
I20260207 20:53:46.416244 11987 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "52feb87fb4a84a0a9535925ca10abb19" candidate_uuid: "9b43b54cd6074804af60756cb25ffd26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc4191dfab5d46e883b3251b034c1479" is_pre_election: true
I20260207 20:53:46.416832 11987 raft_consensus.cc:2468] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b43b54cd6074804af60756cb25ffd26 in term 0.
I20260207 20:53:46.417310 12120 leader_election.cc:304] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5987c8087bb8442b8ea62b8378c89606, 9b43b54cd6074804af60756cb25ffd26; no voters:
I20260207 20:53:46.414887 12209 leader_election.cc:290] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165), 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621)
I20260207 20:53:46.418430 12220 raft_consensus.cc:2804] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:46.418825 12220 raft_consensus.cc:493] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:46.419121 12220 raft_consensus.cc:3060] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:46.424623 12204 raft_consensus.cc:493] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:46.425115 12204 raft_consensus.cc:515] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.427038 12204 leader_election.cc:290] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621), 9b43b54cd6074804af60756cb25ffd26 (127.2.223.3:44319)
I20260207 20:53:46.428485 12220 raft_consensus.cc:515] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.429278 12154 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9a765fb155142f49ceba92d7468fc02" candidate_uuid: "dc4191dfab5d46e883b3251b034c1479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b43b54cd6074804af60756cb25ffd26" is_pre_election: true
I20260207 20:53:46.429905 12154 raft_consensus.cc:2468] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc4191dfab5d46e883b3251b034c1479 in term 0.
I20260207 20:53:46.430894 11951 leader_election.cc:304] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b43b54cd6074804af60756cb25ffd26, dc4191dfab5d46e883b3251b034c1479; no voters:
I20260207 20:53:46.431378 12064 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "52feb87fb4a84a0a9535925ca10abb19" candidate_uuid: "9b43b54cd6074804af60756cb25ffd26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5987c8087bb8442b8ea62b8378c89606"
I20260207 20:53:46.431985 12064 raft_consensus.cc:3060] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:46.432117 12065 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9a765fb155142f49ceba92d7468fc02" candidate_uuid: "dc4191dfab5d46e883b3251b034c1479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5987c8087bb8442b8ea62b8378c89606" is_pre_election: true
I20260207 20:53:46.432746 12065 raft_consensus.cc:2468] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc4191dfab5d46e883b3251b034c1479 in term 0.
I20260207 20:53:46.433043 11987 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "52feb87fb4a84a0a9535925ca10abb19" candidate_uuid: "9b43b54cd6074804af60756cb25ffd26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc4191dfab5d46e883b3251b034c1479"
I20260207 20:53:46.433605 11987 raft_consensus.cc:3060] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:46.439479 12204 raft_consensus.cc:2804] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:46.439934 12204 raft_consensus.cc:493] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:46.440282 12204 raft_consensus.cc:3060] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:46.445098 12064 raft_consensus.cc:2468] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b43b54cd6074804af60756cb25ffd26 in term 1.
I20260207 20:53:46.446198 12120 leader_election.cc:304] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5987c8087bb8442b8ea62b8378c89606, 9b43b54cd6074804af60756cb25ffd26; no voters:
I20260207 20:53:46.447291 11987 raft_consensus.cc:2468] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b43b54cd6074804af60756cb25ffd26 in term 1.
I20260207 20:53:46.447324 12220 leader_election.cc:290] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 1 election: Requested vote from peers dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165), 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621)
I20260207 20:53:46.448586 12220 raft_consensus.cc:2804] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:46.449919 12220 raft_consensus.cc:697] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [term 1 LEADER]: Becoming Leader. State: Replica: 9b43b54cd6074804af60756cb25ffd26, State: Running, Role: LEADER
I20260207 20:53:46.450902 12220 consensus_queue.cc:237] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.451160 12204 raft_consensus.cc:515] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.454959 12064 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9a765fb155142f49ceba92d7468fc02" candidate_uuid: "dc4191dfab5d46e883b3251b034c1479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5987c8087bb8442b8ea62b8378c89606"
I20260207 20:53:46.455634 12064 raft_consensus.cc:3060] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:46.461874 12204 leader_election.cc:290] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [CANDIDATE]: Term 1 election: Requested vote from peers 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621), 9b43b54cd6074804af60756cb25ffd26 (127.2.223.3:44319)
I20260207 20:53:46.462540 12064 raft_consensus.cc:2468] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc4191dfab5d46e883b3251b034c1479 in term 1.
I20260207 20:53:46.465210 12154 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9a765fb155142f49ceba92d7468fc02" candidate_uuid: "dc4191dfab5d46e883b3251b034c1479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b43b54cd6074804af60756cb25ffd26"
I20260207 20:53:46.465775 12154 raft_consensus.cc:3060] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:46.466493 11953 leader_election.cc:304] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5987c8087bb8442b8ea62b8378c89606, dc4191dfab5d46e883b3251b034c1479; no voters:
I20260207 20:53:46.467779 12204 raft_consensus.cc:2804] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:46.467458 11796 catalog_manager.cc:5654] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b43b54cd6074804af60756cb25ffd26 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "9b43b54cd6074804af60756cb25ffd26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:46.485909 12154 raft_consensus.cc:2468] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc4191dfab5d46e883b3251b034c1479 in term 1.
I20260207 20:53:46.490662 12204 raft_consensus.cc:697] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [term 1 LEADER]: Becoming Leader. State: Replica: dc4191dfab5d46e883b3251b034c1479, State: Running, Role: LEADER
I20260207 20:53:46.491715 12204 consensus_queue.cc:237] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.508718 11796 catalog_manager.cc:5654] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc4191dfab5d46e883b3251b034c1479 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "dc4191dfab5d46e883b3251b034c1479" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } health_report { overall_health: UNKNOWN } } }
I20260207 20:53:46.629781 11794 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47764:
name: "other-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "value"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\006\001\000\000\000\000\007\001d\000\000\000""\006\001\000\000\000\000\007\001d\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:53:46.632339 11794 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table other-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:53:46.690348 11975 tablet_service.cc:1505] Processing CreateTablet for tablet 28c29ecbc0104a33a0987868a6b8b525 (DEFAULT_TABLE table=other-table [id=bc1e9f2e40e14d1ab3d87130981ccead]), partition=RANGE (key) PARTITION 0 <= VALUES < 100
I20260207 20:53:46.691296 12143 tablet_service.cc:1505] Processing CreateTablet for tablet 28c29ecbc0104a33a0987868a6b8b525 (DEFAULT_TABLE table=other-table [id=bc1e9f2e40e14d1ab3d87130981ccead]), partition=RANGE (key) PARTITION 0 <= VALUES < 100
I20260207 20:53:46.692600 12143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c29ecbc0104a33a0987868a6b8b525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:46.693198 12055 tablet_service.cc:1505] Processing CreateTablet for tablet 28c29ecbc0104a33a0987868a6b8b525 (DEFAULT_TABLE table=other-table [id=bc1e9f2e40e14d1ab3d87130981ccead]), partition=RANGE (key) PARTITION 0 <= VALUES < 100
I20260207 20:53:46.694146 12055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c29ecbc0104a33a0987868a6b8b525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:46.691700 11975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c29ecbc0104a33a0987868a6b8b525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:46.708649 12202 tablet_bootstrap.cc:492] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606: Bootstrap starting.
I20260207 20:53:46.719559 12201 tablet_bootstrap.cc:492] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26: Bootstrap starting.
I20260207 20:53:46.723590 12202 tablet_bootstrap.cc:654] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:46.726148 12201 tablet_bootstrap.cc:654] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:46.742820 12202 tablet_bootstrap.cc:492] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606: No bootstrap required, opened a new log
I20260207 20:53:46.743428 12202 ts_tablet_manager.cc:1403] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606: Time spent bootstrapping tablet: real 0.035s user 0.015s sys 0.005s
I20260207 20:53:46.746248 12202 raft_consensus.cc:359] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.747043 12202 raft_consensus.cc:385] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:46.747612 12202 raft_consensus.cc:740] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5987c8087bb8442b8ea62b8378c89606, State: Initialized, Role: FOLLOWER
I20260207 20:53:46.749648 12201 tablet_bootstrap.cc:492] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26: No bootstrap required, opened a new log
I20260207 20:53:46.750209 12201 ts_tablet_manager.cc:1403] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26: Time spent bootstrapping tablet: real 0.031s user 0.014s sys 0.000s
I20260207 20:53:46.751389 12240 tablet_bootstrap.cc:492] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479: Bootstrap starting.
I20260207 20:53:46.753026 12201 raft_consensus.cc:359] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.753762 12201 raft_consensus.cc:385] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:46.754098 12201 raft_consensus.cc:740] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b43b54cd6074804af60756cb25ffd26, State: Initialized, Role: FOLLOWER
I20260207 20:53:46.754941 12201 consensus_queue.cc:260] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.748449 12202 consensus_queue.cc:260] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.760869 12202 ts_tablet_manager.cc:1434] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260207 20:53:46.761760 12064 raft_consensus.cc:3060] T 96dddbfc23d74701ba7e28f3579c04ba P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:46.769382 12201 ts_tablet_manager.cc:1434] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260207 20:53:46.787516 12240 tablet_bootstrap.cc:654] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:46.789669 12220 consensus_queue.cc:1048] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:46.807837 12240 tablet_bootstrap.cc:492] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479: No bootstrap required, opened a new log
I20260207 20:53:46.808499 12240 ts_tablet_manager.cc:1403] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479: Time spent bootstrapping tablet: real 0.057s user 0.014s sys 0.003s
I20260207 20:53:46.811225 12240 raft_consensus.cc:359] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.812043 12240 raft_consensus.cc:385] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:46.812388 12240 raft_consensus.cc:740] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc4191dfab5d46e883b3251b034c1479, State: Initialized, Role: FOLLOWER
I20260207 20:53:46.815171 12240 consensus_queue.cc:260] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.821699 12240 ts_tablet_manager.cc:1434] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260207 20:53:46.841411 12209 raft_consensus.cc:493] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:46.841842 12209 raft_consensus.cc:515] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.843381 12209 leader_election.cc:290] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165), 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621)
I20260207 20:53:46.844107 11987 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "28c29ecbc0104a33a0987868a6b8b525" candidate_uuid: "9b43b54cd6074804af60756cb25ffd26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc4191dfab5d46e883b3251b034c1479" is_pre_election: true
I20260207 20:53:46.844887 12065 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "28c29ecbc0104a33a0987868a6b8b525" candidate_uuid: "9b43b54cd6074804af60756cb25ffd26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5987c8087bb8442b8ea62b8378c89606" is_pre_election: true
I20260207 20:53:46.844800 11987 raft_consensus.cc:2468] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b43b54cd6074804af60756cb25ffd26 in term 0.
I20260207 20:53:46.845512 12065 raft_consensus.cc:2468] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b43b54cd6074804af60756cb25ffd26 in term 0.
I20260207 20:53:46.846294 12119 leader_election.cc:304] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b43b54cd6074804af60756cb25ffd26, dc4191dfab5d46e883b3251b034c1479; no voters:
I20260207 20:53:46.847271 12209 raft_consensus.cc:2804] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:46.847625 12209 raft_consensus.cc:493] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:46.847944 12209 raft_consensus.cc:3060] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:46.860549 12220 consensus_queue.cc:1048] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260207 20:53:46.862507 12209 raft_consensus.cc:515] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.869318 11986 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "28c29ecbc0104a33a0987868a6b8b525" candidate_uuid: "9b43b54cd6074804af60756cb25ffd26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc4191dfab5d46e883b3251b034c1479"
I20260207 20:53:46.869869 11986 raft_consensus.cc:3060] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:46.876508 11986 raft_consensus.cc:2468] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b43b54cd6074804af60756cb25ffd26 in term 1.
I20260207 20:53:46.877571 12119 leader_election.cc:304] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b43b54cd6074804af60756cb25ffd26, dc4191dfab5d46e883b3251b034c1479; no voters:
I20260207 20:53:46.878644 12220 raft_consensus.cc:2804] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:46.880033 12220 raft_consensus.cc:697] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [term 1 LEADER]: Becoming Leader. State: Replica: 9b43b54cd6074804af60756cb25ffd26, State: Running, Role: LEADER
I20260207 20:53:46.880949 12220 consensus_queue.cc:237] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:46.883160 12065 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "28c29ecbc0104a33a0987868a6b8b525" candidate_uuid: "9b43b54cd6074804af60756cb25ffd26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5987c8087bb8442b8ea62b8378c89606"
I20260207 20:53:46.883947 12065 raft_consensus.cc:3060] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:46.883189 12209 leader_election.cc:290] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 1 election: Requested vote from peers dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165), 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621)
I20260207 20:53:46.890362 12065 raft_consensus.cc:2468] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b43b54cd6074804af60756cb25ffd26 in term 1.
I20260207 20:53:46.906186 11794 catalog_manager.cc:5654] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b43b54cd6074804af60756cb25ffd26 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "9b43b54cd6074804af60756cb25ffd26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:46.932981 12220 consensus_queue.cc:1048] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:46.945124 11795 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47764:
table { table_name: "other-table" } alter_schema_steps { type: DROP_RANGE_PARTITION drop_range_partition { range_bounds { rows: "\006\001\000\000\000\000\007\001d\000\000\000""\006\001\000\000\000\000\007\001d\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "value" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
I20260207 20:53:46.950712 12220 consensus_queue.cc:1048] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:46.985764 11795 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c: Sending DeleteTablet for 3 replicas of tablet 28c29ecbc0104a33a0987868a6b8b525
I20260207 20:53:46.988742 12143 tablet_service.cc:1552] Processing DeleteTablet for tablet 28c29ecbc0104a33a0987868a6b8b525 with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-02-07 20:53:46 UTC) from {username='slave'} at 127.0.0.1:56582
I20260207 20:53:46.989358 12055 tablet_service.cc:1552] Processing DeleteTablet for tablet 28c29ecbc0104a33a0987868a6b8b525 with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-02-07 20:53:46 UTC) from {username='slave'} at 127.0.0.1:57118
I20260207 20:53:46.991042 11975 tablet_service.cc:1552] Processing DeleteTablet for tablet 28c29ecbc0104a33a0987868a6b8b525 with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-02-07 20:53:46 UTC) from {username='slave'} at 127.0.0.1:51280
I20260207 20:53:46.995397 12253 tablet_replica.cc:333] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479: stopping tablet replica
I20260207 20:53:46.997392 12253 raft_consensus.cc:2243] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:46.999723 12253 raft_consensus.cc:2272] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:47.014034 12253 ts_tablet_manager.cc:1916] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:53:47.028729 12252 tablet_replica.cc:333] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606: stopping tablet replica
I20260207 20:53:47.032593 12251 tablet_replica.cc:333] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26: stopping tablet replica
I20260207 20:53:47.035161 12251 raft_consensus.cc:2243] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:47.035956 12251 pending_rounds.cc:70] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26: Trying to abort 1 pending ops.
I20260207 20:53:47.036206 12251 pending_rounds.cc:77] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7251958279717556224 op_type: NO_OP noop_request { }
I20260207 20:53:47.036561 12251 raft_consensus.cc:2889] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260207 20:53:47.037211 12252 raft_consensus.cc:2243] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:47.037782 12252 raft_consensus.cc:2272] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:47.036921 12251 raft_consensus.cc:2272] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:47.047904 12252 ts_tablet_manager.cc:1916] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:53:47.055377 12251 ts_tablet_manager.cc:1916] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:53:47.062757 12204 consensus_queue.cc:1048] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:47.083052 12253 ts_tablet_manager.cc:1929] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260207 20:53:47.083988 12253 log.cc:1199] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-0-root/wals/28c29ecbc0104a33a0987868a6b8b525
I20260207 20:53:47.083045 12251 ts_tablet_manager.cc:1929] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260207 20:53:47.084930 12251 log.cc:1199] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-2-root/wals/28c29ecbc0104a33a0987868a6b8b525
I20260207 20:53:47.085827 12253 ts_tablet_manager.cc:1950] T 28c29ecbc0104a33a0987868a6b8b525 P dc4191dfab5d46e883b3251b034c1479: Deleting consensus metadata
I20260207 20:53:47.092849 12204 consensus_queue.cc:1048] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:47.093694 12251 ts_tablet_manager.cc:1950] T 28c29ecbc0104a33a0987868a6b8b525 P 9b43b54cd6074804af60756cb25ffd26: Deleting consensus metadata
I20260207 20:53:47.097090 11783 catalog_manager.cc:4985] TS dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165): tablet 28c29ecbc0104a33a0987868a6b8b525 (table other-table [id=bc1e9f2e40e14d1ab3d87130981ccead]) successfully deleted
I20260207 20:53:47.099387 12252 ts_tablet_manager.cc:1929] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260207 20:53:47.099936 12252 log.cc:1199] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestFilterOnNotabletTable.1770497537224219-2940-0/minicluster-data/ts-1-root/wals/28c29ecbc0104a33a0987868a6b8b525
I20260207 20:53:47.100216 11782 catalog_manager.cc:4985] TS 9b43b54cd6074804af60756cb25ffd26 (127.2.223.3:44319): tablet 28c29ecbc0104a33a0987868a6b8b525 (table other-table [id=bc1e9f2e40e14d1ab3d87130981ccead]) successfully deleted
I20260207 20:53:47.100745 12252 ts_tablet_manager.cc:1950] T 28c29ecbc0104a33a0987868a6b8b525 P 5987c8087bb8442b8ea62b8378c89606: Deleting consensus metadata
I20260207 20:53:47.104328 11784 catalog_manager.cc:4985] TS 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621): tablet 28c29ecbc0104a33a0987868a6b8b525 (table other-table [id=bc1e9f2e40e14d1ab3d87130981ccead]) successfully deleted
W20260207 20:53:47.232704 11951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.223.3:44319, user_credentials={real_user=slave}} blocked reactor thread for 45017.8us
W20260207 20:53:48.124466 11784 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.223.60:38865, user_credentials={real_user=slave}} blocked reactor thread for 52153.5us
I20260207 20:53:48.501798 12055 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:53:48.503768 11975 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:53:48.522320 12143 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260207 20:53:48.665156 12008 debug-util.cc:398] Leaking SignalData structure 0x7b08000a1f40 after lost signal to thread 2943
I20260207 20:53:49.030695 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:53:49.121728 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:49.122848 2940 tablet_replica.cc:333] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479: stopping tablet replica
I20260207 20:53:49.123728 2940 raft_consensus.cc:2243] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:49.124284 2940 raft_consensus.cc:2272] T 52feb87fb4a84a0a9535925ca10abb19 P dc4191dfab5d46e883b3251b034c1479 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:49.126921 2940 tablet_replica.cc:333] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479: stopping tablet replica
I20260207 20:53:49.127638 2940 raft_consensus.cc:2243] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:49.128728 2940 raft_consensus.cc:2272] T c9a765fb155142f49ceba92d7468fc02 P dc4191dfab5d46e883b3251b034c1479 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:49.131107 2940 tablet_replica.cc:333] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479: stopping tablet replica
I20260207 20:53:49.131744 2940 raft_consensus.cc:2243] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:49.132638 2940 raft_consensus.cc:2272] T 96dddbfc23d74701ba7e28f3579c04ba P dc4191dfab5d46e883b3251b034c1479 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260207 20:53:49.196355 12119 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.223.1:34165: connect: Connection refused (error 111) [suppressed 42 similar messages]
W20260207 20:53:49.199622 12119 consensus_peers.cc:597] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 -> Peer dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165): Couldn't send request to peer dc4191dfab5d46e883b3251b034c1479. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:34165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260207 20:53:49.327044 12119 consensus_peers.cc:597] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 -> Peer dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165): Couldn't send request to peer dc4191dfab5d46e883b3251b034c1479. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:34165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260207 20:53:50.143996 2940 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 12008)
I20260207 20:53:50.267679 12303 raft_consensus.cc:493] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc4191dfab5d46e883b3251b034c1479)
I20260207 20:53:50.268711 12303 raft_consensus.cc:515] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:50.273389 12303 leader_election.cc:290] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165), 9b43b54cd6074804af60756cb25ffd26 (127.2.223.3:44319)
W20260207 20:53:50.290771 12030 leader_election.cc:336] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165): Network error: Client connection negotiation failed: client connection to 127.2.223.1:34165: connect: Connection refused (error 111)
I20260207 20:53:50.297988 12154 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9a765fb155142f49ceba92d7468fc02" candidate_uuid: "5987c8087bb8442b8ea62b8378c89606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b43b54cd6074804af60756cb25ffd26" is_pre_election: true
I20260207 20:53:50.300266 12029 leader_election.cc:304] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5987c8087bb8442b8ea62b8378c89606; no voters: 9b43b54cd6074804af60756cb25ffd26, dc4191dfab5d46e883b3251b034c1479
I20260207 20:53:50.301225 12303 raft_consensus.cc:2749] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260207 20:53:50.345423 12301 raft_consensus.cc:493] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc4191dfab5d46e883b3251b034c1479)
I20260207 20:53:50.346153 12301 raft_consensus.cc:515] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:50.348104 12301 leader_election.cc:290] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165), 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621)
I20260207 20:53:50.349989 12065 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9a765fb155142f49ceba92d7468fc02" candidate_uuid: "9b43b54cd6074804af60756cb25ffd26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5987c8087bb8442b8ea62b8378c89606" is_pre_election: true
I20260207 20:53:50.350803 12065 raft_consensus.cc:2468] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b43b54cd6074804af60756cb25ffd26 in term 1.
I20260207 20:53:50.352232 12120 leader_election.cc:304] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5987c8087bb8442b8ea62b8378c89606, 9b43b54cd6074804af60756cb25ffd26; no voters:
W20260207 20:53:50.354038 12119 leader_election.cc:336] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165): Network error: Client connection negotiation failed: client connection to 127.2.223.1:34165: connect: Connection refused (error 111)
I20260207 20:53:50.355330 12301 raft_consensus.cc:2804] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260207 20:53:50.355822 12301 raft_consensus.cc:493] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dc4191dfab5d46e883b3251b034c1479)
I20260207 20:53:50.356350 12301 raft_consensus.cc:3060] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:53:50.367113 12301 raft_consensus.cc:515] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:50.370293 12065 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9a765fb155142f49ceba92d7468fc02" candidate_uuid: "9b43b54cd6074804af60756cb25ffd26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5987c8087bb8442b8ea62b8378c89606"
I20260207 20:53:50.371065 12065 raft_consensus.cc:3060] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:53:50.368980 12301 leader_election.cc:290] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 2 election: Requested vote from peers dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165), 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621)
W20260207 20:53:50.375056 12119 leader_election.cc:336] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165): Network error: Client connection negotiation failed: client connection to 127.2.223.1:34165: connect: Connection refused (error 111)
I20260207 20:53:50.379789 12065 raft_consensus.cc:2468] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b43b54cd6074804af60756cb25ffd26 in term 2.
I20260207 20:53:50.380985 12120 leader_election.cc:304] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5987c8087bb8442b8ea62b8378c89606, 9b43b54cd6074804af60756cb25ffd26; no voters: dc4191dfab5d46e883b3251b034c1479
I20260207 20:53:50.381731 12301 raft_consensus.cc:2804] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 2 FOLLOWER]: Leader election won for term 2
I20260207 20:53:50.384150 12301 raft_consensus.cc:697] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 2 LEADER]: Becoming Leader. State: Replica: 9b43b54cd6074804af60756cb25ffd26, State: Running, Role: LEADER
I20260207 20:53:50.385864 12301 consensus_queue.cc:237] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } }
I20260207 20:53:50.397169 11797 catalog_manager.cc:5654] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 reported cstate change: term changed from 1 to 2, leader changed from dc4191dfab5d46e883b3251b034c1479 (127.2.223.1) to 9b43b54cd6074804af60756cb25ffd26 (127.2.223.3). New cstate: current_term: 2 leader_uuid: "9b43b54cd6074804af60756cb25ffd26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc4191dfab5d46e883b3251b034c1479" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 34165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b43b54cd6074804af60756cb25ffd26" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 44319 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:50.957463 12065 raft_consensus.cc:1275] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 2 FOLLOWER]: Refusing update from remote peer 9b43b54cd6074804af60756cb25ffd26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260207 20:53:50.959002 12301 consensus_queue.cc:1048] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5987c8087bb8442b8ea62b8378c89606" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260207 20:53:51.008577 12119 consensus_peers.cc:597] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 -> Peer dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165): Couldn't send request to peer dc4191dfab5d46e883b3251b034c1479. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:34165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260207 20:53:51.145016 2940 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 12008)
W20260207 20:53:51.716557 12119 consensus_peers.cc:597] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 -> Peer dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165): Couldn't send request to peer dc4191dfab5d46e883b3251b034c1479. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:34165: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260207 20:53:51.762785 12119 consensus_peers.cc:597] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 -> Peer dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165): Couldn't send request to peer dc4191dfab5d46e883b3251b034c1479. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:34165: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260207 20:53:52.145504 2940 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 12008)
W20260207 20:53:53.146132 2940 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 12008)
W20260207 20:53:53.676117 12119 consensus_peers.cc:597] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 -> Peer dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165): Couldn't send request to peer dc4191dfab5d46e883b3251b034c1479. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:34165: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260207 20:53:53.897102 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:53:53.926180 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:53:53.961627 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:53.962389 2940 tablet_replica.cc:333] T 96dddbfc23d74701ba7e28f3579c04ba P 5987c8087bb8442b8ea62b8378c89606: stopping tablet replica
I20260207 20:53:53.963292 2940 raft_consensus.cc:2243] T 96dddbfc23d74701ba7e28f3579c04ba P 5987c8087bb8442b8ea62b8378c89606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:53.963785 2940 raft_consensus.cc:2272] T 96dddbfc23d74701ba7e28f3579c04ba P 5987c8087bb8442b8ea62b8378c89606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:53.966689 2940 tablet_replica.cc:333] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606: stopping tablet replica
I20260207 20:53:53.967160 2940 raft_consensus.cc:2243] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:53.967554 2940 raft_consensus.cc:2272] T 52feb87fb4a84a0a9535925ca10abb19 P 5987c8087bb8442b8ea62b8378c89606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:53.969487 2940 tablet_replica.cc:333] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606: stopping tablet replica
I20260207 20:53:53.969918 2940 raft_consensus.cc:2243] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:53.970376 2940 raft_consensus.cc:2272] T c9a765fb155142f49ceba92d7468fc02 P 5987c8087bb8442b8ea62b8378c89606 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260207 20:53:53.975456 12120 consensus_peers.cc:597] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 -> Peer 5987c8087bb8442b8ea62b8378c89606 (127.2.223.2:38621): Couldn't send request to peer 5987c8087bb8442b8ea62b8378c89606. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:53.994715 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:53:54.013662 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
W20260207 20:53:54.050096 12119 consensus_peers.cc:597] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 -> Peer dc4191dfab5d46e883b3251b034c1479 (127.2.223.1:34165): Couldn't send request to peer dc4191dfab5d46e883b3251b034c1479. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:34165: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260207 20:53:54.050710 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:54.051594 2940 tablet_replica.cc:333] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26: stopping tablet replica
I20260207 20:53:54.052222 2940 raft_consensus.cc:2243] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 2 LEADER]: Raft consensus shutting down.
I20260207 20:53:54.053025 2940 raft_consensus.cc:2272] T c9a765fb155142f49ceba92d7468fc02 P 9b43b54cd6074804af60756cb25ffd26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:54.055265 2940 tablet_replica.cc:333] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26: stopping tablet replica
I20260207 20:53:54.055787 2940 raft_consensus.cc:2243] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:54.056661 2940 raft_consensus.cc:2272] T 52feb87fb4a84a0a9535925ca10abb19 P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:54.059087 2940 tablet_replica.cc:333] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26: stopping tablet replica
I20260207 20:53:54.059543 2940 raft_consensus.cc:2243] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:54.060381 2940 raft_consensus.cc:2272] T 96dddbfc23d74701ba7e28f3579c04ba P 9b43b54cd6074804af60756cb25ffd26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:54.083827 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:53:54.103220 2940 master.cc:561] Master@127.2.223.62:34671 shutting down...
I20260207 20:53:54.124096 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:54.124601 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:54.124876 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4a1f924420f9406f895bf7466f02f4be: stopping tablet replica
I20260207 20:53:54.144657 2940 master.cc:583] Master@127.2.223.62:34671 shutdown complete.
I20260207 20:53:54.162123 2940 master.cc:561] Master@127.2.223.61:34643 shutting down...
I20260207 20:53:54.180832 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:54.181735 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:54.182121 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P f53df85887f04ef6abcd4e737082b30c: stopping tablet replica
I20260207 20:53:54.202339 2940 master.cc:583] Master@127.2.223.61:34643 shutdown complete.
I20260207 20:53:54.219399 2940 master.cc:561] Master@127.2.223.60:38865 shutting down...
I20260207 20:53:54.235860 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:54.236400 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:54.236716 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P ab6da7c48aa449b3b88f219df1a171ef: stopping tablet replica
I20260207 20:53:54.255264 2940 master.cc:583] Master@127.2.223.60:38865 shutdown complete.
[ OK ] RemoteKsckTest.TestFilterOnNotabletTable (9558 ms)
[ RUN ] RemoteKsckTest.TestNonMatchingTabletIdFilter
I20260207 20:53:54.293819 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:35915,127.2.223.61:41475,127.2.223.60:35789
I20260207 20:53:54.295346 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:54.301015 12330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:54.301059 12329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:54.301785 12332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:54.303710 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:54.304497 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:54.304675 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:54.304832 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497634304815 us; error 0 us; skew 500 ppm
I20260207 20:53:54.305317 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:54.307540 2940 webserver.cc:492] Webserver started at http://127.2.223.62:38769/ using document root <none> and password file <none>
I20260207 20:53:54.307979 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:54.308156 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:54.308409 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:54.309470 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "c8ea054ae8f4497aa4565d66abbc4f18"
format_stamp: "Formatted at 2026-02-07 20:53:54 on dist-test-slave-kqw4"
I20260207 20:53:54.313699 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:53:54.316988 12337 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:54.317655 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:53:54.317973 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "c8ea054ae8f4497aa4565d66abbc4f18"
format_stamp: "Formatted at 2026-02-07 20:53:54 on dist-test-slave-kqw4"
I20260207 20:53:54.318222 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:54.339532 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:54.340691 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:54.377019 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:35915
I20260207 20:53:54.377120 12388 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:35915 every 8 connection(s)
I20260207 20:53:54.380672 12389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:54.380836 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:54.386042 12391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:54.386549 12392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:54.389341 12394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:54.389219 12389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:54.389598 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:54.390698 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:54.390933 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:54.391093 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497634391076 us; error 0 us; skew 500 ppm
I20260207 20:53:54.391748 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:54.394562 2940 webserver.cc:492] Webserver started at http://127.2.223.61:33767/ using document root <none> and password file <none>
I20260207 20:53:54.395112 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:54.395347 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:54.395654 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:54.397104 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542"
format_stamp: "Formatted at 2026-02-07 20:53:54 on dist-test-slave-kqw4"
I20260207 20:53:54.402195 12389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:54.402451 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
W20260207 20:53:54.404407 12338 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.223.61:41475: connect: Connection refused (error 111) [suppressed 30 similar messages]
I20260207 20:53:54.406867 12402 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:54.407647 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
W20260207 20:53:54.407821 12389 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:41475: Network error: Client connection negotiation failed: client connection to 127.2.223.61:41475: connect: Connection refused (error 111)
I20260207 20:53:54.407974 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542"
format_stamp: "Formatted at 2026-02-07 20:53:54 on dist-test-slave-kqw4"
I20260207 20:53:54.408330 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:54.431289 12389 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } attempt: 1
I20260207 20:53:54.433887 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:54.435283 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260207 20:53:54.435325 12389 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:41475: Network error: Client connection negotiation failed: client connection to 127.2.223.61:41475: connect: Connection refused (error 111)
I20260207 20:53:54.481896 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:41475
I20260207 20:53:54.482019 12453 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:41475 every 8 connection(s)
I20260207 20:53:54.485567 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:54.485788 12454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260207 20:53:54.490789 12456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:54.491325 12457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:54.493201 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:54.493686 12459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:54.494623 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:54.494884 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:54.495087 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497634495062 us; error 0 us; skew 500 ppm
I20260207 20:53:54.495448 12454 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:54.495764 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:54.498669 2940 webserver.cc:492] Webserver started at http://127.2.223.60:35481/ using document root <none> and password file <none>
I20260207 20:53:54.499312 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:54.499478 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:54.499718 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:54.500756 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "084ba69ec8f148dd9cb1a19d07491663"
format_stamp: "Formatted at 2026-02-07 20:53:54 on dist-test-slave-kqw4"
I20260207 20:53:54.502866 12389 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } attempt: 2
I20260207 20:53:54.505914 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260207 20:53:54.508831 12454 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:54.510453 12466 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:54.512503 2940 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260207 20:53:54.512777 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "084ba69ec8f148dd9cb1a19d07491663"
format_stamp: "Formatted at 2026-02-07 20:53:54 on dist-test-slave-kqw4"
I20260207 20:53:54.513029 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:54.518746 12389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:54.522226 12454 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:54.523645 12389 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:35789: Network error: Client connection negotiation failed: client connection to 127.2.223.60:35789: connect: Connection refused (error 111)
I20260207 20:53:54.526923 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
W20260207 20:53:54.527555 12454 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:35789: Network error: Client connection negotiation failed: client connection to 127.2.223.60:35789: connect: Connection refused (error 111)
I20260207 20:53:54.528070 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:54.564991 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:35789
I20260207 20:53:54.565099 12519 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:35789 every 8 connection(s)
I20260207 20:53:54.567901 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:53:54.568915 12520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:54.574081 12389 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } attempt: 1
I20260207 20:53:54.575201 12520 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:54.587031 12520 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:54.588985 12454 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } attempt: 1
I20260207 20:53:54.593834 12389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18: Bootstrap starting.
I20260207 20:53:54.597854 12520 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:54.600448 12389 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:54.604974 12389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18: No bootstrap required, opened a new log
I20260207 20:53:54.606057 12454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542: Bootstrap starting.
I20260207 20:53:54.607137 12389 raft_consensus.cc:359] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } }
I20260207 20:53:54.607666 12389 raft_consensus.cc:385] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:54.607896 12389 raft_consensus.cc:740] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ea054ae8f4497aa4565d66abbc4f18, State: Initialized, Role: FOLLOWER
I20260207 20:53:54.608475 12389 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } }
I20260207 20:53:54.610461 12525 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } } }
I20260207 20:53:54.611303 12525 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:54.612136 12389 sys_catalog.cc:565] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:54.612653 12454 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:54.617414 12454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542: No bootstrap required, opened a new log
I20260207 20:53:54.619634 12454 raft_consensus.cc:359] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } }
I20260207 20:53:54.620332 12454 raft_consensus.cc:385] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:54.620618 12454 raft_consensus.cc:740] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a4aa32bb4a4c94af3e3c1b952e7542, State: Initialized, Role: FOLLOWER
I20260207 20:53:54.621404 12520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663: Bootstrap starting.
I20260207 20:53:54.621238 12454 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } }
I20260207 20:53:54.623132 12532 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } } }
I20260207 20:53:54.623951 12532 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:54.624831 12454 sys_catalog.cc:565] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:54.628356 12520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:54.629041 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
W20260207 20:53:54.633852 12539 catalog_manager.cc:1568] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:54.634230 12539 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:54.636839 12520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663: No bootstrap required, opened a new log
I20260207 20:53:54.639748 12520 raft_consensus.cc:359] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } }
I20260207 20:53:54.640358 12520 raft_consensus.cc:385] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:54.640518 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:53:54.640705 12520 raft_consensus.cc:740] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 084ba69ec8f148dd9cb1a19d07491663, State: Initialized, Role: FOLLOWER
I20260207 20:53:54.641513 12520 consensus_queue.cc:260] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } }
I20260207 20:53:54.643441 12551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } } }
I20260207 20:53:54.644491 12551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [sys.catalog]: This master's current role is: FOLLOWER
W20260207 20:53:54.644706 12550 catalog_manager.cc:1568] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:54.645051 12550 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:54.645102 12520 sys_catalog.cc:565] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:54.656102 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:54.658715 12562 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:54.659097 12562 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:53:54.663769 12564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:54.664399 12563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:54.666364 12566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:54.666479 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:54.667379 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:54.667572 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:54.667743 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497634667726 us; error 0 us; skew 500 ppm
I20260207 20:53:54.668262 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:54.670456 2940 webserver.cc:492] Webserver started at http://127.2.223.1:34245/ using document root <none> and password file <none>
I20260207 20:53:54.670944 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:54.671129 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:54.671367 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:54.672400 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "e8b47f5f48d14655af608b34379d9249"
format_stamp: "Formatted at 2026-02-07 20:53:54 on dist-test-slave-kqw4"
I20260207 20:53:54.676684 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260207 20:53:54.679711 12571 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:54.680421 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:53:54.680692 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "e8b47f5f48d14655af608b34379d9249"
format_stamp: "Formatted at 2026-02-07 20:53:54 on dist-test-slave-kqw4"
I20260207 20:53:54.680953 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:53:54.688331 12408 tablet.cc:2378] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260207 20:53:54.696480 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:54.697710 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:54.699173 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:54.701447 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:54.701638 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:54.701866 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:54.702018 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:54.743192 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:41349
I20260207 20:53:54.743368 12633 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:41349 every 8 connection(s)
I20260207 20:53:54.758967 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:54.761749 12634 heartbeater.cc:344] Connected to a master server at 127.2.223.60:35789
I20260207 20:53:54.762192 12634 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:54.763031 12634 heartbeater.cc:507] Master 127.2.223.60:35789 requested a full tablet report, sending...
I20260207 20:53:54.763957 12635 heartbeater.cc:344] Connected to a master server at 127.2.223.61:41475
I20260207 20:53:54.764350 12635 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:54.765136 12635 heartbeater.cc:507] Master 127.2.223.61:41475 requested a full tablet report, sending...
I20260207 20:53:54.765836 12485 ts_manager.cc:194] Registered new tserver with Master: e8b47f5f48d14655af608b34379d9249 (127.2.223.1:41349)
I20260207 20:53:54.767720 12419 ts_manager.cc:194] Registered new tserver with Master: e8b47f5f48d14655af608b34379d9249 (127.2.223.1:41349)
W20260207 20:53:54.770290 12641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:54.771180 12642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:54.772789 12636 heartbeater.cc:344] Connected to a master server at 127.2.223.62:35915
I20260207 20:53:54.773231 12636 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:54.773947 12636 heartbeater.cc:507] Master 127.2.223.62:35915 requested a full tablet report, sending...
I20260207 20:53:54.774233 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:54.775008 12645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:54.775887 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:54.776082 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:54.776253 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497634776235 us; error 0 us; skew 500 ppm
I20260207 20:53:54.776304 12354 ts_manager.cc:194] Registered new tserver with Master: e8b47f5f48d14655af608b34379d9249 (127.2.223.1:41349)
I20260207 20:53:54.776806 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:54.779373 2940 webserver.cc:492] Webserver started at http://127.2.223.2:45431/ using document root <none> and password file <none>
I20260207 20:53:54.780035 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:54.780267 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:54.780545 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:54.782456 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "34b761b8bdff414a876925a29a64c221"
format_stamp: "Formatted at 2026-02-07 20:53:54 on dist-test-slave-kqw4"
I20260207 20:53:54.786551 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260207 20:53:54.789990 12649 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:54.791013 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260207 20:53:54.791352 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "34b761b8bdff414a876925a29a64c221"
format_stamp: "Formatted at 2026-02-07 20:53:54 on dist-test-slave-kqw4"
I20260207 20:53:54.791615 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:54.807364 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:54.808465 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:54.809763 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:54.811897 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:54.812090 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:54.812295 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:54.812443 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:54.844869 12551 raft_consensus.cc:493] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:54.845422 12551 raft_consensus.cc:515] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } }
I20260207 20:53:54.847400 12551 leader_election.cc:290] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8ea054ae8f4497aa4565d66abbc4f18 (127.2.223.62:35915), e1a4aa32bb4a4c94af3e3c1b952e7542 (127.2.223.61:41475)
I20260207 20:53:54.848304 12525 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:54.848719 12525 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } }
I20260207 20:53:54.848835 12364 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "084ba69ec8f148dd9cb1a19d07491663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" is_pre_election: true
I20260207 20:53:54.849849 12364 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 084ba69ec8f148dd9cb1a19d07491663 in term 0.
I20260207 20:53:54.850011 12429 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "084ba69ec8f148dd9cb1a19d07491663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" is_pre_election: true
I20260207 20:53:54.850556 12525 leader_election.cc:290] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a4aa32bb4a4c94af3e3c1b952e7542 (127.2.223.61:41475), 084ba69ec8f148dd9cb1a19d07491663 (127.2.223.60:35789)
I20260207 20:53:54.850728 12429 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 084ba69ec8f148dd9cb1a19d07491663 in term 0.
I20260207 20:53:54.851902 12471 leader_election.cc:304] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 084ba69ec8f148dd9cb1a19d07491663, c8ea054ae8f4497aa4565d66abbc4f18; no voters:
I20260207 20:53:54.851953 12428 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" is_pre_election: true
I20260207 20:53:54.852818 12495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "084ba69ec8f148dd9cb1a19d07491663" is_pre_election: true
I20260207 20:53:54.853050 12428 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8ea054ae8f4497aa4565d66abbc4f18 in term 0.
I20260207 20:53:54.853459 12495 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8ea054ae8f4497aa4565d66abbc4f18 in term 0.
I20260207 20:53:54.854202 12338 leader_election.cc:304] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8ea054ae8f4497aa4565d66abbc4f18, e1a4aa32bb4a4c94af3e3c1b952e7542; no voters:
I20260207 20:53:54.855451 12525 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:54.855715 12525 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:54.855957 12525 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:54.861836 12551 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:54.862285 12551 raft_consensus.cc:493] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:54.862637 12551 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:54.868587 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:37731
I20260207 20:53:54.868854 12711 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:37731 every 8 connection(s)
I20260207 20:53:54.868811 12551 raft_consensus.cc:515] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } }
I20260207 20:53:54.871655 12364 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "084ba69ec8f148dd9cb1a19d07491663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ea054ae8f4497aa4565d66abbc4f18"
I20260207 20:53:54.871798 12428 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "084ba69ec8f148dd9cb1a19d07491663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542"
I20260207 20:53:54.872417 12428 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:54.874358 12525 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } }
I20260207 20:53:54.877067 12364 raft_consensus.cc:2393] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 084ba69ec8f148dd9cb1a19d07491663 in current term 1: Already voted for candidate c8ea054ae8f4497aa4565d66abbc4f18 in this term.
I20260207 20:53:54.882331 12429 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542"
I20260207 20:53:54.882711 12428 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 084ba69ec8f148dd9cb1a19d07491663 in term 1.
I20260207 20:53:54.883783 12525 leader_election.cc:290] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [CANDIDATE]: Term 1 election: Requested vote from peers e1a4aa32bb4a4c94af3e3c1b952e7542 (127.2.223.61:41475), 084ba69ec8f148dd9cb1a19d07491663 (127.2.223.60:35789)
I20260207 20:53:54.884320 12551 leader_election.cc:290] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [CANDIDATE]: Term 1 election: Requested vote from peers c8ea054ae8f4497aa4565d66abbc4f18 (127.2.223.62:35915), e1a4aa32bb4a4c94af3e3c1b952e7542 (127.2.223.61:41475)
I20260207 20:53:54.885165 12495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "084ba69ec8f148dd9cb1a19d07491663"
I20260207 20:53:54.885978 12495 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c8ea054ae8f4497aa4565d66abbc4f18 in current term 1: Already voted for candidate 084ba69ec8f148dd9cb1a19d07491663 in this term.
I20260207 20:53:54.887305 12338 leader_election.cc:304] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8ea054ae8f4497aa4565d66abbc4f18; no voters: 084ba69ec8f148dd9cb1a19d07491663, e1a4aa32bb4a4c94af3e3c1b952e7542
I20260207 20:53:54.888494 12525 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260207 20:53:54.888793 12468 leader_election.cc:304] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 084ba69ec8f148dd9cb1a19d07491663, e1a4aa32bb4a4c94af3e3c1b952e7542; no voters: c8ea054ae8f4497aa4565d66abbc4f18
I20260207 20:53:54.890836 12551 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:54.902954 12551 raft_consensus.cc:697] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 1 LEADER]: Becoming Leader. State: Replica: 084ba69ec8f148dd9cb1a19d07491663, State: Running, Role: LEADER
I20260207 20:53:54.904153 12551 consensus_queue.cc:237] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } }
I20260207 20:53:54.907601 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:54.915324 12712 heartbeater.cc:344] Connected to a master server at 127.2.223.60:35789
I20260207 20:53:54.915818 12712 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:54.916666 12712 heartbeater.cc:507] Master 127.2.223.60:35789 requested a full tablet report, sending...
W20260207 20:53:54.917550 12721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:54.919394 12715 heartbeater.cc:344] Connected to a master server at 127.2.223.62:35915
W20260207 20:53:54.921136 12722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:54.921000 12715 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:54.923309 12713 heartbeater.cc:344] Connected to a master server at 127.2.223.61:41475
I20260207 20:53:54.923483 12715 heartbeater.cc:507] Master 127.2.223.62:35915 requested a full tablet report, sending...
I20260207 20:53:54.923722 12713 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:54.924501 12713 heartbeater.cc:507] Master 127.2.223.61:41475 requested a full tablet report, sending...
I20260207 20:53:54.926265 12354 ts_manager.cc:194] Registered new tserver with Master: 34b761b8bdff414a876925a29a64c221 (127.2.223.2:37731)
I20260207 20:53:54.927088 12418 ts_manager.cc:194] Registered new tserver with Master: 34b761b8bdff414a876925a29a64c221 (127.2.223.2:37731)
I20260207 20:53:54.931285 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:54.931739 12724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:54.932268 12484 ts_manager.cc:194] Registered new tserver with Master: 34b761b8bdff414a876925a29a64c221 (127.2.223.2:37731)
I20260207 20:53:54.935508 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:54.935792 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:54.936240 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497634936219 us; error 0 us; skew 500 ppm
I20260207 20:53:54.935758 12717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 084ba69ec8f148dd9cb1a19d07491663. Latest consensus state: current_term: 1 leader_uuid: "084ba69ec8f148dd9cb1a19d07491663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } } }
I20260207 20:53:54.936645 12717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:54.936918 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:54.938158 12726 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:53:54.944432 12726 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:53:54.950174 2940 webserver.cc:492] Webserver started at http://127.2.223.3:33723/ using document root <none> and password file <none>
I20260207 20:53:54.950970 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:54.951215 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:54.951531 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:54.952971 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "dda7e043dde34025b299cd7c18027ca7"
format_stamp: "Formatted at 2026-02-07 20:53:54 on dist-test-slave-kqw4"
I20260207 20:53:54.955260 12428 raft_consensus.cc:1275] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [term 1 FOLLOWER]: Refusing update from remote peer 084ba69ec8f148dd9cb1a19d07491663: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:54.956436 12364 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 1 FOLLOWER]: Refusing update from remote peer 084ba69ec8f148dd9cb1a19d07491663: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:54.956787 12551 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:54.960289 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.005s sys 0.003s
I20260207 20:53:54.963363 12551 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:54.981932 12525 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 084ba69ec8f148dd9cb1a19d07491663. Latest consensus state: current_term: 1 leader_uuid: "084ba69ec8f148dd9cb1a19d07491663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } } }
I20260207 20:53:54.983233 12525 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:54.984681 12551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "084ba69ec8f148dd9cb1a19d07491663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } } }
I20260207 20:53:54.985433 12551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:54.985404 12532 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 084ba69ec8f148dd9cb1a19d07491663. Latest consensus state: current_term: 1 leader_uuid: "084ba69ec8f148dd9cb1a19d07491663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } } }
I20260207 20:53:54.986352 12532 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:54.990195 12732 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:54.992758 12551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "084ba69ec8f148dd9cb1a19d07491663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } } }
I20260207 20:53:54.993482 12551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:54.994042 2940 fs_manager.cc:730] Time spent opening block manager: real 0.031s user 0.013s sys 0.007s
I20260207 20:53:54.994421 12726 catalog_manager.cc:1357] Generated new cluster ID: 39729a7cca884a7ba010e9ae317cb2ef
I20260207 20:53:54.994464 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "dda7e043dde34025b299cd7c18027ca7"
format_stamp: "Formatted at 2026-02-07 20:53:54 on dist-test-slave-kqw4"
I20260207 20:53:54.995414 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestNonMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:54.995513 12726 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:53:54.995929 12532 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "084ba69ec8f148dd9cb1a19d07491663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } } }
I20260207 20:53:54.996728 12532 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:55.005030 12525 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "084ba69ec8f148dd9cb1a19d07491663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ea054ae8f4497aa4565d66abbc4f18" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35915 } } peers { permanent_uuid: "e1a4aa32bb4a4c94af3e3c1b952e7542" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41475 } } peers { permanent_uuid: "084ba69ec8f148dd9cb1a19d07491663" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35789 } } }
I20260207 20:53:55.008240 12525 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:55.042146 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:55.043792 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:55.046813 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:55.053619 12726 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:53:55.055400 12726 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:53:55.059202 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:55.059544 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:55.059836 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:55.060040 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:55.090737 12726 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663: Generated new TSK 0
I20260207 20:53:55.091482 12726 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:53:55.102285 12485 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33642
I20260207 20:53:55.109480 12485 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53678
I20260207 20:53:55.114997 12712 heartbeater.cc:499] Master 127.2.223.60:35789 was elected leader, sending a full tablet report...
I20260207 20:53:55.124303 12634 heartbeater.cc:499] Master 127.2.223.60:35789 was elected leader, sending a full tablet report...
I20260207 20:53:55.151893 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:40127
I20260207 20:53:55.152034 12801 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:40127 every 8 connection(s)
I20260207 20:53:55.176821 12802 heartbeater.cc:344] Connected to a master server at 127.2.223.60:35789
I20260207 20:53:55.177320 12802 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:55.178169 12802 heartbeater.cc:507] Master 127.2.223.60:35789 requested a full tablet report, sending...
I20260207 20:53:55.180267 12485 ts_manager.cc:194] Registered new tserver with Master: dda7e043dde34025b299cd7c18027ca7 (127.2.223.3:40127)
I20260207 20:53:55.181985 12485 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33646
I20260207 20:53:55.186304 12804 heartbeater.cc:344] Connected to a master server at 127.2.223.62:35915
I20260207 20:53:55.187903 12804 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:55.188601 12804 heartbeater.cc:507] Master 127.2.223.62:35915 requested a full tablet report, sending...
I20260207 20:53:55.190662 12353 ts_manager.cc:194] Registered new tserver with Master: dda7e043dde34025b299cd7c18027ca7 (127.2.223.3:40127)
I20260207 20:53:55.194940 12802 heartbeater.cc:499] Master 127.2.223.60:35789 was elected leader, sending a full tablet report...
I20260207 20:53:55.195333 12803 heartbeater.cc:344] Connected to a master server at 127.2.223.61:41475
I20260207 20:53:55.195753 12803 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:55.196275 12803 heartbeater.cc:507] Master 127.2.223.61:41475 requested a full tablet report, sending...
I20260207 20:53:55.200224 12418 ts_manager.cc:194] Registered new tserver with Master: dda7e043dde34025b299cd7c18027ca7 (127.2.223.3:40127)
I20260207 20:53:55.201086 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.03650346s
I20260207 20:53:55.243750 12485 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33652:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:53:55.248474 12485 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:53:55.346390 12599 tablet_service.cc:1505] Processing CreateTablet for tablet 85eda65a696e4a8db5b74e072db30a95 (DEFAULT_TABLE table=ksck-test-table [id=496d9338030c478daccc104eaf0833e7]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:55.347853 12599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85eda65a696e4a8db5b74e072db30a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:55.358016 12598 tablet_service.cc:1505] Processing CreateTablet for tablet 8a242c7ced84428cac12eb8ac0c238e1 (DEFAULT_TABLE table=ksck-test-table [id=496d9338030c478daccc104eaf0833e7]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:55.359396 12598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a242c7ced84428cac12eb8ac0c238e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:55.369292 12597 tablet_service.cc:1505] Processing CreateTablet for tablet 0325d0d4891443af9e40c465dd077d25 (DEFAULT_TABLE table=ksck-test-table [id=496d9338030c478daccc104eaf0833e7]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:55.370519 12597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0325d0d4891443af9e40c465dd077d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:55.370205 12767 tablet_service.cc:1505] Processing CreateTablet for tablet 85eda65a696e4a8db5b74e072db30a95 (DEFAULT_TABLE table=ksck-test-table [id=496d9338030c478daccc104eaf0833e7]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:55.371531 12767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85eda65a696e4a8db5b74e072db30a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:55.375077 12766 tablet_service.cc:1505] Processing CreateTablet for tablet 8a242c7ced84428cac12eb8ac0c238e1 (DEFAULT_TABLE table=ksck-test-table [id=496d9338030c478daccc104eaf0833e7]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:55.376344 12766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a242c7ced84428cac12eb8ac0c238e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:55.379431 12765 tablet_service.cc:1505] Processing CreateTablet for tablet 0325d0d4891443af9e40c465dd077d25 (DEFAULT_TABLE table=ksck-test-table [id=496d9338030c478daccc104eaf0833e7]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:55.380448 12765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0325d0d4891443af9e40c465dd077d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:55.384773 12676 tablet_service.cc:1505] Processing CreateTablet for tablet 8a242c7ced84428cac12eb8ac0c238e1 (DEFAULT_TABLE table=ksck-test-table [id=496d9338030c478daccc104eaf0833e7]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:55.385756 12677 tablet_service.cc:1505] Processing CreateTablet for tablet 85eda65a696e4a8db5b74e072db30a95 (DEFAULT_TABLE table=ksck-test-table [id=496d9338030c478daccc104eaf0833e7]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:55.387681 12675 tablet_service.cc:1505] Processing CreateTablet for tablet 0325d0d4891443af9e40c465dd077d25 (DEFAULT_TABLE table=ksck-test-table [id=496d9338030c478daccc104eaf0833e7]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:55.387735 12822 tablet_bootstrap.cc:492] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249: Bootstrap starting.
I20260207 20:53:55.386099 12676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a242c7ced84428cac12eb8ac0c238e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:55.395027 12675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0325d0d4891443af9e40c465dd077d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:55.397197 12822 tablet_bootstrap.cc:654] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:55.399202 12677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85eda65a696e4a8db5b74e072db30a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:55.416208 12822 tablet_bootstrap.cc:492] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249: No bootstrap required, opened a new log
I20260207 20:53:55.416857 12822 ts_tablet_manager.cc:1403] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249: Time spent bootstrapping tablet: real 0.029s user 0.013s sys 0.010s
I20260207 20:53:55.419688 12822 raft_consensus.cc:359] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.420614 12822 raft_consensus.cc:385] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:55.420974 12822 raft_consensus.cc:740] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b47f5f48d14655af608b34379d9249, State: Initialized, Role: FOLLOWER
I20260207 20:53:55.424245 12822 consensus_queue.cc:260] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.430042 12822 ts_tablet_manager.cc:1434] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249: Time spent starting tablet: real 0.013s user 0.007s sys 0.001s
I20260207 20:53:55.435786 12824 raft_consensus.cc:493] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:55.436317 12824 raft_consensus.cc:515] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.441670 12822 tablet_bootstrap.cc:492] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249: Bootstrap starting.
I20260207 20:53:55.450374 12824 leader_election.cc:290] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34b761b8bdff414a876925a29a64c221 (127.2.223.2:37731), dda7e043dde34025b299cd7c18027ca7 (127.2.223.3:40127)
I20260207 20:53:55.456449 12822 tablet_bootstrap.cc:654] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:55.503814 12828 tablet_bootstrap.cc:492] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7: Bootstrap starting.
I20260207 20:53:55.507717 12822 tablet_bootstrap.cc:492] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249: No bootstrap required, opened a new log
I20260207 20:53:55.519186 12822 ts_tablet_manager.cc:1403] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249: Time spent bootstrapping tablet: real 0.078s user 0.008s sys 0.013s
I20260207 20:53:55.514379 12687 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0325d0d4891443af9e40c465dd077d25" candidate_uuid: "e8b47f5f48d14655af608b34379d9249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b761b8bdff414a876925a29a64c221" is_pre_election: true
W20260207 20:53:55.522225 12575 leader_election.cc:343] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34b761b8bdff414a876925a29a64c221 (127.2.223.2:37731): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:53:55.523496 12828 tablet_bootstrap.cc:654] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:55.527743 12822 raft_consensus.cc:359] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } }
I20260207 20:53:55.528543 12822 raft_consensus.cc:385] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:55.528846 12822 raft_consensus.cc:740] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b47f5f48d14655af608b34379d9249, State: Initialized, Role: FOLLOWER
I20260207 20:53:55.529531 12822 consensus_queue.cc:260] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } }
I20260207 20:53:55.531801 12822 ts_tablet_manager.cc:1434] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260207 20:53:55.532872 12822 tablet_bootstrap.cc:492] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249: Bootstrap starting.
I20260207 20:53:55.545823 12829 tablet_bootstrap.cc:492] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221: Bootstrap starting.
I20260207 20:53:55.548784 12777 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0325d0d4891443af9e40c465dd077d25" candidate_uuid: "e8b47f5f48d14655af608b34379d9249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dda7e043dde34025b299cd7c18027ca7" is_pre_election: true
I20260207 20:53:55.550313 12825 raft_consensus.cc:493] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260207 20:53:55.550432 12572 leader_election.cc:343] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dda7e043dde34025b299cd7c18027ca7 (127.2.223.3:40127): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:53:55.551015 12825 raft_consensus.cc:515] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } }
I20260207 20:53:55.554322 12687 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85eda65a696e4a8db5b74e072db30a95" candidate_uuid: "e8b47f5f48d14655af608b34379d9249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b761b8bdff414a876925a29a64c221" is_pre_election: true
I20260207 20:53:55.554797 12822 tablet_bootstrap.cc:654] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249: Neither blocks nor log segments found. Creating new log.
W20260207 20:53:55.555739 12575 leader_election.cc:343] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34b761b8bdff414a876925a29a64c221 (127.2.223.2:37731): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:53:55.556881 12825 leader_election.cc:290] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dda7e043dde34025b299cd7c18027ca7 (127.2.223.3:40127), 34b761b8bdff414a876925a29a64c221 (127.2.223.2:37731)
I20260207 20:53:55.559442 12829 tablet_bootstrap.cc:654] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:55.551255 12572 leader_election.cc:304] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b47f5f48d14655af608b34379d9249; no voters: 34b761b8bdff414a876925a29a64c221, dda7e043dde34025b299cd7c18027ca7
I20260207 20:53:55.561131 12825 raft_consensus.cc:2749] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:53:55.562965 12777 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85eda65a696e4a8db5b74e072db30a95" candidate_uuid: "e8b47f5f48d14655af608b34379d9249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dda7e043dde34025b299cd7c18027ca7" is_pre_election: true
W20260207 20:53:55.564850 12572 leader_election.cc:343] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dda7e043dde34025b299cd7c18027ca7 (127.2.223.3:40127): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:53:55.565397 12822 tablet_bootstrap.cc:492] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249: No bootstrap required, opened a new log
I20260207 20:53:55.565230 12572 leader_election.cc:304] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b47f5f48d14655af608b34379d9249; no voters: 34b761b8bdff414a876925a29a64c221, dda7e043dde34025b299cd7c18027ca7
I20260207 20:53:55.565559 12828 tablet_bootstrap.cc:492] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7: No bootstrap required, opened a new log
I20260207 20:53:55.566020 12822 ts_tablet_manager.cc:1403] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249: Time spent bootstrapping tablet: real 0.033s user 0.007s sys 0.004s
I20260207 20:53:55.566052 12825 raft_consensus.cc:2749] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:53:55.566102 12828 ts_tablet_manager.cc:1403] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7: Time spent bootstrapping tablet: real 0.063s user 0.005s sys 0.011s
I20260207 20:53:55.567485 12829 tablet_bootstrap.cc:492] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221: No bootstrap required, opened a new log
I20260207 20:53:55.571051 12829 ts_tablet_manager.cc:1403] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.005s
I20260207 20:53:55.573854 12822 raft_consensus.cc:359] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.577677 12822 raft_consensus.cc:385] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:55.577987 12822 raft_consensus.cc:740] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b47f5f48d14655af608b34379d9249, State: Initialized, Role: FOLLOWER
I20260207 20:53:55.573779 12829 raft_consensus.cc:359] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.579257 12829 raft_consensus.cc:385] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:55.579530 12829 raft_consensus.cc:740] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34b761b8bdff414a876925a29a64c221, State: Initialized, Role: FOLLOWER
I20260207 20:53:55.580529 12829 consensus_queue.cc:260] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.581851 12822 consensus_queue.cc:260] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.584393 12822 ts_tablet_manager.cc:1434] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249: Time spent starting tablet: real 0.016s user 0.003s sys 0.004s
I20260207 20:53:55.586536 12829 ts_tablet_manager.cc:1434] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221: Time spent starting tablet: real 0.015s user 0.005s sys 0.003s
I20260207 20:53:55.572544 12828 raft_consensus.cc:359] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.590813 12828 raft_consensus.cc:385] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:55.591130 12828 raft_consensus.cc:740] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dda7e043dde34025b299cd7c18027ca7, State: Initialized, Role: FOLLOWER
I20260207 20:53:55.595011 12828 consensus_queue.cc:260] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.598248 12828 ts_tablet_manager.cc:1434] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7: Time spent starting tablet: real 0.029s user 0.007s sys 0.000s
I20260207 20:53:55.601802 12829 tablet_bootstrap.cc:492] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221: Bootstrap starting.
I20260207 20:53:55.609081 12829 tablet_bootstrap.cc:654] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:55.610895 12828 tablet_bootstrap.cc:492] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7: Bootstrap starting.
I20260207 20:53:55.620913 12829 tablet_bootstrap.cc:492] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221: No bootstrap required, opened a new log
I20260207 20:53:55.621447 12829 ts_tablet_manager.cc:1403] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.008s
I20260207 20:53:55.624217 12829 raft_consensus.cc:359] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } }
I20260207 20:53:55.624874 12829 raft_consensus.cc:385] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:55.625162 12829 raft_consensus.cc:740] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34b761b8bdff414a876925a29a64c221, State: Initialized, Role: FOLLOWER
I20260207 20:53:55.625970 12829 consensus_queue.cc:260] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } }
I20260207 20:53:55.627540 12828 tablet_bootstrap.cc:654] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:55.628206 12829 ts_tablet_manager.cc:1434] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260207 20:53:55.635599 12829 tablet_bootstrap.cc:492] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221: Bootstrap starting.
I20260207 20:53:55.640070 12539 catalog_manager.cc:1269] Loaded cluster ID: 39729a7cca884a7ba010e9ae317cb2ef
I20260207 20:53:55.640420 12539 catalog_manager.cc:1562] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18: loading cluster ID for follower catalog manager: success
I20260207 20:53:55.642184 12829 tablet_bootstrap.cc:654] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:55.644651 12828 tablet_bootstrap.cc:492] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7: No bootstrap required, opened a new log
I20260207 20:53:55.645149 12828 ts_tablet_manager.cc:1403] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7: Time spent bootstrapping tablet: real 0.034s user 0.009s sys 0.008s
I20260207 20:53:55.649775 12828 raft_consensus.cc:359] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.650445 12828 raft_consensus.cc:385] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:55.650841 12828 raft_consensus.cc:740] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dda7e043dde34025b299cd7c18027ca7, State: Initialized, Role: FOLLOWER
I20260207 20:53:55.656467 12828 consensus_queue.cc:260] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.658936 12828 ts_tablet_manager.cc:1434] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7: Time spent starting tablet: real 0.013s user 0.007s sys 0.001s
I20260207 20:53:55.652621 12550 catalog_manager.cc:1269] Loaded cluster ID: 39729a7cca884a7ba010e9ae317cb2ef
I20260207 20:53:55.659966 12550 catalog_manager.cc:1562] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542: loading cluster ID for follower catalog manager: success
I20260207 20:53:55.669883 12829 tablet_bootstrap.cc:492] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221: No bootstrap required, opened a new log
I20260207 20:53:55.659948 12828 tablet_bootstrap.cc:492] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7: Bootstrap starting.
I20260207 20:53:55.670457 12829 ts_tablet_manager.cc:1403] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221: Time spent bootstrapping tablet: real 0.035s user 0.014s sys 0.006s
I20260207 20:53:55.673406 12829 raft_consensus.cc:359] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.674100 12829 raft_consensus.cc:385] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:55.674381 12829 raft_consensus.cc:740] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34b761b8bdff414a876925a29a64c221, State: Initialized, Role: FOLLOWER
I20260207 20:53:55.675295 12829 consensus_queue.cc:260] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.680298 12829 ts_tablet_manager.cc:1434] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221: Time spent starting tablet: real 0.009s user 0.004s sys 0.002s
I20260207 20:53:55.674340 12539 catalog_manager.cc:1584] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18: acquiring CA information for follower catalog manager: success
I20260207 20:53:55.682520 12550 catalog_manager.cc:1584] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542: acquiring CA information for follower catalog manager: success
I20260207 20:53:55.686419 12539 catalog_manager.cc:1612] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:55.695887 12828 tablet_bootstrap.cc:654] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:55.698971 12550 catalog_manager.cc:1612] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:55.706017 12828 tablet_bootstrap.cc:492] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7: No bootstrap required, opened a new log
I20260207 20:53:55.706548 12828 ts_tablet_manager.cc:1403] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7: Time spent bootstrapping tablet: real 0.047s user 0.010s sys 0.001s
I20260207 20:53:55.708990 12828 raft_consensus.cc:359] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } }
I20260207 20:53:55.709606 12828 raft_consensus.cc:385] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:55.709889 12828 raft_consensus.cc:740] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dda7e043dde34025b299cd7c18027ca7, State: Initialized, Role: FOLLOWER
I20260207 20:53:55.710686 12828 consensus_queue.cc:260] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } }
I20260207 20:53:55.712884 12828 ts_tablet_manager.cc:1434] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7: Time spent starting tablet: real 0.006s user 0.001s sys 0.003s
I20260207 20:53:55.751842 12835 raft_consensus.cc:493] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:55.752367 12835 raft_consensus.cc:515] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.754700 12835 leader_election.cc:290] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b47f5f48d14655af608b34379d9249 (127.2.223.1:41349), 34b761b8bdff414a876925a29a64c221 (127.2.223.2:37731)
I20260207 20:53:55.761860 12825 raft_consensus.cc:493] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:55.762460 12825 raft_consensus.cc:515] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.764600 12825 leader_election.cc:290] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34b761b8bdff414a876925a29a64c221 (127.2.223.2:37731), dda7e043dde34025b299cd7c18027ca7 (127.2.223.3:40127)
I20260207 20:53:55.765733 12777 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a242c7ced84428cac12eb8ac0c238e1" candidate_uuid: "e8b47f5f48d14655af608b34379d9249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dda7e043dde34025b299cd7c18027ca7" is_pre_election: true
I20260207 20:53:55.766496 12777 raft_consensus.cc:2468] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b47f5f48d14655af608b34379d9249 in term 0.
I20260207 20:53:55.767554 12572 leader_election.cc:304] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dda7e043dde34025b299cd7c18027ca7, e8b47f5f48d14655af608b34379d9249; no voters:
I20260207 20:53:55.768401 12825 raft_consensus.cc:2804] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:55.768750 12825 raft_consensus.cc:493] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:55.769075 12825 raft_consensus.cc:3060] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:55.770557 12687 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a242c7ced84428cac12eb8ac0c238e1" candidate_uuid: "e8b47f5f48d14655af608b34379d9249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b761b8bdff414a876925a29a64c221" is_pre_election: true
I20260207 20:53:55.771205 12687 raft_consensus.cc:2468] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b47f5f48d14655af608b34379d9249 in term 0.
I20260207 20:53:55.775863 12825 raft_consensus.cc:515] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.777786 12825 leader_election.cc:290] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [CANDIDATE]: Term 1 election: Requested vote from peers 34b761b8bdff414a876925a29a64c221 (127.2.223.2:37731), dda7e043dde34025b299cd7c18027ca7 (127.2.223.3:40127)
I20260207 20:53:55.778406 12687 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a242c7ced84428cac12eb8ac0c238e1" candidate_uuid: "e8b47f5f48d14655af608b34379d9249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b761b8bdff414a876925a29a64c221"
I20260207 20:53:55.779568 12687 raft_consensus.cc:3060] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:55.779878 12777 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a242c7ced84428cac12eb8ac0c238e1" candidate_uuid: "e8b47f5f48d14655af608b34379d9249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dda7e043dde34025b299cd7c18027ca7"
I20260207 20:53:55.780411 12777 raft_consensus.cc:3060] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:55.787822 12835 raft_consensus.cc:493] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:55.788333 12835 raft_consensus.cc:515] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.790175 12835 leader_election.cc:290] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b47f5f48d14655af608b34379d9249 (127.2.223.1:41349), 34b761b8bdff414a876925a29a64c221 (127.2.223.2:37731)
I20260207 20:53:55.793191 12777 raft_consensus.cc:2468] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b47f5f48d14655af608b34379d9249 in term 1.
I20260207 20:53:55.794353 12572 leader_election.cc:304] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dda7e043dde34025b299cd7c18027ca7, e8b47f5f48d14655af608b34379d9249; no voters:
I20260207 20:53:55.795154 12825 raft_consensus.cc:2804] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:55.797106 12825 raft_consensus.cc:697] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [term 1 LEADER]: Becoming Leader. State: Replica: e8b47f5f48d14655af608b34379d9249, State: Running, Role: LEADER
I20260207 20:53:55.797979 12825 consensus_queue.cc:237] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.794731 12687 raft_consensus.cc:2468] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b47f5f48d14655af608b34379d9249 in term 1.
I20260207 20:53:55.822506 12609 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a242c7ced84428cac12eb8ac0c238e1" candidate_uuid: "dda7e043dde34025b299cd7c18027ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b47f5f48d14655af608b34379d9249" is_pre_election: true
I20260207 20:53:55.828467 12687 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a242c7ced84428cac12eb8ac0c238e1" candidate_uuid: "dda7e043dde34025b299cd7c18027ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b761b8bdff414a876925a29a64c221" is_pre_election: true
I20260207 20:53:55.828840 12686 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0325d0d4891443af9e40c465dd077d25" candidate_uuid: "dda7e043dde34025b299cd7c18027ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b761b8bdff414a876925a29a64c221" is_pre_election: true
I20260207 20:53:55.829555 12686 raft_consensus.cc:2468] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dda7e043dde34025b299cd7c18027ca7 in term 0.
I20260207 20:53:55.830950 12742 leader_election.cc:304] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b761b8bdff414a876925a29a64c221, dda7e043dde34025b299cd7c18027ca7; no voters:
I20260207 20:53:55.829250 12687 raft_consensus.cc:2393] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dda7e043dde34025b299cd7c18027ca7 in current term 1: Already voted for candidate e8b47f5f48d14655af608b34379d9249 in this term.
I20260207 20:53:55.833665 12609 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0325d0d4891443af9e40c465dd077d25" candidate_uuid: "dda7e043dde34025b299cd7c18027ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b47f5f48d14655af608b34379d9249" is_pre_election: true
I20260207 20:53:55.834306 12609 raft_consensus.cc:2468] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dda7e043dde34025b299cd7c18027ca7 in term 0.
I20260207 20:53:55.835088 12742 leader_election.cc:304] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dda7e043dde34025b299cd7c18027ca7; no voters: 34b761b8bdff414a876925a29a64c221, e8b47f5f48d14655af608b34379d9249
I20260207 20:53:55.832983 12835 raft_consensus.cc:2804] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:55.836470 12835 raft_consensus.cc:493] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:55.835786 12484 catalog_manager.cc:5654] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b47f5f48d14655af608b34379d9249 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "e8b47f5f48d14655af608b34379d9249" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } health_report { overall_health: UNKNOWN } } }
I20260207 20:53:55.836836 12835 raft_consensus.cc:3060] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:55.844599 12834 raft_consensus.cc:493] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:55.845110 12834 raft_consensus.cc:515] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } }
I20260207 20:53:55.848845 12834 leader_election.cc:290] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b47f5f48d14655af608b34379d9249 (127.2.223.1:41349), dda7e043dde34025b299cd7c18027ca7 (127.2.223.3:40127)
I20260207 20:53:55.853464 12843 raft_consensus.cc:2749] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:53:55.862182 12835 raft_consensus.cc:515] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.868674 12835 leader_election.cc:290] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [CANDIDATE]: Term 1 election: Requested vote from peers e8b47f5f48d14655af608b34379d9249 (127.2.223.1:41349), 34b761b8bdff414a876925a29a64c221 (127.2.223.2:37731)
I20260207 20:53:55.870112 12609 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0325d0d4891443af9e40c465dd077d25" candidate_uuid: "dda7e043dde34025b299cd7c18027ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b47f5f48d14655af608b34379d9249"
I20260207 20:53:55.873939 12609 raft_consensus.cc:3060] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:55.874250 12687 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0325d0d4891443af9e40c465dd077d25" candidate_uuid: "dda7e043dde34025b299cd7c18027ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b761b8bdff414a876925a29a64c221"
I20260207 20:53:55.874956 12687 raft_consensus.cc:3060] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:55.874791 12608 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85eda65a696e4a8db5b74e072db30a95" candidate_uuid: "34b761b8bdff414a876925a29a64c221" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b47f5f48d14655af608b34379d9249" is_pre_election: true
I20260207 20:53:55.875787 12608 raft_consensus.cc:2468] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34b761b8bdff414a876925a29a64c221 in term 0.
I20260207 20:53:55.882917 12687 raft_consensus.cc:2468] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dda7e043dde34025b299cd7c18027ca7 in term 1.
I20260207 20:53:55.886904 12742 leader_election.cc:304] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b761b8bdff414a876925a29a64c221, dda7e043dde34025b299cd7c18027ca7; no voters:
I20260207 20:53:55.887734 12843 raft_consensus.cc:2804] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:55.888399 12652 leader_election.cc:304] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b761b8bdff414a876925a29a64c221, e8b47f5f48d14655af608b34379d9249; no voters:
I20260207 20:53:55.893603 12834 raft_consensus.cc:2804] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:55.896184 12834 raft_consensus.cc:493] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:55.896522 12834 raft_consensus.cc:3060] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:55.898892 12835 raft_consensus.cc:493] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:55.908499 12843 raft_consensus.cc:697] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [term 1 LEADER]: Becoming Leader. State: Replica: dda7e043dde34025b299cd7c18027ca7, State: Running, Role: LEADER
I20260207 20:53:55.910351 12843 consensus_queue.cc:237] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } }
I20260207 20:53:55.909226 12835 raft_consensus.cc:515] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } }
I20260207 20:53:55.924365 12777 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85eda65a696e4a8db5b74e072db30a95" candidate_uuid: "34b761b8bdff414a876925a29a64c221" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dda7e043dde34025b299cd7c18027ca7" is_pre_election: true
I20260207 20:53:55.925019 12777 raft_consensus.cc:2468] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34b761b8bdff414a876925a29a64c221 in term 0.
I20260207 20:53:55.916129 12609 raft_consensus.cc:2468] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dda7e043dde34025b299cd7c18027ca7 in term 1.
I20260207 20:53:55.917681 12834 raft_consensus.cc:515] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } }
I20260207 20:53:55.925508 12608 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85eda65a696e4a8db5b74e072db30a95" candidate_uuid: "dda7e043dde34025b299cd7c18027ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b47f5f48d14655af608b34379d9249" is_pre_election: true
I20260207 20:53:55.926452 12608 raft_consensus.cc:2468] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dda7e043dde34025b299cd7c18027ca7 in term 0.
I20260207 20:53:55.927238 12834 leader_election.cc:290] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [CANDIDATE]: Term 1 election: Requested vote from peers e8b47f5f48d14655af608b34379d9249 (127.2.223.1:41349), dda7e043dde34025b299cd7c18027ca7 (127.2.223.3:40127)
I20260207 20:53:55.927772 12741 leader_election.cc:304] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dda7e043dde34025b299cd7c18027ca7, e8b47f5f48d14655af608b34379d9249; no voters:
I20260207 20:53:55.928299 12777 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85eda65a696e4a8db5b74e072db30a95" candidate_uuid: "34b761b8bdff414a876925a29a64c221" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dda7e043dde34025b299cd7c18027ca7"
I20260207 20:53:55.928887 12777 raft_consensus.cc:3060] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:55.929006 12608 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85eda65a696e4a8db5b74e072db30a95" candidate_uuid: "34b761b8bdff414a876925a29a64c221" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b47f5f48d14655af608b34379d9249"
I20260207 20:53:55.930364 12608 raft_consensus.cc:3060] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:55.937155 12777 raft_consensus.cc:2468] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b761b8bdff414a876925a29a64c221 in term 1.
I20260207 20:53:55.939101 12650 leader_election.cc:304] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b761b8bdff414a876925a29a64c221, dda7e043dde34025b299cd7c18027ca7; no voters:
I20260207 20:53:55.940528 12834 raft_consensus.cc:2804] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:55.947018 12851 raft_consensus.cc:2764] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260207 20:53:55.949546 12608 raft_consensus.cc:2468] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b761b8bdff414a876925a29a64c221 in term 1.
I20260207 20:53:55.952857 12687 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85eda65a696e4a8db5b74e072db30a95" candidate_uuid: "dda7e043dde34025b299cd7c18027ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b761b8bdff414a876925a29a64c221" is_pre_election: true
I20260207 20:53:55.959406 12834 raft_consensus.cc:697] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [term 1 LEADER]: Becoming Leader. State: Replica: 34b761b8bdff414a876925a29a64c221, State: Running, Role: LEADER
I20260207 20:53:55.960430 12834 consensus_queue.cc:237] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } }
I20260207 20:53:55.965863 12835 leader_election.cc:290] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b47f5f48d14655af608b34379d9249 (127.2.223.1:41349), 34b761b8bdff414a876925a29a64c221 (127.2.223.2:37731)
I20260207 20:53:55.972821 12485 catalog_manager.cc:5654] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 reported cstate change: term changed from 0 to 1, leader changed from <none> to dda7e043dde34025b299cd7c18027ca7 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "dda7e043dde34025b299cd7c18027ca7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:55.975539 12484 catalog_manager.cc:5654] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34b761b8bdff414a876925a29a64c221 (127.2.223.2). New cstate: current_term: 1 leader_uuid: "34b761b8bdff414a876925a29a64c221" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:56.235769 12825 consensus_queue.cc:1048] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:56.305403 12843 consensus_queue.cc:1048] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:56.313696 12824 consensus_queue.cc:1048] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b761b8bdff414a876925a29a64c221" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:56.355556 12843 consensus_queue.cc:1048] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:56.432643 12834 consensus_queue.cc:1048] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b47f5f48d14655af608b34379d9249" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:56.466071 12834 consensus_queue.cc:1048] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dda7e043dde34025b299cd7c18027ca7" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 40127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:56.835242 12767 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:53:56.839165 12598 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:53:56.845916 12676 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:53:57.237968 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:53:57.291041 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:57.291671 2940 tablet_replica.cc:333] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249: stopping tablet replica
I20260207 20:53:57.292243 2940 raft_consensus.cc:2243] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:57.292982 2940 raft_consensus.cc:2272] T 8a242c7ced84428cac12eb8ac0c238e1 P e8b47f5f48d14655af608b34379d9249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:57.295643 2940 tablet_replica.cc:333] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249: stopping tablet replica
I20260207 20:53:57.296435 2940 raft_consensus.cc:2243] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:57.296933 2940 raft_consensus.cc:2272] T 85eda65a696e4a8db5b74e072db30a95 P e8b47f5f48d14655af608b34379d9249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:57.301637 2940 tablet_replica.cc:333] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249: stopping tablet replica
I20260207 20:53:57.302340 2940 raft_consensus.cc:2243] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:57.302891 2940 raft_consensus.cc:2272] T 0325d0d4891443af9e40c465dd077d25 P e8b47f5f48d14655af608b34379d9249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:57.326081 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:53:57.339092 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:53:57.372262 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:57.372862 2940 tablet_replica.cc:333] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221: stopping tablet replica
I20260207 20:53:57.373558 2940 raft_consensus.cc:2243] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:57.373991 2940 raft_consensus.cc:2272] T 0325d0d4891443af9e40c465dd077d25 P 34b761b8bdff414a876925a29a64c221 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:57.376405 2940 tablet_replica.cc:333] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221: stopping tablet replica
I20260207 20:53:57.377158 2940 raft_consensus.cc:2243] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:57.378153 2940 raft_consensus.cc:2272] T 85eda65a696e4a8db5b74e072db30a95 P 34b761b8bdff414a876925a29a64c221 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:57.380686 2940 tablet_replica.cc:333] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221: stopping tablet replica
I20260207 20:53:57.381331 2940 raft_consensus.cc:2243] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:57.381726 2940 raft_consensus.cc:2272] T 8a242c7ced84428cac12eb8ac0c238e1 P 34b761b8bdff414a876925a29a64c221 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:57.395185 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
W20260207 20:53:57.405519 12741 consensus_peers.cc:597] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 -> Peer e8b47f5f48d14655af608b34379d9249 (127.2.223.1:41349): Couldn't send request to peer e8b47f5f48d14655af608b34379d9249. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:41349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:53:57.408881 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:53:57.431108 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:53:57.431648 2940 tablet_replica.cc:333] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7: stopping tablet replica
I20260207 20:53:57.432176 2940 raft_consensus.cc:2243] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:57.432585 2940 raft_consensus.cc:2272] T 85eda65a696e4a8db5b74e072db30a95 P dda7e043dde34025b299cd7c18027ca7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:57.434716 2940 tablet_replica.cc:333] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7: stopping tablet replica
I20260207 20:53:57.435187 2940 raft_consensus.cc:2243] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:57.435914 2940 raft_consensus.cc:2272] T 0325d0d4891443af9e40c465dd077d25 P dda7e043dde34025b299cd7c18027ca7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:57.437659 2940 tablet_replica.cc:333] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7: stopping tablet replica
I20260207 20:53:57.438120 2940 raft_consensus.cc:2243] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:57.438477 2940 raft_consensus.cc:2272] T 8a242c7ced84428cac12eb8ac0c238e1 P dda7e043dde34025b299cd7c18027ca7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:57.458335 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:53:57.471982 2940 master.cc:561] Master@127.2.223.62:35915 shutting down...
I20260207 20:53:57.488430 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:57.488935 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:57.489228 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P c8ea054ae8f4497aa4565d66abbc4f18: stopping tablet replica
I20260207 20:53:57.508482 2940 master.cc:583] Master@127.2.223.62:35915 shutdown complete.
I20260207 20:53:57.522115 2940 master.cc:561] Master@127.2.223.61:41475 shutting down...
I20260207 20:53:57.537931 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:53:57.538434 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:57.538756 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P e1a4aa32bb4a4c94af3e3c1b952e7542: stopping tablet replica
I20260207 20:53:57.557179 2940 master.cc:583] Master@127.2.223.61:41475 shutdown complete.
I20260207 20:53:57.571377 2940 master.cc:561] Master@127.2.223.60:35789 shutting down...
I20260207 20:53:57.586241 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:53:57.587117 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:53:57.587431 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 084ba69ec8f148dd9cb1a19d07491663: stopping tablet replica
I20260207 20:53:57.606060 2940 master.cc:583] Master@127.2.223.60:35789 shutdown complete.
[ OK ] RemoteKsckTest.TestNonMatchingTabletIdFilter (3342 ms)
[ RUN ] RemoteKsckTest.TestMatchingTabletIdFilter
I20260207 20:53:57.637491 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:44691,127.2.223.61:38129,127.2.223.60:35755
I20260207 20:53:57.638943 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:57.643891 12914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:57.644001 12915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:57.645074 12917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:57.646256 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:57.647078 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:57.647244 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:57.647354 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497637647344 us; error 0 us; skew 500 ppm
I20260207 20:53:57.647801 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:57.649813 2940 webserver.cc:492] Webserver started at http://127.2.223.62:35371/ using document root <none> and password file <none>
I20260207 20:53:57.650242 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:57.650388 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:57.650619 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:57.651584 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "87b8708c0aaa44dbafb43b2af0c4eac0"
format_stamp: "Formatted at 2026-02-07 20:53:57 on dist-test-slave-kqw4"
I20260207 20:53:57.655567 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260207 20:53:57.658557 12922 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:57.659253 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:53:57.659482 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "87b8708c0aaa44dbafb43b2af0c4eac0"
format_stamp: "Formatted at 2026-02-07 20:53:57 on dist-test-slave-kqw4"
I20260207 20:53:57.659708 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:57.683507 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:57.684424 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:57.716694 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:44691
I20260207 20:53:57.716804 12973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:44691 every 8 connection(s)
I20260207 20:53:57.720307 12974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:57.720343 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:57.725447 12976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:57.726097 12977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:57.728615 12979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:57.729374 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:57.729743 12974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:57.730419 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:57.730715 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:57.730911 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497637730893 us; error 0 us; skew 500 ppm
I20260207 20:53:57.731653 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:57.735366 2940 webserver.cc:492] Webserver started at http://127.2.223.61:37391/ using document root <none> and password file <none>
I20260207 20:53:57.735901 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:57.736124 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:57.736380 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:57.737402 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "6b00ee24cdeb41ad821e6387f57c1f54"
format_stamp: "Formatted at 2026-02-07 20:53:57 on dist-test-slave-kqw4"
I20260207 20:53:57.741257 12974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:57.743158 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
W20260207 20:53:57.746340 12974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:38129: Network error: Client connection negotiation failed: client connection to 127.2.223.61:38129: connect: Connection refused (error 111)
I20260207 20:53:57.747014 12987 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:57.747715 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260207 20:53:57.747996 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "6b00ee24cdeb41ad821e6387f57c1f54"
format_stamp: "Formatted at 2026-02-07 20:53:57 on dist-test-slave-kqw4"
I20260207 20:53:57.748262 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:57.761417 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:57.762369 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:57.795570 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:38129
I20260207 20:53:57.795694 13038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:38129 every 8 connection(s)
I20260207 20:53:57.799800 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:57.799914 13039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260207 20:53:57.804860 13041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:57.807333 13042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:57.808039 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:57.808159 13044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:57.808452 13039 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:57.809214 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:57.809480 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:57.809665 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497637809647 us; error 0 us; skew 500 ppm
I20260207 20:53:57.810410 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:57.811028 12974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } attempt: 1
I20260207 20:53:57.814538 2940 webserver.cc:492] Webserver started at http://127.2.223.60:35105/ using document root <none> and password file <none>
I20260207 20:53:57.815079 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:57.815259 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:57.815495 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:57.816517 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "aa16cee1437c4df69a8536d75afe2825"
format_stamp: "Formatted at 2026-02-07 20:53:57 on dist-test-slave-kqw4"
I20260207 20:53:57.821744 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260207 20:53:57.827586 13039 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:57.828027 13051 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:57.828217 12974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:57.829159 2940 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260207 20:53:57.829438 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "aa16cee1437c4df69a8536d75afe2825"
format_stamp: "Formatted at 2026-02-07 20:53:57 on dist-test-slave-kqw4"
I20260207 20:53:57.829689 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:53:57.833984 12974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:35755: Network error: Client connection negotiation failed: client connection to 127.2.223.60:35755: connect: Connection refused (error 111)
I20260207 20:53:57.839429 13039 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:53:57.844132 13039 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:35755: Network error: Client connection negotiation failed: client connection to 127.2.223.60:35755: connect: Connection refused (error 111)
I20260207 20:53:57.848167 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:57.849191 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:57.877523 12974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } attempt: 1
W20260207 20:53:57.882467 12974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:35755: Network error: Client connection negotiation failed: client connection to 127.2.223.60:35755: connect: Connection refused (error 111)
I20260207 20:53:57.884874 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:35755
I20260207 20:53:57.884972 13103 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:35755 every 8 connection(s)
I20260207 20:53:57.887780 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:53:57.888695 13104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:57.894953 13104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:57.904891 13104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:57.905580 13039 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } attempt: 1
I20260207 20:53:57.915302 13104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:53:57.918031 12974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } attempt: 2
I20260207 20:53:57.923794 13039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54: Bootstrap starting.
I20260207 20:53:57.928874 13039 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:57.933094 13104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825: Bootstrap starting.
I20260207 20:53:57.933320 13039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54: No bootstrap required, opened a new log
I20260207 20:53:57.935606 13039 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } }
I20260207 20:53:57.936138 13039 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:57.936371 13039 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b00ee24cdeb41ad821e6387f57c1f54, State: Initialized, Role: FOLLOWER
I20260207 20:53:57.937155 12974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0: Bootstrap starting.
I20260207 20:53:57.936990 13039 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } }
I20260207 20:53:57.939157 13104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:57.939134 13110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } } }
I20260207 20:53:57.940176 13110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:57.940953 13039 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:57.943311 12974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:57.944603 13104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825: No bootstrap required, opened a new log
I20260207 20:53:57.947757 13104 raft_consensus.cc:359] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } }
I20260207 20:53:57.948576 13104 raft_consensus.cc:385] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:57.948884 13104 raft_consensus.cc:740] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa16cee1437c4df69a8536d75afe2825, State: Initialized, Role: FOLLOWER
I20260207 20:53:57.949772 13104 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } }
I20260207 20:53:57.954906 12974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0: No bootstrap required, opened a new log
W20260207 20:53:57.957227 13124 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:57.957516 13124 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:57.957896 12974 raft_consensus.cc:359] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } }
I20260207 20:53:57.958194 13121 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } } }
I20260207 20:53:57.958638 12974 raft_consensus.cc:385] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:57.958820 13121 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:57.958982 12974 raft_consensus.cc:740] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b8708c0aaa44dbafb43b2af0c4eac0, State: Initialized, Role: FOLLOWER
I20260207 20:53:57.960041 13104 sys_catalog.cc:565] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:53:57.959761 12974 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } }
I20260207 20:53:57.961606 13125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } } }
I20260207 20:53:57.962122 13125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:57.963433 12974 sys_catalog.cc:565] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [sys.catalog]: configured and running, proceeding with master startup.
W20260207 20:53:57.975744 13141 catalog_manager.cc:1568] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:57.976059 13141 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:53:57.976945 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:53:57.977205 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:53:57.978446 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:53:57.979679 13147 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:53:57.979955 13147 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:53:57.984237 13148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:57.984637 13149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:57.992452 13151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:57.992501 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:57.993538 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:57.993743 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:57.993899 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497637993882 us; error 0 us; skew 500 ppm
I20260207 20:53:57.994385 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:57.996596 2940 webserver.cc:492] Webserver started at http://127.2.223.1:40131/ using document root <none> and password file <none>
I20260207 20:53:57.997033 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:57.997222 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:57.997458 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:57.998432 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "5df9f697578e46aa98102537705922d3"
format_stamp: "Formatted at 2026-02-07 20:53:57 on dist-test-slave-kqw4"
I20260207 20:53:58.002481 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260207 20:53:58.005525 13156 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:58.006275 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:53:58.006546 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "5df9f697578e46aa98102537705922d3"
format_stamp: "Formatted at 2026-02-07 20:53:57 on dist-test-slave-kqw4"
I20260207 20:53:58.006855 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:58.015926 13121 raft_consensus.cc:493] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:58.016472 13121 raft_consensus.cc:515] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } }
I20260207 20:53:58.018402 13121 leader_election.cc:290] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b8708c0aaa44dbafb43b2af0c4eac0 (127.2.223.62:44691), 6b00ee24cdeb41ad821e6387f57c1f54 (127.2.223.61:38129)
I20260207 20:53:58.019377 13014 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aa16cee1437c4df69a8536d75afe2825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" is_pre_election: true
I20260207 20:53:58.019331 12949 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aa16cee1437c4df69a8536d75afe2825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" is_pre_election: true
I20260207 20:53:58.020236 13014 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa16cee1437c4df69a8536d75afe2825 in term 0.
I20260207 20:53:58.020325 12949 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa16cee1437c4df69a8536d75afe2825 in term 0.
I20260207 20:53:58.021373 13054 leader_election.cc:304] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b00ee24cdeb41ad821e6387f57c1f54, aa16cee1437c4df69a8536d75afe2825; no voters:
I20260207 20:53:58.022048 13121 raft_consensus.cc:2804] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:58.022270 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:58.022411 13121 raft_consensus.cc:493] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:58.022816 13121 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:58.023437 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:58.024910 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:58.027200 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:58.027388 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:58.027603 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:58.027747 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:58.028304 13121 raft_consensus.cc:515] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } }
I20260207 20:53:58.029822 13121 leader_election.cc:290] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [CANDIDATE]: Term 1 election: Requested vote from peers 87b8708c0aaa44dbafb43b2af0c4eac0 (127.2.223.62:44691), 6b00ee24cdeb41ad821e6387f57c1f54 (127.2.223.61:38129)
I20260207 20:53:58.030740 12949 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aa16cee1437c4df69a8536d75afe2825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0"
I20260207 20:53:58.030860 13014 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aa16cee1437c4df69a8536d75afe2825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b00ee24cdeb41ad821e6387f57c1f54"
I20260207 20:53:58.031306 12949 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:58.031476 13014 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:58.037355 12949 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa16cee1437c4df69a8536d75afe2825 in term 1.
I20260207 20:53:58.038558 13055 leader_election.cc:304] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b8708c0aaa44dbafb43b2af0c4eac0, aa16cee1437c4df69a8536d75afe2825; no voters:
I20260207 20:53:58.039557 13121 raft_consensus.cc:2804] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:58.040454 13014 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa16cee1437c4df69a8536d75afe2825 in term 1.
I20260207 20:53:58.040969 13121 raft_consensus.cc:697] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [term 1 LEADER]: Becoming Leader. State: Replica: aa16cee1437c4df69a8536d75afe2825, State: Running, Role: LEADER
I20260207 20:53:58.041930 13121 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } }
I20260207 20:53:58.046415 13169 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa16cee1437c4df69a8536d75afe2825. Latest consensus state: current_term: 1 leader_uuid: "aa16cee1437c4df69a8536d75afe2825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } } }
I20260207 20:53:58.047156 13169 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:58.049187 13179 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:53:58.056563 13179 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:53:58.066943 13014 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [term 1 FOLLOWER]: Refusing update from remote peer aa16cee1437c4df69a8536d75afe2825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:58.067405 12949 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [term 1 FOLLOWER]: Refusing update from remote peer aa16cee1437c4df69a8536d75afe2825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:58.068687 13169 consensus_queue.cc:1048] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:58.069367 13121 consensus_queue.cc:1048] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:58.086613 13125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa16cee1437c4df69a8536d75afe2825. Latest consensus state: current_term: 1 leader_uuid: "aa16cee1437c4df69a8536d75afe2825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } } }
I20260207 20:53:58.087432 13125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:58.088905 13110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa16cee1437c4df69a8536d75afe2825. Latest consensus state: current_term: 1 leader_uuid: "aa16cee1437c4df69a8536d75afe2825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } } }
I20260207 20:53:58.089694 13110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:58.095021 13179 catalog_manager.cc:1357] Generated new cluster ID: 213b4f028505451f99525cb563a85630
I20260207 20:53:58.095388 13179 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:53:58.096176 13226 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:41889 every 8 connection(s)
I20260207 20:53:58.096725 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:41889
I20260207 20:53:58.102499 13110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa16cee1437c4df69a8536d75afe2825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } } }
I20260207 20:53:58.103338 13110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:58.103926 13169 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa16cee1437c4df69a8536d75afe2825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } } }
I20260207 20:53:58.104621 13169 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:58.104758 13125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa16cee1437c4df69a8536d75afe2825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } } }
I20260207 20:53:58.105485 13125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:53:58.105887 13121 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa16cee1437c4df69a8536d75afe2825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b8708c0aaa44dbafb43b2af0c4eac0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 44691 } } peers { permanent_uuid: "6b00ee24cdeb41ad821e6387f57c1f54" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38129 } } peers { permanent_uuid: "aa16cee1437c4df69a8536d75afe2825" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35755 } } }
I20260207 20:53:58.106664 13121 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [sys.catalog]: This master's current role is: LEADER
I20260207 20:53:58.140069 13179 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:53:58.141657 13179 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:53:58.142912 13232 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38129
I20260207 20:53:58.143392 13232 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:58.144302 13232 heartbeater.cc:507] Master 127.2.223.61:38129 requested a full tablet report, sending...
I20260207 20:53:58.147547 13004 ts_manager.cc:194] Registered new tserver with Master: 5df9f697578e46aa98102537705922d3 (127.2.223.1:41889)
I20260207 20:53:58.156567 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:58.160279 13234 heartbeater.cc:344] Connected to a master server at 127.2.223.62:44691
I20260207 20:53:58.160740 13234 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:58.161564 13234 heartbeater.cc:507] Master 127.2.223.62:44691 requested a full tablet report, sending...
I20260207 20:53:58.164876 12939 ts_manager.cc:194] Registered new tserver with Master: 5df9f697578e46aa98102537705922d3 (127.2.223.1:41889)
I20260207 20:53:58.165290 13230 heartbeater.cc:344] Connected to a master server at 127.2.223.60:35755
I20260207 20:53:58.165685 13230 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:58.166481 13230 heartbeater.cc:507] Master 127.2.223.60:35755 requested a full tablet report, sending...
I20260207 20:53:58.168367 13069 ts_manager.cc:194] Registered new tserver with Master: 5df9f697578e46aa98102537705922d3 (127.2.223.1:41889)
W20260207 20:53:58.172176 13238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:58.179498 13179 catalog_manager.cc:6027] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825: Generated new TSK 0
I20260207 20:53:58.180302 13179 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20260207 20:53:58.185863 13239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:58.189128 2940 server_base.cc:1060] running on GCE node
W20260207 20:53:58.190043 13241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:58.190985 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:58.191186 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:58.191359 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497638191343 us; error 0 us; skew 500 ppm
I20260207 20:53:58.191824 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:58.193882 2940 webserver.cc:492] Webserver started at http://127.2.223.2:44349/ using document root <none> and password file <none>
I20260207 20:53:58.194334 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:58.194514 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:58.194779 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:58.196039 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "c47dcb059ec8427e82d71b836d9708da"
format_stamp: "Formatted at 2026-02-07 20:53:58 on dist-test-slave-kqw4"
I20260207 20:53:58.198248 13069 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35416
I20260207 20:53:58.202072 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260207 20:53:58.205197 13246 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:58.205879 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:53:58.206174 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "c47dcb059ec8427e82d71b836d9708da"
format_stamp: "Formatted at 2026-02-07 20:53:58 on dist-test-slave-kqw4"
I20260207 20:53:58.206419 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:58.210776 13230 heartbeater.cc:499] Master 127.2.223.60:35755 was elected leader, sending a full tablet report...
I20260207 20:53:58.224573 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:58.226112 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:58.227687 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:58.229776 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:58.229962 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:58.230144 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:58.230266 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:58.275322 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:42571
I20260207 20:53:58.275429 13308 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:42571 every 8 connection(s)
I20260207 20:53:58.302691 13309 heartbeater.cc:344] Connected to a master server at 127.2.223.60:35755
I20260207 20:53:58.303232 13309 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:58.304258 13309 heartbeater.cc:507] Master 127.2.223.60:35755 requested a full tablet report, sending...
I20260207 20:53:58.307830 13069 ts_manager.cc:194] Registered new tserver with Master: c47dcb059ec8427e82d71b836d9708da (127.2.223.2:42571)
I20260207 20:53:58.309947 13069 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35422
I20260207 20:53:58.315929 13310 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38129
I20260207 20:53:58.316336 13310 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:58.316708 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:53:58.316947 13310 heartbeater.cc:507] Master 127.2.223.61:38129 requested a full tablet report, sending...
I20260207 20:53:58.318928 13311 heartbeater.cc:344] Connected to a master server at 127.2.223.62:44691
I20260207 20:53:58.319312 13311 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:58.319392 13003 ts_manager.cc:194] Registered new tserver with Master: c47dcb059ec8427e82d71b836d9708da (127.2.223.2:42571)
I20260207 20:53:58.320011 13311 heartbeater.cc:507] Master 127.2.223.62:44691 requested a full tablet report, sending...
I20260207 20:53:58.322467 12939 ts_manager.cc:194] Registered new tserver with Master: c47dcb059ec8427e82d71b836d9708da (127.2.223.2:42571)
I20260207 20:53:58.323895 13309 heartbeater.cc:499] Master 127.2.223.60:35755 was elected leader, sending a full tablet report...
W20260207 20:53:58.324978 13316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:58.327853 13317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:53:58.329655 13319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:53:58.330219 2940 server_base.cc:1060] running on GCE node
I20260207 20:53:58.331220 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:53:58.331470 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:53:58.331681 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497638331663 us; error 0 us; skew 500 ppm
I20260207 20:53:58.332412 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:53:58.335332 2940 webserver.cc:492] Webserver started at http://127.2.223.3:41351/ using document root <none> and password file <none>
I20260207 20:53:58.335965 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:53:58.336174 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:53:58.336417 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:53:58.337697 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba"
format_stamp: "Formatted at 2026-02-07 20:53:58 on dist-test-slave-kqw4"
I20260207 20:53:58.343127 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260207 20:53:58.346731 13324 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:58.347747 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260207 20:53:58.348119 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba"
format_stamp: "Formatted at 2026-02-07 20:53:58 on dist-test-slave-kqw4"
I20260207 20:53:58.348482 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestMatchingTabletIdFilter.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:53:58.370091 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:53:58.371479 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:53:58.372956 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:53:58.375273 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:53:58.375561 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260207 20:53:58.375856 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:53:58.376027 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:53:58.444921 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:33177
I20260207 20:53:58.444974 13386 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:33177 every 8 connection(s)
I20260207 20:53:58.497121 13387 heartbeater.cc:344] Connected to a master server at 127.2.223.60:35755
I20260207 20:53:58.497511 13387 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:58.498366 13387 heartbeater.cc:507] Master 127.2.223.60:35755 requested a full tablet report, sending...
I20260207 20:53:58.502818 13069 ts_manager.cc:194] Registered new tserver with Master: 5cbe5f36b70c4113a75af24ffa7bd6ba (127.2.223.3:33177)
I20260207 20:53:58.504557 13069 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35430
I20260207 20:53:58.505856 13390 heartbeater.cc:344] Connected to a master server at 127.2.223.62:44691
I20260207 20:53:58.506281 13390 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:58.507057 13390 heartbeater.cc:507] Master 127.2.223.62:44691 requested a full tablet report, sending...
I20260207 20:53:58.509622 12938 ts_manager.cc:194] Registered new tserver with Master: 5cbe5f36b70c4113a75af24ffa7bd6ba (127.2.223.3:33177)
I20260207 20:53:58.512312 13388 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38129
I20260207 20:53:58.512668 13388 heartbeater.cc:461] Registering TS with master...
I20260207 20:53:58.513357 13388 heartbeater.cc:507] Master 127.2.223.61:38129 requested a full tablet report, sending...
I20260207 20:53:58.515703 13003 ts_manager.cc:194] Registered new tserver with Master: 5cbe5f36b70c4113a75af24ffa7bd6ba (127.2.223.3:33177)
I20260207 20:53:58.516525 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.045192217s
I20260207 20:53:58.520051 13387 heartbeater.cc:499] Master 127.2.223.60:35755 was elected leader, sending a full tablet report...
I20260207 20:53:58.571513 13067 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35438:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:53:58.574216 13067 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:53:58.680476 13273 tablet_service.cc:1505] Processing CreateTablet for tablet 2d93f2622fc84cf7b382d0cdd71e9320 (DEFAULT_TABLE table=ksck-test-table [id=25f61721539b4619801edaf66c1d7ec8]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:58.681820 13273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d93f2622fc84cf7b382d0cdd71e9320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:58.683651 13274 tablet_service.cc:1505] Processing CreateTablet for tablet de5851fa868949b998664cbbbce2a28b (DEFAULT_TABLE table=ksck-test-table [id=25f61721539b4619801edaf66c1d7ec8]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:58.684302 13352 tablet_service.cc:1505] Processing CreateTablet for tablet de5851fa868949b998664cbbbce2a28b (DEFAULT_TABLE table=ksck-test-table [id=25f61721539b4619801edaf66c1d7ec8]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:58.684494 13187 tablet_service.cc:1505] Processing CreateTablet for tablet de5851fa868949b998664cbbbce2a28b (DEFAULT_TABLE table=ksck-test-table [id=25f61721539b4619801edaf66c1d7ec8]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:53:58.685025 13274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5851fa868949b998664cbbbce2a28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:58.685577 13352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5851fa868949b998664cbbbce2a28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:58.685796 13187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5851fa868949b998664cbbbce2a28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:58.683651 13186 tablet_service.cc:1505] Processing CreateTablet for tablet 2d93f2622fc84cf7b382d0cdd71e9320 (DEFAULT_TABLE table=ksck-test-table [id=25f61721539b4619801edaf66c1d7ec8]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:58.688344 13186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d93f2622fc84cf7b382d0cdd71e9320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:58.701778 13351 tablet_service.cc:1505] Processing CreateTablet for tablet 2d93f2622fc84cf7b382d0cdd71e9320 (DEFAULT_TABLE table=ksck-test-table [id=25f61721539b4619801edaf66c1d7ec8]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:53:58.703171 13351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d93f2622fc84cf7b382d0cdd71e9320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:58.710021 13408 tablet_bootstrap.cc:492] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3: Bootstrap starting.
I20260207 20:53:58.716936 13408 tablet_bootstrap.cc:654] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:58.729664 13408 tablet_bootstrap.cc:492] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3: No bootstrap required, opened a new log
I20260207 20:53:58.730294 13408 ts_tablet_manager.cc:1403] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.005s
I20260207 20:53:58.733139 13408 raft_consensus.cc:359] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } } peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } }
I20260207 20:53:58.734190 13408 raft_consensus.cc:385] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:58.734551 13408 raft_consensus.cc:740] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5df9f697578e46aa98102537705922d3, State: Initialized, Role: FOLLOWER
I20260207 20:53:58.735433 13408 consensus_queue.cc:260] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } } peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } }
I20260207 20:53:58.748546 13411 tablet_bootstrap.cc:492] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba: Bootstrap starting.
I20260207 20:53:58.751732 13187 tablet_service.cc:1505] Processing CreateTablet for tablet 9fba3b0b63804aea8653d886fb9225cb (DEFAULT_TABLE table=ksck-test-table [id=25f61721539b4619801edaf66c1d7ec8]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:58.757301 13187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fba3b0b63804aea8653d886fb9225cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:58.758652 13352 tablet_service.cc:1505] Processing CreateTablet for tablet 9fba3b0b63804aea8653d886fb9225cb (DEFAULT_TABLE table=ksck-test-table [id=25f61721539b4619801edaf66c1d7ec8]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:58.759876 13352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fba3b0b63804aea8653d886fb9225cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:58.753527 13272 tablet_service.cc:1505] Processing CreateTablet for tablet 9fba3b0b63804aea8653d886fb9225cb (DEFAULT_TABLE table=ksck-test-table [id=25f61721539b4619801edaf66c1d7ec8]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:53:58.761860 13272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fba3b0b63804aea8653d886fb9225cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:53:58.788849 13412 tablet_bootstrap.cc:492] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da: Bootstrap starting.
I20260207 20:53:58.789598 13408 ts_tablet_manager.cc:1434] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3: Time spent starting tablet: real 0.059s user 0.012s sys 0.009s
I20260207 20:53:58.799476 13411 tablet_bootstrap.cc:654] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:58.807252 13408 tablet_bootstrap.cc:492] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3: Bootstrap starting.
I20260207 20:53:58.814127 13408 tablet_bootstrap.cc:654] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:58.821355 13412 tablet_bootstrap.cc:654] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:58.835558 13411 tablet_bootstrap.cc:492] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba: No bootstrap required, opened a new log
I20260207 20:53:58.836035 13408 tablet_bootstrap.cc:492] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3: No bootstrap required, opened a new log
I20260207 20:53:58.836174 13411 ts_tablet_manager.cc:1403] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba: Time spent bootstrapping tablet: real 0.088s user 0.006s sys 0.007s
I20260207 20:53:58.837000 13408 ts_tablet_manager.cc:1403] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3: Time spent bootstrapping tablet: real 0.030s user 0.011s sys 0.000s
I20260207 20:53:58.838755 13412 tablet_bootstrap.cc:492] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da: No bootstrap required, opened a new log
I20260207 20:53:58.839267 13412 ts_tablet_manager.cc:1403] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da: Time spent bootstrapping tablet: real 0.051s user 0.012s sys 0.000s
I20260207 20:53:58.839200 13411 raft_consensus.cc:359] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } } peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } }
I20260207 20:53:58.840085 13411 raft_consensus.cc:385] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:58.840878 13411 raft_consensus.cc:740] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cbe5f36b70c4113a75af24ffa7bd6ba, State: Initialized, Role: FOLLOWER
I20260207 20:53:58.841773 13411 consensus_queue.cc:260] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } } peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } }
I20260207 20:53:58.842124 13408 raft_consensus.cc:359] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:58.845155 13408 raft_consensus.cc:385] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:58.845557 13408 raft_consensus.cc:740] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5df9f697578e46aa98102537705922d3, State: Initialized, Role: FOLLOWER
I20260207 20:53:58.844940 13412 raft_consensus.cc:359] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } } peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } }
I20260207 20:53:58.846931 13412 raft_consensus.cc:385] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:58.851300 13412 raft_consensus.cc:740] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47dcb059ec8427e82d71b836d9708da, State: Initialized, Role: FOLLOWER
I20260207 20:53:58.850522 13408 consensus_queue.cc:260] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:58.852208 13412 consensus_queue.cc:260] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } } peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } }
I20260207 20:53:58.863658 13411 ts_tablet_manager.cc:1434] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba: Time spent starting tablet: real 0.027s user 0.012s sys 0.000s
I20260207 20:53:58.868603 13411 tablet_bootstrap.cc:492] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba: Bootstrap starting.
I20260207 20:53:58.870172 13412 ts_tablet_manager.cc:1434] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da: Time spent starting tablet: real 0.030s user 0.008s sys 0.004s
I20260207 20:53:58.874044 13412 tablet_bootstrap.cc:492] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da: Bootstrap starting.
I20260207 20:53:58.874503 13411 tablet_bootstrap.cc:654] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:58.885474 13411 tablet_bootstrap.cc:492] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba: No bootstrap required, opened a new log
I20260207 20:53:58.886054 13411 ts_tablet_manager.cc:1403] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.000s
I20260207 20:53:58.887303 13412 tablet_bootstrap.cc:654] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:58.889377 13411 raft_consensus.cc:359] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:58.890066 13411 raft_consensus.cc:385] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:58.890409 13411 raft_consensus.cc:740] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cbe5f36b70c4113a75af24ffa7bd6ba, State: Initialized, Role: FOLLOWER
I20260207 20:53:58.891289 13411 consensus_queue.cc:260] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:58.893886 13411 ts_tablet_manager.cc:1434] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260207 20:53:58.898710 13411 tablet_bootstrap.cc:492] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba: Bootstrap starting.
I20260207 20:53:58.904433 13411 tablet_bootstrap.cc:654] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:58.915599 13411 tablet_bootstrap.cc:492] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba: No bootstrap required, opened a new log
I20260207 20:53:58.916208 13411 ts_tablet_manager.cc:1403] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.004s
I20260207 20:53:58.916872 13408 ts_tablet_manager.cc:1434] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3: Time spent starting tablet: real 0.079s user 0.005s sys 0.000s
I20260207 20:53:58.918989 13411 raft_consensus.cc:359] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:58.919901 13411 raft_consensus.cc:385] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:58.920244 13411 raft_consensus.cc:740] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cbe5f36b70c4113a75af24ffa7bd6ba, State: Initialized, Role: FOLLOWER
I20260207 20:53:58.921047 13411 consensus_queue.cc:260] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:58.925801 13411 ts_tablet_manager.cc:1434] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba: Time spent starting tablet: real 0.009s user 0.001s sys 0.004s
I20260207 20:53:58.927788 13410 raft_consensus.cc:493] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:58.928282 13410 raft_consensus.cc:515] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:58.930640 13408 tablet_bootstrap.cc:492] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3: Bootstrap starting.
I20260207 20:53:58.930688 13410 leader_election.cc:290] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47dcb059ec8427e82d71b836d9708da (127.2.223.2:42571), 5cbe5f36b70c4113a75af24ffa7bd6ba (127.2.223.3:33177)
I20260207 20:53:58.936280 13408 tablet_bootstrap.cc:654] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:58.942845 13412 tablet_bootstrap.cc:492] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da: No bootstrap required, opened a new log
I20260207 20:53:58.943372 13412 ts_tablet_manager.cc:1403] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da: Time spent bootstrapping tablet: real 0.070s user 0.034s sys 0.000s
I20260207 20:53:58.954756 13412 raft_consensus.cc:359] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:58.961850 13412 raft_consensus.cc:385] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:58.962275 13412 raft_consensus.cc:740] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47dcb059ec8427e82d71b836d9708da, State: Initialized, Role: FOLLOWER
I20260207 20:53:58.962905 13124 catalog_manager.cc:1269] Loaded cluster ID: 213b4f028505451f99525cb563a85630
I20260207 20:53:58.963240 13124 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54: loading cluster ID for follower catalog manager: success
I20260207 20:53:58.964776 13362 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d93f2622fc84cf7b382d0cdd71e9320" candidate_uuid: "5df9f697578e46aa98102537705922d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" is_pre_election: true
I20260207 20:53:58.965551 13362 raft_consensus.cc:2468] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5df9f697578e46aa98102537705922d3 in term 0.
I20260207 20:53:58.966830 13157 leader_election.cc:304] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cbe5f36b70c4113a75af24ffa7bd6ba, 5df9f697578e46aa98102537705922d3; no voters:
I20260207 20:53:58.967712 13410 raft_consensus.cc:2804] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:58.968075 13410 raft_consensus.cc:493] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:58.968385 13410 raft_consensus.cc:3060] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:58.969496 13124 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54: acquiring CA information for follower catalog manager: success
I20260207 20:53:58.976260 13124 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:58.978699 13410 raft_consensus.cc:515] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:58.963253 13412 consensus_queue.cc:260] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:58.983743 13408 tablet_bootstrap.cc:492] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3: No bootstrap required, opened a new log
I20260207 20:53:58.984315 13408 ts_tablet_manager.cc:1403] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3: Time spent bootstrapping tablet: real 0.054s user 0.015s sys 0.012s
I20260207 20:53:58.985210 13147 catalog_manager.cc:1269] Loaded cluster ID: 213b4f028505451f99525cb563a85630
I20260207 20:53:58.987728 13284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d93f2622fc84cf7b382d0cdd71e9320" candidate_uuid: "5df9f697578e46aa98102537705922d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47dcb059ec8427e82d71b836d9708da" is_pre_election: true
I20260207 20:53:58.993039 13147 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0: loading cluster ID for follower catalog manager: success
I20260207 20:53:58.993276 13284 raft_consensus.cc:2468] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5df9f697578e46aa98102537705922d3 in term 0.
I20260207 20:53:58.988193 13408 raft_consensus.cc:359] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:58.988495 13283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d93f2622fc84cf7b382d0cdd71e9320" candidate_uuid: "5df9f697578e46aa98102537705922d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47dcb059ec8427e82d71b836d9708da"
I20260207 20:53:58.989184 13362 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d93f2622fc84cf7b382d0cdd71e9320" candidate_uuid: "5df9f697578e46aa98102537705922d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba"
I20260207 20:53:58.996461 13408 raft_consensus.cc:385] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:58.996728 13362 raft_consensus.cc:3060] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:58.996675 13283 raft_consensus.cc:3060] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:58.996902 13408 raft_consensus.cc:740] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5df9f697578e46aa98102537705922d3, State: Initialized, Role: FOLLOWER
I20260207 20:53:58.997920 13408 consensus_queue.cc:260] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:59.001336 13147 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0: acquiring CA information for follower catalog manager: success
I20260207 20:53:59.006498 13147 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:53:58.990096 13412 ts_tablet_manager.cc:1434] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da: Time spent starting tablet: real 0.046s user 0.006s sys 0.000s
I20260207 20:53:58.990374 13410 leader_election.cc:290] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [CANDIDATE]: Term 1 election: Requested vote from peers c47dcb059ec8427e82d71b836d9708da (127.2.223.2:42571), 5cbe5f36b70c4113a75af24ffa7bd6ba (127.2.223.3:33177)
I20260207 20:53:59.011963 13283 raft_consensus.cc:2468] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5df9f697578e46aa98102537705922d3 in term 1.
I20260207 20:53:59.007583 13362 raft_consensus.cc:2468] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5df9f697578e46aa98102537705922d3 in term 1.
I20260207 20:53:59.019541 13159 leader_election.cc:304] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5df9f697578e46aa98102537705922d3, c47dcb059ec8427e82d71b836d9708da; no voters:
I20260207 20:53:59.014611 13412 tablet_bootstrap.cc:492] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da: Bootstrap starting.
I20260207 20:53:59.027030 13410 raft_consensus.cc:2804] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:59.027596 13410 raft_consensus.cc:697] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [term 1 LEADER]: Becoming Leader. State: Replica: 5df9f697578e46aa98102537705922d3, State: Running, Role: LEADER
I20260207 20:53:59.029295 13410 consensus_queue.cc:237] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:59.049108 13424 raft_consensus.cc:493] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:59.051082 13424 raft_consensus.cc:515] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } } peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } }
I20260207 20:53:59.037215 13412 tablet_bootstrap.cc:654] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da: Neither blocks nor log segments found. Creating new log.
I20260207 20:53:59.053984 13283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de5851fa868949b998664cbbbce2a28b" candidate_uuid: "5df9f697578e46aa98102537705922d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47dcb059ec8427e82d71b836d9708da" is_pre_election: true
I20260207 20:53:59.054703 13283 raft_consensus.cc:2468] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5df9f697578e46aa98102537705922d3 in term 0.
I20260207 20:53:59.048712 13408 ts_tablet_manager.cc:1434] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3: Time spent starting tablet: real 0.064s user 0.032s sys 0.016s
I20260207 20:53:59.056085 13159 leader_election.cc:304] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5df9f697578e46aa98102537705922d3, c47dcb059ec8427e82d71b836d9708da; no voters:
I20260207 20:53:59.059105 13410 raft_consensus.cc:2804] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:59.059496 13410 raft_consensus.cc:493] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:59.059818 13410 raft_consensus.cc:3060] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:59.065258 13069 catalog_manager.cc:5654] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5df9f697578e46aa98102537705922d3 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "5df9f697578e46aa98102537705922d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } health_report { overall_health: UNKNOWN } } }
I20260207 20:53:59.068111 13410 raft_consensus.cc:515] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } } peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } }
I20260207 20:53:59.070082 13410 leader_election.cc:290] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [CANDIDATE]: Term 1 election: Requested vote from peers c47dcb059ec8427e82d71b836d9708da (127.2.223.2:42571), 5cbe5f36b70c4113a75af24ffa7bd6ba (127.2.223.3:33177)
I20260207 20:53:59.072343 13424 leader_election.cc:290] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47dcb059ec8427e82d71b836d9708da (127.2.223.2:42571), 5cbe5f36b70c4113a75af24ffa7bd6ba (127.2.223.3:33177)
I20260207 20:53:59.073854 13361 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de5851fa868949b998664cbbbce2a28b" candidate_uuid: "5df9f697578e46aa98102537705922d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" is_pre_election: true
I20260207 20:53:59.074304 13283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de5851fa868949b998664cbbbce2a28b" candidate_uuid: "5df9f697578e46aa98102537705922d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47dcb059ec8427e82d71b836d9708da"
I20260207 20:53:59.074541 13361 raft_consensus.cc:2468] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5df9f697578e46aa98102537705922d3 in term 0.
I20260207 20:53:59.074927 13283 raft_consensus.cc:3060] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:59.076053 13412 tablet_bootstrap.cc:492] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da: No bootstrap required, opened a new log
I20260207 20:53:59.076557 13412 ts_tablet_manager.cc:1403] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da: Time spent bootstrapping tablet: real 0.062s user 0.008s sys 0.004s
I20260207 20:53:59.075104 13362 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de5851fa868949b998664cbbbce2a28b" candidate_uuid: "5df9f697578e46aa98102537705922d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba"
I20260207 20:53:59.079227 13362 raft_consensus.cc:3060] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:59.079285 13412 raft_consensus.cc:359] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:59.080139 13412 raft_consensus.cc:385] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:53:59.080448 13412 raft_consensus.cc:740] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47dcb059ec8427e82d71b836d9708da, State: Initialized, Role: FOLLOWER
I20260207 20:53:59.081276 13412 consensus_queue.cc:260] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:59.083608 13412 ts_tablet_manager.cc:1434] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260207 20:53:59.088634 13283 raft_consensus.cc:2468] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5df9f697578e46aa98102537705922d3 in term 1.
I20260207 20:53:59.089764 13159 leader_election.cc:304] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5df9f697578e46aa98102537705922d3, c47dcb059ec8427e82d71b836d9708da; no voters:
I20260207 20:53:59.090689 13424 raft_consensus.cc:2804] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:59.091207 13424 raft_consensus.cc:697] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [term 1 LEADER]: Becoming Leader. State: Replica: 5df9f697578e46aa98102537705922d3, State: Running, Role: LEADER
I20260207 20:53:59.091990 13424 consensus_queue.cc:237] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } } peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } }
I20260207 20:53:59.090318 13362 raft_consensus.cc:2468] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5df9f697578e46aa98102537705922d3 in term 1.
I20260207 20:53:59.101722 13416 raft_consensus.cc:493] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:53:59.102329 13416 raft_consensus.cc:515] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:59.104990 13416 leader_election.cc:290] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5df9f697578e46aa98102537705922d3 (127.2.223.1:41889), c47dcb059ec8427e82d71b836d9708da (127.2.223.2:42571)
I20260207 20:53:59.131093 13197 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fba3b0b63804aea8653d886fb9225cb" candidate_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5df9f697578e46aa98102537705922d3" is_pre_election: true
I20260207 20:53:59.131873 13197 raft_consensus.cc:2468] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cbe5f36b70c4113a75af24ffa7bd6ba in term 0.
I20260207 20:53:59.133347 13326 leader_election.cc:304] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cbe5f36b70c4113a75af24ffa7bd6ba, 5df9f697578e46aa98102537705922d3; no voters:
I20260207 20:53:59.134167 13416 raft_consensus.cc:2804] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:53:59.134419 13283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fba3b0b63804aea8653d886fb9225cb" candidate_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47dcb059ec8427e82d71b836d9708da" is_pre_election: true
I20260207 20:53:59.134639 13416 raft_consensus.cc:493] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:53:59.135097 13416 raft_consensus.cc:3060] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:59.136518 13069 catalog_manager.cc:5654] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5df9f697578e46aa98102537705922d3 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "5df9f697578e46aa98102537705922d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:59.135136 13283 raft_consensus.cc:2468] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cbe5f36b70c4113a75af24ffa7bd6ba in term 0.
I20260207 20:53:59.145704 13416 raft_consensus.cc:515] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:59.147962 13416 leader_election.cc:290] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [CANDIDATE]: Term 1 election: Requested vote from peers 5df9f697578e46aa98102537705922d3 (127.2.223.1:41889), c47dcb059ec8427e82d71b836d9708da (127.2.223.2:42571)
I20260207 20:53:59.150463 13283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fba3b0b63804aea8653d886fb9225cb" candidate_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47dcb059ec8427e82d71b836d9708da"
I20260207 20:53:59.151114 13283 raft_consensus.cc:3060] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:59.155046 13197 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fba3b0b63804aea8653d886fb9225cb" candidate_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5df9f697578e46aa98102537705922d3"
I20260207 20:53:59.155629 13197 raft_consensus.cc:3060] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:53:59.164999 13283 raft_consensus.cc:2468] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cbe5f36b70c4113a75af24ffa7bd6ba in term 1.
I20260207 20:53:59.166196 13327 leader_election.cc:304] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cbe5f36b70c4113a75af24ffa7bd6ba, c47dcb059ec8427e82d71b836d9708da; no voters:
I20260207 20:53:59.167251 13416 raft_consensus.cc:2804] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:53:59.168793 13197 raft_consensus.cc:2468] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cbe5f36b70c4113a75af24ffa7bd6ba in term 1.
I20260207 20:53:59.169584 13416 raft_consensus.cc:697] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 1 LEADER]: Becoming Leader. State: Replica: 5cbe5f36b70c4113a75af24ffa7bd6ba, State: Running, Role: LEADER
I20260207 20:53:59.170513 13416 consensus_queue.cc:237] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } }
I20260207 20:53:59.186167 13066 catalog_manager.cc:5654] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cbe5f36b70c4113a75af24ffa7bd6ba (127.2.223.3). New cstate: current_term: 1 leader_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 } health_report { overall_health: HEALTHY } } }
I20260207 20:53:59.305312 2940 ksck_remote-test.cc:739] Generating row writes...
I20260207 20:53:59.464480 13424 consensus_queue.cc:1048] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:59.473297 13283 raft_consensus.cc:1275] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da [term 1 FOLLOWER]: Refusing update from remote peer 5df9f697578e46aa98102537705922d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:59.479295 13424 consensus_queue.cc:1048] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:59.486380 13361 raft_consensus.cc:1275] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 1 FOLLOWER]: Refusing update from remote peer 5df9f697578e46aa98102537705922d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:59.488219 13424 consensus_queue.cc:1048] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cbe5f36b70c4113a75af24ffa7bd6ba" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 33177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:59.502331 13284 raft_consensus.cc:1275] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da [term 1 FOLLOWER]: Refusing update from remote peer 5df9f697578e46aa98102537705922d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:59.504304 13424 consensus_queue.cc:1048] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:59.605630 13284 raft_consensus.cc:1275] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da [term 1 FOLLOWER]: Refusing update from remote peer 5cbe5f36b70c4113a75af24ffa7bd6ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:59.610528 13431 consensus_queue.cc:1048] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47dcb059ec8427e82d71b836d9708da" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260207 20:53:59.624727 13197 raft_consensus.cc:1275] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3 [term 1 FOLLOWER]: Refusing update from remote peer 5cbe5f36b70c4113a75af24ffa7bd6ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:53:59.629196 13431 consensus_queue.cc:1048] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "5df9f697578e46aa98102537705922d3" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:53:59.712190 13441 mvcc.cc:204] Tried to move back new op lower bound from 7251958331755995136 to 7251958330049974272. Current Snapshot: MvccSnapshot[applied={T|T < 7251958331755995136}]
W20260207 20:53:59.841681 13055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.223.62:44691, user_credentials={real_user=slave}} blocked reactor thread for 73798.4us
I20260207 20:54:00.552992 13352 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:54:00.564821 13186 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260207 20:54:00.582252 13272 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:54:00.976274 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:54:01.040814 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:01.041584 2940 tablet_replica.cc:333] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3: stopping tablet replica
I20260207 20:54:01.042438 2940 raft_consensus.cc:2243] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:01.043140 2940 raft_consensus.cc:2272] T 9fba3b0b63804aea8653d886fb9225cb P 5df9f697578e46aa98102537705922d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:01.046649 2940 tablet_replica.cc:333] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3: stopping tablet replica
I20260207 20:54:01.047483 2940 raft_consensus.cc:2243] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:01.048622 2940 raft_consensus.cc:2272] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5df9f697578e46aa98102537705922d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:01.051277 2940 tablet_replica.cc:333] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3: stopping tablet replica
I20260207 20:54:01.051941 2940 raft_consensus.cc:2243] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:01.052803 2940 raft_consensus.cc:2272] T de5851fa868949b998664cbbbce2a28b P 5df9f697578e46aa98102537705922d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:01.070552 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:54:01.088655 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:54:01.128226 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:01.128993 2940 tablet_replica.cc:333] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da: stopping tablet replica
I20260207 20:54:01.129755 2940 raft_consensus.cc:2243] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:01.130316 2940 raft_consensus.cc:2272] T 9fba3b0b63804aea8653d886fb9225cb P c47dcb059ec8427e82d71b836d9708da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:01.133263 2940 tablet_replica.cc:333] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da: stopping tablet replica
I20260207 20:54:01.133692 2940 raft_consensus.cc:2243] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:01.134189 2940 raft_consensus.cc:2272] T 2d93f2622fc84cf7b382d0cdd71e9320 P c47dcb059ec8427e82d71b836d9708da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:01.136253 2940 tablet_replica.cc:333] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da: stopping tablet replica
I20260207 20:54:01.136685 2940 raft_consensus.cc:2243] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:01.137115 2940 raft_consensus.cc:2272] T de5851fa868949b998664cbbbce2a28b P c47dcb059ec8427e82d71b836d9708da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:01.158092 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:54:01.175869 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:54:01.204897 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:01.205552 2940 tablet_replica.cc:333] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba: stopping tablet replica
I20260207 20:54:01.206127 2940 raft_consensus.cc:2243] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:01.206943 2940 raft_consensus.cc:2272] T 9fba3b0b63804aea8653d886fb9225cb P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:01.209165 2940 tablet_replica.cc:333] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba: stopping tablet replica
I20260207 20:54:01.209620 2940 raft_consensus.cc:2243] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:01.210059 2940 raft_consensus.cc:2272] T 2d93f2622fc84cf7b382d0cdd71e9320 P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:01.211944 2940 tablet_replica.cc:333] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba: stopping tablet replica
I20260207 20:54:01.212352 2940 raft_consensus.cc:2243] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:01.212762 2940 raft_consensus.cc:2272] T de5851fa868949b998664cbbbce2a28b P 5cbe5f36b70c4113a75af24ffa7bd6ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:01.233217 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:54:01.246403 2940 master.cc:561] Master@127.2.223.62:44691 shutting down...
I20260207 20:54:01.269187 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:01.269771 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:01.270170 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 87b8708c0aaa44dbafb43b2af0c4eac0: stopping tablet replica
I20260207 20:54:01.289888 2940 master.cc:583] Master@127.2.223.62:44691 shutdown complete.
I20260207 20:54:01.304337 2940 master.cc:561] Master@127.2.223.61:38129 shutting down...
I20260207 20:54:01.325610 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:01.326143 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:01.326444 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6b00ee24cdeb41ad821e6387f57c1f54: stopping tablet replica
I20260207 20:54:01.345444 2940 master.cc:583] Master@127.2.223.61:38129 shutdown complete.
W20260207 20:54:01.360203 13055 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.223.62:44691: connect: Connection refused (error 111) [suppressed 8 similar messages]
I20260207 20:54:01.362174 2940 master.cc:561] Master@127.2.223.60:35755 shutting down...
W20260207 20:54:01.364272 13055 consensus_peers.cc:597] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 -> Peer 87b8708c0aaa44dbafb43b2af0c4eac0 (127.2.223.62:44691): Couldn't send request to peer 87b8708c0aaa44dbafb43b2af0c4eac0. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.62:44691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:54:01.381016 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:01.381880 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:01.382220 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P aa16cee1437c4df69a8536d75afe2825: stopping tablet replica
I20260207 20:54:01.402478 2940 master.cc:583] Master@127.2.223.60:35755 shutdown complete.
[ OK ] RemoteKsckTest.TestMatchingTabletIdFilter (3799 ms)
[ RUN ] RemoteKsckTest.TestTableFiltersNoMatch
I20260207 20:54:01.435987 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:40311,127.2.223.61:35593,127.2.223.60:33863
I20260207 20:54:01.437325 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:01.442814 13499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:01.443434 13501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:01.443641 13498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:01.443850 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:01.444769 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:01.444941 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:01.445050 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497641445040 us; error 0 us; skew 500 ppm
I20260207 20:54:01.445474 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:01.447604 2940 webserver.cc:492] Webserver started at http://127.2.223.62:40245/ using document root <none> and password file <none>
I20260207 20:54:01.448017 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:01.448172 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:01.448400 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:01.449491 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "0b97a14f197f4094bff999da22316f06"
format_stamp: "Formatted at 2026-02-07 20:54:01 on dist-test-slave-kqw4"
I20260207 20:54:01.453570 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:54:01.457041 13506 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:01.457784 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:54:01.458055 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "0b97a14f197f4094bff999da22316f06"
format_stamp: "Formatted at 2026-02-07 20:54:01 on dist-test-slave-kqw4"
I20260207 20:54:01.458300 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:01.475711 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:01.477262 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:01.514946 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:40311
I20260207 20:54:01.515065 13557 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:40311 every 8 connection(s)
I20260207 20:54:01.518631 13558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:01.518744 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:01.523959 13560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:01.525388 13561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:01.527101 13558 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:54:01.527840 13563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:01.528755 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:01.529966 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:01.530256 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:01.530491 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497641530470 us; error 0 us; skew 500 ppm
I20260207 20:54:01.531253 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:01.533922 2940 webserver.cc:492] Webserver started at http://127.2.223.61:43589/ using document root <none> and password file <none>
I20260207 20:54:01.534401 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:01.534569 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:01.534837 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:01.536209 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "a6e0a29be0be4932a2ffda79bbd48e06"
format_stamp: "Formatted at 2026-02-07 20:54:01 on dist-test-slave-kqw4"
I20260207 20:54:01.540614 13558 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:01.541770 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260207 20:54:01.545785 13571 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20260207 20:54:01.546218 13558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:35593: Network error: Client connection negotiation failed: client connection to 127.2.223.61:35593: connect: Connection refused (error 111)
I20260207 20:54:01.546643 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:54:01.546970 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "a6e0a29be0be4932a2ffda79bbd48e06"
format_stamp: "Formatted at 2026-02-07 20:54:01 on dist-test-slave-kqw4"
I20260207 20:54:01.547230 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:01.560786 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:01.561971 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:01.578711 13558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } attempt: 1
W20260207 20:54:01.583853 13558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:35593: Network error: Client connection negotiation failed: client connection to 127.2.223.61:35593: connect: Connection refused (error 111)
I20260207 20:54:01.599792 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:35593
I20260207 20:54:01.599884 13622 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:35593 every 8 connection(s)
I20260207 20:54:01.603482 13623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:01.603575 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:01.608835 13625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:01.609385 13626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:01.611291 13623 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:54:01.612196 13628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:01.612455 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:01.613397 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:01.613631 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:01.613832 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497641613813 us; error 0 us; skew 500 ppm
I20260207 20:54:01.614369 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:01.617029 2940 webserver.cc:492] Webserver started at http://127.2.223.60:41415/ using document root <none> and password file <none>
I20260207 20:54:01.617645 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:01.617863 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:01.618165 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:01.619223 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "4a0fe3bae03649a194dc7141a7e3f021"
format_stamp: "Formatted at 2026-02-07 20:54:01 on dist-test-slave-kqw4"
I20260207 20:54:01.622771 13623 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:01.624512 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260207 20:54:01.628384 13558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } attempt: 2
I20260207 20:54:01.628573 13635 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:01.631210 2940 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260207 20:54:01.631541 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "4a0fe3bae03649a194dc7141a7e3f021"
format_stamp: "Formatted at 2026-02-07 20:54:01 on dist-test-slave-kqw4"
I20260207 20:54:01.631906 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:01.635002 13623 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:54:01.641219 13623 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:33863: Network error: Client connection negotiation failed: client connection to 127.2.223.60:33863: connect: Connection refused (error 111)
I20260207 20:54:01.641891 13558 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:54:01.645823 13558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:33863: Network error: Client connection negotiation failed: client connection to 127.2.223.60:33863: connect: Connection refused (error 111)
I20260207 20:54:01.647131 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:01.648281 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:01.684727 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:33863
I20260207 20:54:01.684821 13688 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:33863 every 8 connection(s)
I20260207 20:54:01.687625 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:54:01.688556 13689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:01.694746 13689 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:01.695657 13623 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } attempt: 1
I20260207 20:54:01.706357 13689 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:01.710251 13558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } attempt: 1
I20260207 20:54:01.714293 13623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06: Bootstrap starting.
I20260207 20:54:01.717453 13689 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:01.720719 13623 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:01.726320 13623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06: No bootstrap required, opened a new log
I20260207 20:54:01.729347 13623 raft_consensus.cc:359] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } }
I20260207 20:54:01.730077 13623 raft_consensus.cc:385] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:01.730363 13623 raft_consensus.cc:740] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6e0a29be0be4932a2ffda79bbd48e06, State: Initialized, Role: FOLLOWER
I20260207 20:54:01.730829 13558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06: Bootstrap starting.
I20260207 20:54:01.731113 13623 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } }
I20260207 20:54:01.733423 13695 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } } }
I20260207 20:54:01.734195 13695 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:01.735100 13689 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021: Bootstrap starting.
I20260207 20:54:01.735312 13623 sys_catalog.cc:565] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:54:01.737967 13558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:01.739806 13689 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:01.743914 13558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06: No bootstrap required, opened a new log
I20260207 20:54:01.746757 13558 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } }
I20260207 20:54:01.747584 13558 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:01.747960 13558 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b97a14f197f4094bff999da22316f06, State: Initialized, Role: FOLLOWER
I20260207 20:54:01.749382 13689 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021: No bootstrap required, opened a new log
I20260207 20:54:01.749179 13558 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } }
I20260207 20:54:01.751545 13708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } } }
I20260207 20:54:01.752285 13708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:01.752385 13689 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } }
I20260207 20:54:01.753146 13689 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:01.753486 13558 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:54:01.753439 13689 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0fe3bae03649a194dc7141a7e3f021, State: Initialized, Role: FOLLOWER
I20260207 20:54:01.755225 13689 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } }
W20260207 20:54:01.756423 13709 catalog_manager.cc:1568] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:01.756692 13709 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:54:01.757866 13711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } } }
I20260207 20:54:01.758616 13711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:01.760017 13689 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:54:01.769232 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:54:01.769505 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
W20260207 20:54:01.772603 13726 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:01.772912 13726 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:54:01.775156 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:01.777669 13732 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:01.778010 13732 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:54:01.782408 13733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:01.783118 13734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:01.790248 2940 server_base.cc:1060] running on GCE node
W20260207 20:54:01.790223 13736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:01.791345 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:01.791540 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:01.791697 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497641791680 us; error 0 us; skew 500 ppm
I20260207 20:54:01.792174 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:01.794260 2940 webserver.cc:492] Webserver started at http://127.2.223.1:36517/ using document root <none> and password file <none>
I20260207 20:54:01.794747 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:01.794931 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:01.795161 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:01.796169 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "58243639a0c64a6181be8287a01dfc5a"
format_stamp: "Formatted at 2026-02-07 20:54:01 on dist-test-slave-kqw4"
I20260207 20:54:01.800276 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260207 20:54:01.803393 13741 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:01.804111 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:54:01.804411 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "58243639a0c64a6181be8287a01dfc5a"
format_stamp: "Formatted at 2026-02-07 20:54:01 on dist-test-slave-kqw4"
I20260207 20:54:01.804666 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:01.832582 13695 raft_consensus.cc:493] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:01.833154 13695 raft_consensus.cc:515] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } }
I20260207 20:54:01.835079 13695 leader_election.cc:290] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b97a14f197f4094bff999da22316f06 (127.2.223.62:40311), 4a0fe3bae03649a194dc7141a7e3f021 (127.2.223.60:33863)
I20260207 20:54:01.835886 13533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b97a14f197f4094bff999da22316f06" is_pre_election: true
I20260207 20:54:01.836093 13664 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0fe3bae03649a194dc7141a7e3f021" is_pre_election: true
I20260207 20:54:01.836668 13533 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6e0a29be0be4932a2ffda79bbd48e06 in term 0.
I20260207 20:54:01.836755 13664 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6e0a29be0be4932a2ffda79bbd48e06 in term 0.
I20260207 20:54:01.837873 13575 leader_election.cc:304] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b97a14f197f4094bff999da22316f06, a6e0a29be0be4932a2ffda79bbd48e06; no voters:
I20260207 20:54:01.838496 13695 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:01.838845 13695 raft_consensus.cc:493] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:01.839140 13695 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:01.843444 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:01.845098 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:01.846016 13695 raft_consensus.cc:515] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } }
I20260207 20:54:01.846959 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:01.847942 13695 leader_election.cc:290] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [CANDIDATE]: Term 1 election: Requested vote from peers 0b97a14f197f4094bff999da22316f06 (127.2.223.62:40311), 4a0fe3bae03649a194dc7141a7e3f021 (127.2.223.60:33863)
I20260207 20:54:01.848628 13533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b97a14f197f4094bff999da22316f06"
I20260207 20:54:01.848901 13664 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0fe3bae03649a194dc7141a7e3f021"
I20260207 20:54:01.849258 13533 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:01.849442 13664 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:01.850338 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:01.850658 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260207 20:54:01.850960 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:01.851163 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:01.855353 13664 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e0a29be0be4932a2ffda79bbd48e06 in term 1.
I20260207 20:54:01.856379 13575 leader_election.cc:304] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0fe3bae03649a194dc7141a7e3f021, a6e0a29be0be4932a2ffda79bbd48e06; no voters:
I20260207 20:54:01.856783 13533 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e0a29be0be4932a2ffda79bbd48e06 in term 1.
I20260207 20:54:01.857002 13695 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:01.858302 13695 raft_consensus.cc:697] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [term 1 LEADER]: Becoming Leader. State: Replica: a6e0a29be0be4932a2ffda79bbd48e06, State: Running, Role: LEADER
I20260207 20:54:01.859069 13695 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } }
I20260207 20:54:01.864744 13749 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6e0a29be0be4932a2ffda79bbd48e06. Latest consensus state: current_term: 1 leader_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } } }
I20260207 20:54:01.865332 13749 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:01.867137 13756 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:54:01.874182 13756 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:54:01.884065 13664 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [term 1 FOLLOWER]: Refusing update from remote peer a6e0a29be0be4932a2ffda79bbd48e06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:54:01.884965 13533 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [term 1 FOLLOWER]: Refusing update from remote peer a6e0a29be0be4932a2ffda79bbd48e06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:54:01.885640 13749 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:01.886633 13695 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:01.893955 13711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6e0a29be0be4932a2ffda79bbd48e06. Latest consensus state: current_term: 1 leader_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } } }
I20260207 20:54:01.894701 13711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:01.899574 13708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6e0a29be0be4932a2ffda79bbd48e06. Latest consensus state: current_term: 1 leader_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } } }
I20260207 20:54:01.900285 13708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:01.904780 13756 catalog_manager.cc:1357] Generated new cluster ID: 7b19946829a743ef8b966297736fa123
I20260207 20:54:01.905119 13756 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:54:01.923177 13708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } } }
I20260207 20:54:01.923930 13708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:01.929673 13711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } } }
I20260207 20:54:01.930409 13711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:01.935830 13799 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } } }
I20260207 20:54:01.936820 13799 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:01.936579 13749 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b97a14f197f4094bff999da22316f06" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 40311 } } peers { permanent_uuid: "a6e0a29be0be4932a2ffda79bbd48e06" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 35593 } } peers { permanent_uuid: "4a0fe3bae03649a194dc7141a7e3f021" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 33863 } } }
I20260207 20:54:01.937588 13749 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:01.947904 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:43959
I20260207 20:54:01.948032 13815 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:43959 every 8 connection(s)
I20260207 20:54:01.966696 13756 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:54:01.970707 13756 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:54:01.977649 13816 heartbeater.cc:344] Connected to a master server at 127.2.223.60:33863
I20260207 20:54:01.978145 13816 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:01.979090 13816 heartbeater.cc:507] Master 127.2.223.60:33863 requested a full tablet report, sending...
I20260207 20:54:01.982298 13654 ts_manager.cc:194] Registered new tserver with Master: 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959)
I20260207 20:54:01.987746 13817 heartbeater.cc:344] Connected to a master server at 127.2.223.61:35593
I20260207 20:54:01.988168 13817 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:01.989007 13817 heartbeater.cc:507] Master 127.2.223.61:35593 requested a full tablet report, sending...
I20260207 20:54:01.989796 13819 heartbeater.cc:344] Connected to a master server at 127.2.223.62:40311
I20260207 20:54:01.990330 13819 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:01.991315 13819 heartbeater.cc:507] Master 127.2.223.62:40311 requested a full tablet report, sending...
I20260207 20:54:01.991528 13588 ts_manager.cc:194] Registered new tserver with Master: 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959)
I20260207 20:54:01.994441 13523 ts_manager.cc:194] Registered new tserver with Master: 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959)
I20260207 20:54:01.996445 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:02.002708 13823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:02.014302 13756 catalog_manager.cc:6027] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06: Generated new TSK 0
I20260207 20:54:02.014972 13756 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20260207 20:54:02.016584 13824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:02.021865 2940 server_base.cc:1060] running on GCE node
W20260207 20:54:02.026605 13826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:02.027590 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:02.027817 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:02.027990 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497642027974 us; error 0 us; skew 500 ppm
I20260207 20:54:02.028482 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:02.030989 2940 webserver.cc:492] Webserver started at http://127.2.223.2:45317/ using document root <none> and password file <none>
I20260207 20:54:02.031448 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:02.031629 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:02.031860 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:02.032362 13588 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57090
I20260207 20:54:02.032884 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "4bb45c021af04eefa6ee49ecbc1a6139"
format_stamp: "Formatted at 2026-02-07 20:54:02 on dist-test-slave-kqw4"
I20260207 20:54:02.037456 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:54:02.041111 13831 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:02.041891 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:54:02.042187 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "4bb45c021af04eefa6ee49ecbc1a6139"
format_stamp: "Formatted at 2026-02-07 20:54:02 on dist-test-slave-kqw4"
I20260207 20:54:02.042445 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:02.044714 13817 heartbeater.cc:499] Master 127.2.223.61:35593 was elected leader, sending a full tablet report...
I20260207 20:54:02.070902 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:02.072422 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:02.073988 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:02.076370 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:02.076625 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:02.076927 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:02.077095 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:02.123584 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:37905
I20260207 20:54:02.123689 13893 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:37905 every 8 connection(s)
I20260207 20:54:02.145738 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:54:02.157974 13895 heartbeater.cc:344] Connected to a master server at 127.2.223.61:35593
I20260207 20:54:02.158450 13895 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:02.159359 13895 heartbeater.cc:507] Master 127.2.223.61:35593 requested a full tablet report, sending...
I20260207 20:54:02.165376 13894 heartbeater.cc:344] Connected to a master server at 127.2.223.60:33863
I20260207 20:54:02.165746 13588 ts_manager.cc:194] Registered new tserver with Master: 4bb45c021af04eefa6ee49ecbc1a6139 (127.2.223.2:37905)
I20260207 20:54:02.165939 13894 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:02.166415 13896 heartbeater.cc:344] Connected to a master server at 127.2.223.62:40311
I20260207 20:54:02.166854 13896 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:02.167238 13894 heartbeater.cc:507] Master 127.2.223.60:33863 requested a full tablet report, sending...
I20260207 20:54:02.167672 13896 heartbeater.cc:507] Master 127.2.223.62:40311 requested a full tablet report, sending...
I20260207 20:54:02.167768 13588 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57102
W20260207 20:54:02.169001 13901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:02.170495 13902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:02.170733 13523 ts_manager.cc:194] Registered new tserver with Master: 4bb45c021af04eefa6ee49ecbc1a6139 (127.2.223.2:37905)
I20260207 20:54:02.173481 13654 ts_manager.cc:194] Registered new tserver with Master: 4bb45c021af04eefa6ee49ecbc1a6139 (127.2.223.2:37905)
W20260207 20:54:02.175347 13904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:02.175524 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:02.176714 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:02.176988 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:02.177240 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497642177220 us; error 0 us; skew 500 ppm
I20260207 20:54:02.177947 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:02.180217 2940 webserver.cc:492] Webserver started at http://127.2.223.3:37669/ using document root <none> and password file <none>
I20260207 20:54:02.180653 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:02.180837 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:02.181072 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:02.182082 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "542eb8927ed64630919282d6adcfc7ad"
format_stamp: "Formatted at 2026-02-07 20:54:02 on dist-test-slave-kqw4"
I20260207 20:54:02.183046 13895 heartbeater.cc:499] Master 127.2.223.61:35593 was elected leader, sending a full tablet report...
I20260207 20:54:02.187588 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260207 20:54:02.191489 13909 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:02.192194 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20260207 20:54:02.192482 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "542eb8927ed64630919282d6adcfc7ad"
format_stamp: "Formatted at 2026-02-07 20:54:02 on dist-test-slave-kqw4"
I20260207 20:54:02.192728 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:02.218290 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:02.219409 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:02.220597 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:02.223397 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:02.223647 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:02.223935 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:02.224082 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:02.283675 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:36833
I20260207 20:54:02.283792 13971 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:36833 every 8 connection(s)
I20260207 20:54:02.309129 13972 heartbeater.cc:344] Connected to a master server at 127.2.223.60:33863
I20260207 20:54:02.309525 13972 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:02.310245 13973 heartbeater.cc:344] Connected to a master server at 127.2.223.61:35593
I20260207 20:54:02.310297 13972 heartbeater.cc:507] Master 127.2.223.60:33863 requested a full tablet report, sending...
I20260207 20:54:02.310935 13973 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:02.311825 13973 heartbeater.cc:507] Master 127.2.223.61:35593 requested a full tablet report, sending...
I20260207 20:54:02.313149 13653 ts_manager.cc:194] Registered new tserver with Master: 542eb8927ed64630919282d6adcfc7ad (127.2.223.3:36833)
I20260207 20:54:02.320158 13587 ts_manager.cc:194] Registered new tserver with Master: 542eb8927ed64630919282d6adcfc7ad (127.2.223.3:36833)
I20260207 20:54:02.321816 13587 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57114
I20260207 20:54:02.323695 13975 heartbeater.cc:344] Connected to a master server at 127.2.223.62:40311
I20260207 20:54:02.324016 13975 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:02.324555 13975 heartbeater.cc:507] Master 127.2.223.62:40311 requested a full tablet report, sending...
I20260207 20:54:02.327077 13523 ts_manager.cc:194] Registered new tserver with Master: 542eb8927ed64630919282d6adcfc7ad (127.2.223.3:36833)
I20260207 20:54:02.327240 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.025395461s
I20260207 20:54:02.334386 13973 heartbeater.cc:499] Master 127.2.223.61:35593 was elected leader, sending a full tablet report...
I20260207 20:54:02.374058 13587 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57116:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:54:02.377305 13587 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:54:02.474380 13772 tablet_service.cc:1505] Processing CreateTablet for tablet f4b88e33e5cd499b8ca8c99845e46214 (DEFAULT_TABLE table=ksck-test-table [id=01b15177eb8646f188fa51d15ed2de92]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:02.475879 13772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b88e33e5cd499b8ca8c99845e46214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:02.480160 13771 tablet_service.cc:1505] Processing CreateTablet for tablet 058efef8bfbf4e139f13539841d86bc1 (DEFAULT_TABLE table=ksck-test-table [id=01b15177eb8646f188fa51d15ed2de92]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:02.481577 13771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 058efef8bfbf4e139f13539841d86bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:02.481954 13937 tablet_service.cc:1505] Processing CreateTablet for tablet f4b88e33e5cd499b8ca8c99845e46214 (DEFAULT_TABLE table=ksck-test-table [id=01b15177eb8646f188fa51d15ed2de92]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:02.483227 13937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b88e33e5cd499b8ca8c99845e46214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:02.483549 13770 tablet_service.cc:1505] Processing CreateTablet for tablet 79e2bce1607744fb953fe1d9a7a6c8b1 (DEFAULT_TABLE table=ksck-test-table [id=01b15177eb8646f188fa51d15ed2de92]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:02.484850 13770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e2bce1607744fb953fe1d9a7a6c8b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:02.487607 13936 tablet_service.cc:1505] Processing CreateTablet for tablet 058efef8bfbf4e139f13539841d86bc1 (DEFAULT_TABLE table=ksck-test-table [id=01b15177eb8646f188fa51d15ed2de92]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:02.488883 13936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 058efef8bfbf4e139f13539841d86bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:02.491456 13935 tablet_service.cc:1505] Processing CreateTablet for tablet 79e2bce1607744fb953fe1d9a7a6c8b1 (DEFAULT_TABLE table=ksck-test-table [id=01b15177eb8646f188fa51d15ed2de92]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:02.492657 13935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e2bce1607744fb953fe1d9a7a6c8b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:02.529076 13992 tablet_bootstrap.cc:492] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad: Bootstrap starting.
I20260207 20:54:02.535120 13992 tablet_bootstrap.cc:654] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:02.535967 13859 tablet_service.cc:1505] Processing CreateTablet for tablet f4b88e33e5cd499b8ca8c99845e46214 (DEFAULT_TABLE table=ksck-test-table [id=01b15177eb8646f188fa51d15ed2de92]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:02.537388 13857 tablet_service.cc:1505] Processing CreateTablet for tablet 79e2bce1607744fb953fe1d9a7a6c8b1 (DEFAULT_TABLE table=ksck-test-table [id=01b15177eb8646f188fa51d15ed2de92]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:02.536175 13858 tablet_service.cc:1505] Processing CreateTablet for tablet 058efef8bfbf4e139f13539841d86bc1 (DEFAULT_TABLE table=ksck-test-table [id=01b15177eb8646f188fa51d15ed2de92]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:02.537360 13859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b88e33e5cd499b8ca8c99845e46214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:02.540354 13858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 058efef8bfbf4e139f13539841d86bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:02.545964 13857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e2bce1607744fb953fe1d9a7a6c8b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:02.562147 13992 tablet_bootstrap.cc:492] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad: No bootstrap required, opened a new log
I20260207 20:54:02.562417 13994 tablet_bootstrap.cc:492] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139: Bootstrap starting.
I20260207 20:54:02.562815 13992 ts_tablet_manager.cc:1403] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad: Time spent bootstrapping tablet: real 0.034s user 0.009s sys 0.002s
I20260207 20:54:02.566016 13992 raft_consensus.cc:359] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:02.566753 13992 raft_consensus.cc:385] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:02.567040 13992 raft_consensus.cc:740] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 542eb8927ed64630919282d6adcfc7ad, State: Initialized, Role: FOLLOWER
I20260207 20:54:02.568059 13992 consensus_queue.cc:260] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:02.576798 13992 ts_tablet_manager.cc:1434] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad: Time spent starting tablet: real 0.013s user 0.009s sys 0.001s
I20260207 20:54:02.578013 13992 tablet_bootstrap.cc:492] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad: Bootstrap starting.
I20260207 20:54:02.584061 13992 tablet_bootstrap.cc:654] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:02.588563 13994 tablet_bootstrap.cc:654] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:02.593856 13994 tablet_bootstrap.cc:492] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139: No bootstrap required, opened a new log
I20260207 20:54:02.594487 13994 ts_tablet_manager.cc:1403] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.000s
I20260207 20:54:02.610026 13994 raft_consensus.cc:359] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } }
I20260207 20:54:02.610802 13994 raft_consensus.cc:385] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:02.611109 13994 raft_consensus.cc:740] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb45c021af04eefa6ee49ecbc1a6139, State: Initialized, Role: FOLLOWER
I20260207 20:54:02.611892 13994 consensus_queue.cc:260] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } }
I20260207 20:54:02.644548 13998 tablet_bootstrap.cc:492] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a: Bootstrap starting.
I20260207 20:54:02.666337 13998 tablet_bootstrap.cc:654] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:02.668825 13992 tablet_bootstrap.cc:492] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad: No bootstrap required, opened a new log
I20260207 20:54:02.669453 13992 ts_tablet_manager.cc:1403] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad: Time spent bootstrapping tablet: real 0.092s user 0.028s sys 0.061s
I20260207 20:54:02.670346 13994 ts_tablet_manager.cc:1434] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139: Time spent starting tablet: real 0.075s user 0.006s sys 0.008s
I20260207 20:54:02.671504 13994 tablet_bootstrap.cc:492] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139: Bootstrap starting.
I20260207 20:54:02.672462 13992 raft_consensus.cc:359] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } }
I20260207 20:54:02.676393 13992 raft_consensus.cc:385] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:02.676751 13992 raft_consensus.cc:740] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 542eb8927ed64630919282d6adcfc7ad, State: Initialized, Role: FOLLOWER
I20260207 20:54:02.677628 13992 consensus_queue.cc:260] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } }
I20260207 20:54:02.679965 13992 ts_tablet_manager.cc:1434] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260207 20:54:02.681779 13992 tablet_bootstrap.cc:492] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad: Bootstrap starting.
I20260207 20:54:02.687924 13992 tablet_bootstrap.cc:654] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:02.693285 13994 tablet_bootstrap.cc:654] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:02.702710 13995 raft_consensus.cc:493] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:02.703276 13995 raft_consensus.cc:515] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:02.705832 13995 leader_election.cc:290] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959), 4bb45c021af04eefa6ee49ecbc1a6139 (127.2.223.2:37905)
I20260207 20:54:02.706352 13995 raft_consensus.cc:493] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:02.721836 13995 raft_consensus.cc:515] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } }
I20260207 20:54:02.723803 13995 leader_election.cc:290] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb45c021af04eefa6ee49ecbc1a6139 (127.2.223.2:37905), 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959)
I20260207 20:54:02.745159 13869 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79e2bce1607744fb953fe1d9a7a6c8b1" candidate_uuid: "542eb8927ed64630919282d6adcfc7ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" is_pre_election: true
I20260207 20:54:02.746716 13868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4b88e33e5cd499b8ca8c99845e46214" candidate_uuid: "542eb8927ed64630919282d6adcfc7ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" is_pre_election: true
I20260207 20:54:02.747484 13868 raft_consensus.cc:2468] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 542eb8927ed64630919282d6adcfc7ad in term 0.
W20260207 20:54:02.748847 13913 leader_election.cc:343] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb45c021af04eefa6ee49ecbc1a6139 (127.2.223.2:37905): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:54:02.749584 13913 leader_election.cc:304] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb45c021af04eefa6ee49ecbc1a6139, 542eb8927ed64630919282d6adcfc7ad; no voters:
I20260207 20:54:02.750763 13995 raft_consensus.cc:2804] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:02.751168 13995 raft_consensus.cc:493] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:02.751500 13995 raft_consensus.cc:3060] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:02.746749 13998 tablet_bootstrap.cc:492] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a: No bootstrap required, opened a new log
I20260207 20:54:02.755230 13998 ts_tablet_manager.cc:1403] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a: Time spent bootstrapping tablet: real 0.111s user 0.025s sys 0.015s
I20260207 20:54:02.755841 13782 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4b88e33e5cd499b8ca8c99845e46214" candidate_uuid: "542eb8927ed64630919282d6adcfc7ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58243639a0c64a6181be8287a01dfc5a" is_pre_election: true
I20260207 20:54:02.757923 13994 tablet_bootstrap.cc:492] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139: No bootstrap required, opened a new log
I20260207 20:54:02.758428 13994 ts_tablet_manager.cc:1403] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139: Time spent bootstrapping tablet: real 0.087s user 0.006s sys 0.007s
I20260207 20:54:02.758217 13998 raft_consensus.cc:359] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:02.758942 13998 raft_consensus.cc:385] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:02.759263 13998 raft_consensus.cc:740] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58243639a0c64a6181be8287a01dfc5a, State: Initialized, Role: FOLLOWER
I20260207 20:54:02.754992 13783 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79e2bce1607744fb953fe1d9a7a6c8b1" candidate_uuid: "542eb8927ed64630919282d6adcfc7ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58243639a0c64a6181be8287a01dfc5a" is_pre_election: true
I20260207 20:54:02.759939 13998 consensus_queue.cc:260] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:02.761633 13994 raft_consensus.cc:359] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:02.763414 13992 tablet_bootstrap.cc:492] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad: No bootstrap required, opened a new log
I20260207 20:54:02.763944 13992 ts_tablet_manager.cc:1403] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad: Time spent bootstrapping tablet: real 0.082s user 0.015s sys 0.030s
W20260207 20:54:02.764734 13912 leader_election.cc:343] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959): Illegal state: must be running to vote when last-logged opid is not known
W20260207 20:54:02.765815 13912 leader_election.cc:343] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:54:02.766292 13912 leader_election.cc:304] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 542eb8927ed64630919282d6adcfc7ad; no voters: 4bb45c021af04eefa6ee49ecbc1a6139, 58243639a0c64a6181be8287a01dfc5a
I20260207 20:54:02.766913 13992 raft_consensus.cc:359] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:02.767699 13992 raft_consensus.cc:385] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:02.768020 13992 raft_consensus.cc:740] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 542eb8927ed64630919282d6adcfc7ad, State: Initialized, Role: FOLLOWER
I20260207 20:54:02.768735 13992 consensus_queue.cc:260] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:02.770946 14005 raft_consensus.cc:2749] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:54:02.772716 13992 ts_tablet_manager.cc:1434] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad: Time spent starting tablet: real 0.008s user 0.002s sys 0.004s
I20260207 20:54:02.778931 13995 raft_consensus.cc:515] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } }
I20260207 20:54:02.781023 13995 leader_election.cc:290] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [CANDIDATE]: Term 1 election: Requested vote from peers 4bb45c021af04eefa6ee49ecbc1a6139 (127.2.223.2:37905), 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959)
I20260207 20:54:02.782759 13726 catalog_manager.cc:1269] Loaded cluster ID: 7b19946829a743ef8b966297736fa123
I20260207 20:54:02.783203 13726 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06: loading cluster ID for follower catalog manager: success
I20260207 20:54:02.783093 13868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4b88e33e5cd499b8ca8c99845e46214" candidate_uuid: "542eb8927ed64630919282d6adcfc7ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb45c021af04eefa6ee49ecbc1a6139"
I20260207 20:54:02.783942 13868 raft_consensus.cc:3060] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:02.787613 13783 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4b88e33e5cd499b8ca8c99845e46214" candidate_uuid: "542eb8927ed64630919282d6adcfc7ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58243639a0c64a6181be8287a01dfc5a"
I20260207 20:54:02.791429 13726 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06: acquiring CA information for follower catalog manager: success
I20260207 20:54:02.794612 13868 raft_consensus.cc:2468] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 542eb8927ed64630919282d6adcfc7ad in term 1.
W20260207 20:54:02.795094 13912 leader_election.cc:343] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:54:02.795814 13913 leader_election.cc:304] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb45c021af04eefa6ee49ecbc1a6139, 542eb8927ed64630919282d6adcfc7ad; no voters: 58243639a0c64a6181be8287a01dfc5a
I20260207 20:54:02.796677 13995 raft_consensus.cc:2804] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:02.797173 13995 raft_consensus.cc:697] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [term 1 LEADER]: Becoming Leader. State: Replica: 542eb8927ed64630919282d6adcfc7ad, State: Running, Role: LEADER
I20260207 20:54:02.798015 13995 consensus_queue.cc:237] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } }
I20260207 20:54:02.796887 13726 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:54:02.800995 13994 raft_consensus.cc:385] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:02.801484 13994 raft_consensus.cc:740] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb45c021af04eefa6ee49ecbc1a6139, State: Initialized, Role: FOLLOWER
I20260207 20:54:02.783136 13732 catalog_manager.cc:1269] Loaded cluster ID: 7b19946829a743ef8b966297736fa123
I20260207 20:54:02.804459 13732 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021: loading cluster ID for follower catalog manager: success
I20260207 20:54:02.805016 13994 consensus_queue.cc:260] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:02.808090 13994 ts_tablet_manager.cc:1434] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139: Time spent starting tablet: real 0.049s user 0.003s sys 0.004s
I20260207 20:54:02.809365 13994 tablet_bootstrap.cc:492] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139: Bootstrap starting.
I20260207 20:54:02.811376 13998 ts_tablet_manager.cc:1434] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a: Time spent starting tablet: real 0.056s user 0.022s sys 0.016s
I20260207 20:54:02.812458 13998 tablet_bootstrap.cc:492] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a: Bootstrap starting.
I20260207 20:54:02.818826 13998 tablet_bootstrap.cc:654] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:02.819252 13999 raft_consensus.cc:493] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:02.820611 13999 raft_consensus.cc:515] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:02.819667 13994 tablet_bootstrap.cc:654] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:02.823238 13999 leader_election.cc:290] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959), 542eb8927ed64630919282d6adcfc7ad (127.2.223.3:36833)
I20260207 20:54:02.828250 13732 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021: acquiring CA information for follower catalog manager: success
I20260207 20:54:02.844745 13732 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:54:02.854444 13994 tablet_bootstrap.cc:492] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139: No bootstrap required, opened a new log
I20260207 20:54:02.855767 13994 ts_tablet_manager.cc:1403] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139: Time spent bootstrapping tablet: real 0.047s user 0.013s sys 0.002s
I20260207 20:54:02.864950 13994 raft_consensus.cc:359] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:02.865790 13994 raft_consensus.cc:385] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:02.866132 13994 raft_consensus.cc:740] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb45c021af04eefa6ee49ecbc1a6139, State: Initialized, Role: FOLLOWER
I20260207 20:54:02.868913 13994 consensus_queue.cc:260] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:02.872231 13947 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "058efef8bfbf4e139f13539841d86bc1" candidate_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "542eb8927ed64630919282d6adcfc7ad" is_pre_election: true
I20260207 20:54:02.872984 13947 raft_consensus.cc:2468] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb45c021af04eefa6ee49ecbc1a6139 in term 0.
I20260207 20:54:02.874424 13833 leader_election.cc:304] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb45c021af04eefa6ee49ecbc1a6139, 542eb8927ed64630919282d6adcfc7ad; no voters:
I20260207 20:54:02.874542 13783 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "058efef8bfbf4e139f13539841d86bc1" candidate_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58243639a0c64a6181be8287a01dfc5a" is_pre_election: true
I20260207 20:54:02.875211 13783 raft_consensus.cc:2468] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb45c021af04eefa6ee49ecbc1a6139 in term 0.
I20260207 20:54:02.876109 13999 raft_consensus.cc:2804] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:02.876542 13999 raft_consensus.cc:493] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:02.876899 13999 raft_consensus.cc:3060] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:02.883505 13994 ts_tablet_manager.cc:1434] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139: Time spent starting tablet: real 0.027s user 0.005s sys 0.003s
I20260207 20:54:02.884971 13999 raft_consensus.cc:515] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:02.895216 13783 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "058efef8bfbf4e139f13539841d86bc1" candidate_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58243639a0c64a6181be8287a01dfc5a"
I20260207 20:54:02.895961 13783 raft_consensus.cc:3060] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:02.915786 13783 raft_consensus.cc:2468] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb45c021af04eefa6ee49ecbc1a6139 in term 1.
I20260207 20:54:02.917099 13834 leader_election.cc:304] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb45c021af04eefa6ee49ecbc1a6139, 58243639a0c64a6181be8287a01dfc5a; no voters:
I20260207 20:54:02.919868 13947 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "058efef8bfbf4e139f13539841d86bc1" candidate_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "542eb8927ed64630919282d6adcfc7ad"
I20260207 20:54:02.920603 13947 raft_consensus.cc:3060] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:02.934091 13999 leader_election.cc:290] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [CANDIDATE]: Term 1 election: Requested vote from peers 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959), 542eb8927ed64630919282d6adcfc7ad (127.2.223.3:36833)
I20260207 20:54:02.934896 13999 raft_consensus.cc:2804] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:02.935424 13999 raft_consensus.cc:697] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb45c021af04eefa6ee49ecbc1a6139, State: Running, Role: LEADER
I20260207 20:54:02.940331 13947 raft_consensus.cc:2468] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb45c021af04eefa6ee49ecbc1a6139 in term 1.
I20260207 20:54:02.936340 13999 consensus_queue.cc:237] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:02.964560 13588 catalog_manager.cc:5654] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb45c021af04eefa6ee49ecbc1a6139 (127.2.223.2). New cstate: current_term: 1 leader_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260207 20:54:02.977725 13998 tablet_bootstrap.cc:492] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a: No bootstrap required, opened a new log
I20260207 20:54:02.981505 13998 ts_tablet_manager.cc:1403] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a: Time spent bootstrapping tablet: real 0.169s user 0.056s sys 0.095s
I20260207 20:54:02.980077 13587 catalog_manager.cc:5654] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 542eb8927ed64630919282d6adcfc7ad (127.2.223.3). New cstate: current_term: 1 leader_uuid: "542eb8927ed64630919282d6adcfc7ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } health_report { overall_health: UNKNOWN } } }
I20260207 20:54:02.987282 13998 raft_consensus.cc:359] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } }
I20260207 20:54:02.988108 13998 raft_consensus.cc:385] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:02.988410 13998 raft_consensus.cc:740] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58243639a0c64a6181be8287a01dfc5a, State: Initialized, Role: FOLLOWER
I20260207 20:54:02.989214 13998 consensus_queue.cc:260] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } }
I20260207 20:54:02.991823 13998 ts_tablet_manager.cc:1434] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a: Time spent starting tablet: real 0.010s user 0.005s sys 0.001s
I20260207 20:54:02.992841 13998 tablet_bootstrap.cc:492] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a: Bootstrap starting.
I20260207 20:54:02.999191 13998 tablet_bootstrap.cc:654] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:03.030382 13999 raft_consensus.cc:493] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:03.031075 13999 raft_consensus.cc:515] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:03.033283 13999 leader_election.cc:290] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959), 542eb8927ed64630919282d6adcfc7ad (127.2.223.3:36833)
I20260207 20:54:03.035646 13783 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79e2bce1607744fb953fe1d9a7a6c8b1" candidate_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58243639a0c64a6181be8287a01dfc5a" is_pre_election: true
W20260207 20:54:03.037277 13834 leader_election.cc:343] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:54:03.037544 13947 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79e2bce1607744fb953fe1d9a7a6c8b1" candidate_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "542eb8927ed64630919282d6adcfc7ad" is_pre_election: true
I20260207 20:54:03.038357 13947 raft_consensus.cc:2468] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb45c021af04eefa6ee49ecbc1a6139 in term 0.
I20260207 20:54:03.042222 13833 leader_election.cc:304] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb45c021af04eefa6ee49ecbc1a6139, 542eb8927ed64630919282d6adcfc7ad; no voters: 58243639a0c64a6181be8287a01dfc5a
I20260207 20:54:03.044101 13999 raft_consensus.cc:2804] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:03.044562 13999 raft_consensus.cc:493] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:03.044931 13999 raft_consensus.cc:3060] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:03.080760 13999 raft_consensus.cc:515] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:03.083611 13783 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79e2bce1607744fb953fe1d9a7a6c8b1" candidate_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58243639a0c64a6181be8287a01dfc5a"
I20260207 20:54:03.084303 13947 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79e2bce1607744fb953fe1d9a7a6c8b1" candidate_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "542eb8927ed64630919282d6adcfc7ad"
I20260207 20:54:03.084939 13947 raft_consensus.cc:3060] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:03.085536 14004 raft_consensus.cc:493] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:03.086092 14004 raft_consensus.cc:515] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } }
I20260207 20:54:03.088616 14004 leader_election.cc:290] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 542eb8927ed64630919282d6adcfc7ad (127.2.223.3:36833), 4bb45c021af04eefa6ee49ecbc1a6139 (127.2.223.2:37905)
W20260207 20:54:03.084969 13834 leader_election.cc:343] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:54:03.099560 13947 raft_consensus.cc:2468] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb45c021af04eefa6ee49ecbc1a6139 in term 1.
I20260207 20:54:03.100742 13998 tablet_bootstrap.cc:492] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a: No bootstrap required, opened a new log
I20260207 20:54:03.101203 13833 leader_election.cc:304] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb45c021af04eefa6ee49ecbc1a6139, 542eb8927ed64630919282d6adcfc7ad; no voters: 58243639a0c64a6181be8287a01dfc5a
I20260207 20:54:03.102339 14011 raft_consensus.cc:2804] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:03.101352 13998 ts_tablet_manager.cc:1403] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a: Time spent bootstrapping tablet: real 0.109s user 0.044s sys 0.054s
I20260207 20:54:03.106357 14011 raft_consensus.cc:697] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb45c021af04eefa6ee49ecbc1a6139, State: Running, Role: LEADER
I20260207 20:54:03.107486 14011 consensus_queue.cc:237] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:03.109681 13998 raft_consensus.cc:359] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:03.110474 13998 raft_consensus.cc:385] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:03.110795 13998 raft_consensus.cc:740] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58243639a0c64a6181be8287a01dfc5a, State: Initialized, Role: FOLLOWER
I20260207 20:54:03.111732 13998 consensus_queue.cc:260] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:03.113976 13998 ts_tablet_manager.cc:1434] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260207 20:54:03.100102 13999 leader_election.cc:290] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [CANDIDATE]: Term 1 election: Requested vote from peers 58243639a0c64a6181be8287a01dfc5a (127.2.223.1:43959), 542eb8927ed64630919282d6adcfc7ad (127.2.223.3:36833)
I20260207 20:54:03.123380 13587 catalog_manager.cc:5654] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb45c021af04eefa6ee49ecbc1a6139 (127.2.223.2). New cstate: current_term: 1 leader_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } health_report { overall_health: UNKNOWN } } }
I20260207 20:54:03.130669 13947 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4b88e33e5cd499b8ca8c99845e46214" candidate_uuid: "58243639a0c64a6181be8287a01dfc5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "542eb8927ed64630919282d6adcfc7ad" is_pre_election: true
I20260207 20:54:03.132341 13868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4b88e33e5cd499b8ca8c99845e46214" candidate_uuid: "58243639a0c64a6181be8287a01dfc5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" is_pre_election: true
I20260207 20:54:03.133055 13868 raft_consensus.cc:2393] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58243639a0c64a6181be8287a01dfc5a in current term 1: Already voted for candidate 542eb8927ed64630919282d6adcfc7ad in this term.
I20260207 20:54:03.135402 13745 leader_election.cc:304] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58243639a0c64a6181be8287a01dfc5a; no voters: 4bb45c021af04eefa6ee49ecbc1a6139, 542eb8927ed64630919282d6adcfc7ad
I20260207 20:54:03.136256 14004 raft_consensus.cc:3060] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:03.146262 14004 raft_consensus.cc:2749] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:54:03.203612 14004 raft_consensus.cc:493] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:03.204075 14004 raft_consensus.cc:515] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 } } peers { permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 } } peers { permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 } }
I20260207 20:54:03.207196 13947 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79e2bce1607744fb953fe1d9a7a6c8b1" candidate_uuid: "58243639a0c64a6181be8287a01dfc5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "542eb8927ed64630919282d6adcfc7ad" is_pre_election: true
I20260207 20:54:03.207950 13947 raft_consensus.cc:2393] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58243639a0c64a6181be8287a01dfc5a in current term 1: Already voted for candidate 4bb45c021af04eefa6ee49ecbc1a6139 in this term.
I20260207 20:54:03.208784 13868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79e2bce1607744fb953fe1d9a7a6c8b1" candidate_uuid: "58243639a0c64a6181be8287a01dfc5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" is_pre_election: true
I20260207 20:54:03.210698 14004 leader_election.cc:290] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb45c021af04eefa6ee49ecbc1a6139 (127.2.223.2:37905), 542eb8927ed64630919282d6adcfc7ad (127.2.223.3:36833)
I20260207 20:54:03.212194 13745 leader_election.cc:304] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58243639a0c64a6181be8287a01dfc5a; no voters: 4bb45c021af04eefa6ee49ecbc1a6139, 542eb8927ed64630919282d6adcfc7ad
I20260207 20:54:03.213044 14004 raft_consensus.cc:3060] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:03.218540 14004 raft_consensus.cc:2749] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:54:03.264634 13995 consensus_queue.cc:1048] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:03.340950 14005 consensus_queue.cc:1048] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb45c021af04eefa6ee49ecbc1a6139" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:03.367411 14011 consensus_queue.cc:1048] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [LEADER]: Connected to new peer: Peer: permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:03.442495 14011 consensus_queue.cc:1048] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:03.545081 14011 consensus_queue.cc:1048] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58243639a0c64a6181be8287a01dfc5a" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 43959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:03.570125 13999 consensus_queue.cc:1048] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [LEADER]: Connected to new peer: Peer: permanent_uuid: "542eb8927ed64630919282d6adcfc7ad" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:03.973487 13935 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:54:03.983821 13857 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260207 20:54:04.048346 13770 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:54:04.365247 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:54:04.408058 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:04.408603 2940 tablet_replica.cc:333] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a: stopping tablet replica
I20260207 20:54:04.409152 2940 raft_consensus.cc:2243] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:04.409552 2940 raft_consensus.cc:2272] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 58243639a0c64a6181be8287a01dfc5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:04.411994 2940 tablet_replica.cc:333] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a: stopping tablet replica
I20260207 20:54:04.412676 2940 raft_consensus.cc:2243] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:04.413170 2940 raft_consensus.cc:2272] T f4b88e33e5cd499b8ca8c99845e46214 P 58243639a0c64a6181be8287a01dfc5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:04.415385 2940 tablet_replica.cc:333] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a: stopping tablet replica
I20260207 20:54:04.416010 2940 raft_consensus.cc:2243] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:04.416404 2940 raft_consensus.cc:2272] T 058efef8bfbf4e139f13539841d86bc1 P 58243639a0c64a6181be8287a01dfc5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:04.441612 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:54:04.460175 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:54:04.486968 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:04.487535 2940 tablet_replica.cc:333] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139: stopping tablet replica
I20260207 20:54:04.488063 2940 raft_consensus.cc:2243] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:04.488780 2940 raft_consensus.cc:2272] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:04.491196 2940 tablet_replica.cc:333] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139: stopping tablet replica
I20260207 20:54:04.491724 2940 raft_consensus.cc:2243] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:04.492344 2940 raft_consensus.cc:2272] T 058efef8bfbf4e139f13539841d86bc1 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:04.494362 2940 tablet_replica.cc:333] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139: stopping tablet replica
I20260207 20:54:04.495024 2940 raft_consensus.cc:2243] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:04.495494 2940 raft_consensus.cc:2272] T f4b88e33e5cd499b8ca8c99845e46214 P 4bb45c021af04eefa6ee49ecbc1a6139 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:04.517997 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:54:04.531252 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:54:04.556994 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:04.557555 2940 tablet_replica.cc:333] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad: stopping tablet replica
I20260207 20:54:04.558091 2940 raft_consensus.cc:2243] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:04.558521 2940 raft_consensus.cc:2272] T 058efef8bfbf4e139f13539841d86bc1 P 542eb8927ed64630919282d6adcfc7ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:04.560439 2940 tablet_replica.cc:333] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad: stopping tablet replica
I20260207 20:54:04.560897 2940 raft_consensus.cc:2243] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:04.561662 2940 raft_consensus.cc:2272] T f4b88e33e5cd499b8ca8c99845e46214 P 542eb8927ed64630919282d6adcfc7ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:04.563448 2940 tablet_replica.cc:333] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad: stopping tablet replica
I20260207 20:54:04.563876 2940 raft_consensus.cc:2243] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:04.564245 2940 raft_consensus.cc:2272] T 79e2bce1607744fb953fe1d9a7a6c8b1 P 542eb8927ed64630919282d6adcfc7ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:04.584426 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:54:04.596511 2940 master.cc:561] Master@127.2.223.62:40311 shutting down...
I20260207 20:54:04.614141 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:04.614703 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:04.615005 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0b97a14f197f4094bff999da22316f06: stopping tablet replica
I20260207 20:54:04.633333 2940 master.cc:583] Master@127.2.223.62:40311 shutdown complete.
I20260207 20:54:04.644757 2940 master.cc:561] Master@127.2.223.61:35593 shutting down...
I20260207 20:54:04.659515 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:04.660401 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:04.660723 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P a6e0a29be0be4932a2ffda79bbd48e06: stopping tablet replica
I20260207 20:54:04.680277 2940 master.cc:583] Master@127.2.223.61:35593 shutdown complete.
I20260207 20:54:04.692085 2940 master.cc:561] Master@127.2.223.60:33863 shutting down...
I20260207 20:54:04.709205 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:04.709731 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:04.710029 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4a0fe3bae03649a194dc7141a7e3f021: stopping tablet replica
I20260207 20:54:04.728106 2940 master.cc:583] Master@127.2.223.60:33863 shutdown complete.
[ OK ] RemoteKsckTest.TestTableFiltersNoMatch (3320 ms)
[ RUN ] RemoteKsckTest.TestTableFilters
I20260207 20:54:04.756899 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:35569,127.2.223.61:38335,127.2.223.60:37361
I20260207 20:54:04.758191 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:04.762820 14076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:04.763065 14077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:04.764416 14079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:04.765288 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:04.765985 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:04.766251 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:04.766426 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497644766410 us; error 0 us; skew 500 ppm
I20260207 20:54:04.766991 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:04.769207 2940 webserver.cc:492] Webserver started at http://127.2.223.62:34567/ using document root <none> and password file <none>
I20260207 20:54:04.769641 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:04.769814 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:04.770064 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:04.771176 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9"
format_stamp: "Formatted at 2026-02-07 20:54:04 on dist-test-slave-kqw4"
I20260207 20:54:04.775357 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260207 20:54:04.778416 14084 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:04.779143 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:54:04.779407 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9"
format_stamp: "Formatted at 2026-02-07 20:54:04 on dist-test-slave-kqw4"
I20260207 20:54:04.779657 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:04.793989 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:04.794987 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:04.828644 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:35569
I20260207 20:54:04.828737 14135 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:35569 every 8 connection(s)
I20260207 20:54:04.832333 14136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:04.832479 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:04.837608 14138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:04.839394 14139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:04.840106 14136 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:54:04.841938 14141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:04.843454 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:04.844297 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:04.844481 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:04.844645 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497644844625 us; error 0 us; skew 500 ppm
I20260207 20:54:04.845175 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:04.847692 2940 webserver.cc:492] Webserver started at http://127.2.223.61:33049/ using document root <none> and password file <none>
I20260207 20:54:04.848284 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:04.848512 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:04.848834 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:04.850221 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "57d25f06d55a401cbf9518fc2f95c0a2"
format_stamp: "Formatted at 2026-02-07 20:54:04 on dist-test-slave-kqw4"
I20260207 20:54:04.853868 14136 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:04.855082 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260207 20:54:04.859230 14149 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20260207 20:54:04.859256 14136 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:38335: Network error: Client connection negotiation failed: client connection to 127.2.223.61:38335: connect: Connection refused (error 111)
I20260207 20:54:04.860123 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260207 20:54:04.860411 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "57d25f06d55a401cbf9518fc2f95c0a2"
format_stamp: "Formatted at 2026-02-07 20:54:04 on dist-test-slave-kqw4"
I20260207 20:54:04.860664 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:04.877099 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:04.878127 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:04.897861 14136 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } attempt: 1
W20260207 20:54:04.902849 14136 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:38335: Network error: Client connection negotiation failed: client connection to 127.2.223.61:38335: connect: Connection refused (error 111)
I20260207 20:54:04.915103 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:38335
I20260207 20:54:04.915215 14200 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:38335 every 8 connection(s)
I20260207 20:54:04.918751 14201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:04.918872 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:04.924610 14203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:04.924825 14204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:04.926299 14201 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:54:04.929471 14206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:04.929911 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:04.930910 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:04.931185 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:04.931385 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497644931364 us; error 0 us; skew 500 ppm
I20260207 20:54:04.932150 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:04.935047 2940 webserver.cc:492] Webserver started at http://127.2.223.60:34199/ using document root <none> and password file <none>
I20260207 20:54:04.935622 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:04.935880 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:04.936201 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:04.936343 14136 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } attempt: 2
I20260207 20:54:04.937492 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967"
format_stamp: "Formatted at 2026-02-07 20:54:04 on dist-test-slave-kqw4"
I20260207 20:54:04.939452 14201 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:04.947009 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.009s user 0.005s sys 0.007s
I20260207 20:54:04.948701 14136 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:04.951134 14215 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:04.952103 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260207 20:54:04.952428 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967"
format_stamp: "Formatted at 2026-02-07 20:54:04 on dist-test-slave-kqw4"
I20260207 20:54:04.952725 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:54:04.954198 14136 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:37361: Network error: Client connection negotiation failed: client connection to 127.2.223.60:37361: connect: Connection refused (error 111)
I20260207 20:54:04.955983 14201 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:54:04.961884 14201 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:37361: Network error: Client connection negotiation failed: client connection to 127.2.223.60:37361: connect: Connection refused (error 111)
I20260207 20:54:04.980419 14201 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } attempt: 1
I20260207 20:54:04.984089 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
W20260207 20:54:04.984848 14201 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:37361: Network error: Client connection negotiation failed: client connection to 127.2.223.60:37361: connect: Connection refused (error 111)
I20260207 20:54:04.985263 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:05.011706 14136 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } attempt: 1
W20260207 20:54:05.016465 14136 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:37361: Network error: Client connection negotiation failed: client connection to 127.2.223.60:37361: connect: Connection refused (error 111)
I20260207 20:54:05.021072 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:37361
I20260207 20:54:05.021169 14267 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:37361 every 8 connection(s)
I20260207 20:54:05.023986 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:54:05.024989 14268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:05.027360 14201 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } attempt: 2
I20260207 20:54:05.032652 14268 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:05.045181 14268 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:05.045657 14201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2: Bootstrap starting.
I20260207 20:54:05.050992 14201 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:05.053996 14136 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } attempt: 2
I20260207 20:54:05.056039 14201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2: No bootstrap required, opened a new log
I20260207 20:54:05.055964 14268 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:05.059370 14201 raft_consensus.cc:359] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:05.060233 14201 raft_consensus.cc:385] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:05.060581 14201 raft_consensus.cc:740] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57d25f06d55a401cbf9518fc2f95c0a2, State: Initialized, Role: FOLLOWER
I20260207 20:54:05.061832 14201 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:05.071907 14136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9: Bootstrap starting.
I20260207 20:54:05.074296 14274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } } }
I20260207 20:54:05.075173 14274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:05.076143 14201 sys_catalog.cc:565] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:54:05.076821 14136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:05.081915 14136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9: No bootstrap required, opened a new log
I20260207 20:54:05.084209 14268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967: Bootstrap starting.
I20260207 20:54:05.084399 14136 raft_consensus.cc:359] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:05.085103 14136 raft_consensus.cc:385] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:05.085386 14136 raft_consensus.cc:740] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07b2c5ec4f7049a1af8e6107e6ad21b9, State: Initialized, Role: FOLLOWER
I20260207 20:54:05.086179 14136 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:05.088953 14281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } } }
I20260207 20:54:05.089774 14281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:05.090649 14268 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:05.090579 14136 sys_catalog.cc:565] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:54:05.099376 14268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967: No bootstrap required, opened a new log
I20260207 20:54:05.101504 14268 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:05.101991 14268 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:05.102222 14268 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d67b2a8ab894bc6bd36dbfe7c2db967, State: Initialized, Role: FOLLOWER
I20260207 20:54:05.102788 14268 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:05.108351 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:54:05.108832 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:54:05.109383 14294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } } }
I20260207 20:54:05.110255 14294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:05.111102 14268 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [sys.catalog]: configured and running, proceeding with master startup.
W20260207 20:54:05.112741 14300 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:05.113047 14295 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:05.113106 14300 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:54:05.113520 14295 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:54:05.122157 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:05.124032 14311 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:05.124346 14311 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:54:05.128465 14312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:05.128757 14313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:05.131050 14315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:05.131193 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:05.132050 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:05.132251 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:05.132411 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497645132393 us; error 0 us; skew 500 ppm
I20260207 20:54:05.132885 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:05.135250 2940 webserver.cc:492] Webserver started at http://127.2.223.1:40557/ using document root <none> and password file <none>
I20260207 20:54:05.135685 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:05.135866 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:05.136101 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:05.137092 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "f11703b4cd5049afb15d3a62b97d22fa"
format_stamp: "Formatted at 2026-02-07 20:54:05 on dist-test-slave-kqw4"
I20260207 20:54:05.141187 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260207 20:54:05.144325 14320 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:05.145066 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260207 20:54:05.145339 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "f11703b4cd5049afb15d3a62b97d22fa"
format_stamp: "Formatted at 2026-02-07 20:54:05 on dist-test-slave-kqw4"
I20260207 20:54:05.145589 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:05.161283 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:05.162359 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:05.163748 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:05.165879 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:05.166060 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:05.166286 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:05.166427 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:05.202323 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:37611
I20260207 20:54:05.202422 14382 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:37611 every 8 connection(s)
I20260207 20:54:05.214375 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:54:05.226576 14383 heartbeater.cc:344] Connected to a master server at 127.2.223.60:37361
W20260207 20:54:05.226703 14390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:05.227108 14383 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:05.227993 14383 heartbeater.cc:507] Master 127.2.223.60:37361 requested a full tablet report, sending...
I20260207 20:54:05.229308 14384 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38335
I20260207 20:54:05.229684 14384 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:05.230561 14384 heartbeater.cc:507] Master 127.2.223.61:38335 requested a full tablet report, sending...
I20260207 20:54:05.230876 14233 ts_manager.cc:194] Registered new tserver with Master: f11703b4cd5049afb15d3a62b97d22fa (127.2.223.1:37611)
I20260207 20:54:05.233587 14166 ts_manager.cc:194] Registered new tserver with Master: f11703b4cd5049afb15d3a62b97d22fa (127.2.223.1:37611)
W20260207 20:54:05.235311 14391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:05.235531 14385 heartbeater.cc:344] Connected to a master server at 127.2.223.62:35569
I20260207 20:54:05.236104 14385 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:05.236781 14385 heartbeater.cc:507] Master 127.2.223.62:35569 requested a full tablet report, sending...
W20260207 20:54:05.237740 14393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:05.238513 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:05.239552 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260207 20:54:05.239511 14101 ts_manager.cc:194] Registered new tserver with Master: f11703b4cd5049afb15d3a62b97d22fa (127.2.223.1:37611)
W20260207 20:54:05.239979 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:05.240216 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497645240195 us; error 0 us; skew 500 ppm
I20260207 20:54:05.240916 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:05.243359 2940 webserver.cc:492] Webserver started at http://127.2.223.2:39051/ using document root <none> and password file <none>
I20260207 20:54:05.243814 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:05.243990 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:05.244231 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:05.245280 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "29471cd9f050440d9aad4d1165f19402"
format_stamp: "Formatted at 2026-02-07 20:54:05 on dist-test-slave-kqw4"
I20260207 20:54:05.249783 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:54:05.253504 14398 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:05.254462 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260207 20:54:05.254781 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "29471cd9f050440d9aad4d1165f19402"
format_stamp: "Formatted at 2026-02-07 20:54:05 on dist-test-slave-kqw4"
I20260207 20:54:05.255029 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:05.276463 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:05.277415 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:05.278800 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:05.290940 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:05.291219 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:05.291499 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:05.291702 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:05.330422 14294 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:05.331035 14294 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:05.332732 14281 raft_consensus.cc:493] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:05.333035 14294 leader_election.cc:290] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07b2c5ec4f7049a1af8e6107e6ad21b9 (127.2.223.62:35569), 57d25f06d55a401cbf9518fc2f95c0a2 (127.2.223.61:38335)
I20260207 20:54:05.333256 14281 raft_consensus.cc:515] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:05.334201 14274 raft_consensus.cc:493] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:05.334685 14274 raft_consensus.cc:515] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:05.334874 14111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" is_pre_election: true
I20260207 20:54:05.335628 14111 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d67b2a8ab894bc6bd36dbfe7c2db967 in term 0.
I20260207 20:54:05.336670 14274 leader_election.cc:290] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07b2c5ec4f7049a1af8e6107e6ad21b9 (127.2.223.62:35569), 0d67b2a8ab894bc6bd36dbfe7c2db967 (127.2.223.60:37361)
I20260207 20:54:05.336807 14175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" is_pre_election: true
I20260207 20:54:05.337422 14176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" is_pre_election: true
I20260207 20:54:05.337510 14175 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07b2c5ec4f7049a1af8e6107e6ad21b9 in term 0.
I20260207 20:54:05.338119 14216 leader_election.cc:304] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07b2c5ec4f7049a1af8e6107e6ad21b9, 0d67b2a8ab894bc6bd36dbfe7c2db967; no voters:
I20260207 20:54:05.338860 14085 leader_election.cc:304] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07b2c5ec4f7049a1af8e6107e6ad21b9, 57d25f06d55a401cbf9518fc2f95c0a2; no voters:
I20260207 20:54:05.339382 14111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" is_pre_election: true
I20260207 20:54:05.339973 14111 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57d25f06d55a401cbf9518fc2f95c0a2 in term 0.
I20260207 20:54:05.340256 14243 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" is_pre_election: true
I20260207 20:54:05.340857 14243 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07b2c5ec4f7049a1af8e6107e6ad21b9 in term 0.
I20260207 20:54:05.341681 14150 leader_election.cc:304] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07b2c5ec4f7049a1af8e6107e6ad21b9, 57d25f06d55a401cbf9518fc2f95c0a2; no voters:
I20260207 20:54:05.341919 14243 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" is_pre_election: true
I20260207 20:54:05.342481 14243 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57d25f06d55a401cbf9518fc2f95c0a2 in term 0.
I20260207 20:54:05.342579 14274 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:05.342973 14274 raft_consensus.cc:493] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:05.343313 14274 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:05.343124 14294 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:05.335165 14281 leader_election.cc:290] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57d25f06d55a401cbf9518fc2f95c0a2 (127.2.223.61:38335), 0d67b2a8ab894bc6bd36dbfe7c2db967 (127.2.223.60:37361)
I20260207 20:54:05.344442 14281 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:05.344772 14281 raft_consensus.cc:493] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:05.345081 14281 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:05.343858 14294 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:05.346371 14294 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:05.352913 14274 raft_consensus.cc:515] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:05.358306 14111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9"
I20260207 20:54:05.358577 14294 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:05.359361 14274 leader_election.cc:290] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [CANDIDATE]: Term 1 election: Requested vote from peers 07b2c5ec4f7049a1af8e6107e6ad21b9 (127.2.223.62:35569), 0d67b2a8ab894bc6bd36dbfe7c2db967 (127.2.223.60:37361)
I20260207 20:54:05.360486 14281 raft_consensus.cc:515] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:05.361141 14294 leader_election.cc:290] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [CANDIDATE]: Term 1 election: Requested vote from peers 07b2c5ec4f7049a1af8e6107e6ad21b9 (127.2.223.62:35569), 57d25f06d55a401cbf9518fc2f95c0a2 (127.2.223.61:38335)
I20260207 20:54:05.360390 14243 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967"
I20260207 20:54:05.363296 14175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57d25f06d55a401cbf9518fc2f95c0a2"
I20260207 20:54:05.363664 14111 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 57d25f06d55a401cbf9518fc2f95c0a2 in current term 1: Already voted for candidate 07b2c5ec4f7049a1af8e6107e6ad21b9 in this term.
I20260207 20:54:05.364005 14175 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d67b2a8ab894bc6bd36dbfe7c2db967 in current term 1: Already voted for candidate 57d25f06d55a401cbf9518fc2f95c0a2 in this term.
I20260207 20:54:05.367091 14110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9"
I20260207 20:54:05.367432 14175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57d25f06d55a401cbf9518fc2f95c0a2"
I20260207 20:54:05.363704 14243 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 57d25f06d55a401cbf9518fc2f95c0a2 in current term 1: Already voted for candidate 0d67b2a8ab894bc6bd36dbfe7c2db967 in this term.
I20260207 20:54:05.368163 14175 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 07b2c5ec4f7049a1af8e6107e6ad21b9 in current term 1: Already voted for candidate 57d25f06d55a401cbf9518fc2f95c0a2 in this term.
I20260207 20:54:05.366271 14281 leader_election.cc:290] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [CANDIDATE]: Term 1 election: Requested vote from peers 57d25f06d55a401cbf9518fc2f95c0a2 (127.2.223.61:38335), 0d67b2a8ab894bc6bd36dbfe7c2db967 (127.2.223.60:37361)
I20260207 20:54:05.367031 14242 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967"
I20260207 20:54:05.369665 14110 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d67b2a8ab894bc6bd36dbfe7c2db967 in current term 1: Already voted for candidate 07b2c5ec4f7049a1af8e6107e6ad21b9 in this term.
I20260207 20:54:05.369890 14242 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 07b2c5ec4f7049a1af8e6107e6ad21b9 in current term 1: Already voted for candidate 0d67b2a8ab894bc6bd36dbfe7c2db967 in this term.
I20260207 20:54:05.370836 14153 leader_election.cc:304] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57d25f06d55a401cbf9518fc2f95c0a2; no voters: 07b2c5ec4f7049a1af8e6107e6ad21b9, 0d67b2a8ab894bc6bd36dbfe7c2db967
I20260207 20:54:05.370980 14216 leader_election.cc:304] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d67b2a8ab894bc6bd36dbfe7c2db967; no voters: 07b2c5ec4f7049a1af8e6107e6ad21b9, 57d25f06d55a401cbf9518fc2f95c0a2
I20260207 20:54:05.371549 14274 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260207 20:54:05.371829 14294 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260207 20:54:05.372483 14088 leader_election.cc:304] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07b2c5ec4f7049a1af8e6107e6ad21b9; no voters: 0d67b2a8ab894bc6bd36dbfe7c2db967, 57d25f06d55a401cbf9518fc2f95c0a2
I20260207 20:54:05.373607 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:44443
I20260207 20:54:05.373729 14461 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:44443 every 8 connection(s)
I20260207 20:54:05.373919 14281 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260207 20:54:05.398185 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:54:05.404937 14462 heartbeater.cc:344] Connected to a master server at 127.2.223.60:37361
I20260207 20:54:05.405406 14462 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:05.407254 14462 heartbeater.cc:507] Master 127.2.223.60:37361 requested a full tablet report, sending...
I20260207 20:54:05.407317 14463 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38335
I20260207 20:54:05.407860 14463 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:05.408730 14463 heartbeater.cc:507] Master 127.2.223.61:38335 requested a full tablet report, sending...
I20260207 20:54:05.409291 14233 ts_manager.cc:194] Registered new tserver with Master: 29471cd9f050440d9aad4d1165f19402 (127.2.223.2:44443)
I20260207 20:54:05.413004 14165 ts_manager.cc:194] Registered new tserver with Master: 29471cd9f050440d9aad4d1165f19402 (127.2.223.2:44443)
W20260207 20:54:05.415524 14470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:05.417762 14469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:05.419498 14464 heartbeater.cc:344] Connected to a master server at 127.2.223.62:35569
I20260207 20:54:05.420010 14464 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:05.420917 14464 heartbeater.cc:507] Master 127.2.223.62:35569 requested a full tablet report, sending...
I20260207 20:54:05.423414 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:05.423583 14101 ts_manager.cc:194] Registered new tserver with Master: 29471cd9f050440d9aad4d1165f19402 (127.2.223.2:44443)
W20260207 20:54:05.423987 14472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:05.425182 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:05.425390 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:05.425530 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497645425516 us; error 0 us; skew 500 ppm
I20260207 20:54:05.426230 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:05.430308 2940 webserver.cc:492] Webserver started at http://127.2.223.3:38873/ using document root <none> and password file <none>
I20260207 20:54:05.430851 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:05.431034 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:05.431245 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:05.432467 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "e506f900f5f34e7bb20c368a8fc9594d"
format_stamp: "Formatted at 2026-02-07 20:54:05 on dist-test-slave-kqw4"
I20260207 20:54:05.437811 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260207 20:54:05.441715 14477 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:05.442657 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260207 20:54:05.443092 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "e506f900f5f34e7bb20c368a8fc9594d"
format_stamp: "Formatted at 2026-02-07 20:54:05 on dist-test-slave-kqw4"
I20260207 20:54:05.443374 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:05.460482 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:05.461759 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:05.463856 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:05.466291 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:05.466511 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:05.466780 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:05.466991 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:05.526093 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:39715
I20260207 20:54:05.526199 14539 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:39715 every 8 connection(s)
I20260207 20:54:05.555835 14540 heartbeater.cc:344] Connected to a master server at 127.2.223.60:37361
I20260207 20:54:05.556422 14540 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:05.558521 14540 heartbeater.cc:507] Master 127.2.223.60:37361 requested a full tablet report, sending...
I20260207 20:54:05.562222 14233 ts_manager.cc:194] Registered new tserver with Master: e506f900f5f34e7bb20c368a8fc9594d (127.2.223.3:39715)
I20260207 20:54:05.576759 14541 heartbeater.cc:344] Connected to a master server at 127.2.223.61:38335
I20260207 20:54:05.577183 14541 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:05.577935 14541 heartbeater.cc:507] Master 127.2.223.61:38335 requested a full tablet report, sending...
I20260207 20:54:05.578207 14543 heartbeater.cc:344] Connected to a master server at 127.2.223.62:35569
I20260207 20:54:05.578696 14543 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:05.579433 14543 heartbeater.cc:507] Master 127.2.223.62:35569 requested a full tablet report, sending...
I20260207 20:54:05.580327 14166 ts_manager.cc:194] Registered new tserver with Master: e506f900f5f34e7bb20c368a8fc9594d (127.2.223.3:39715)
I20260207 20:54:05.583112 14101 ts_manager.cc:194] Registered new tserver with Master: e506f900f5f34e7bb20c368a8fc9594d (127.2.223.3:39715)
I20260207 20:54:05.583772 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.022687861s
W20260207 20:54:06.118942 14300 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:06.119329 14300 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:54:06.122159 14295 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:06.122553 14295 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:54:06.128149 14311 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:06.128543 14311 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:54:07.122816 14300 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:07.125837 14300 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:54:07.126526 14295 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:07.127650 14295 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:54:07.132499 14311 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:07.132826 14311 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:54:07.174333 14555 raft_consensus.cc:493] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:07.174886 14555 raft_consensus.cc:515] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:07.176793 14555 leader_election.cc:290] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07b2c5ec4f7049a1af8e6107e6ad21b9 (127.2.223.62:35569), 0d67b2a8ab894bc6bd36dbfe7c2db967 (127.2.223.60:37361)
I20260207 20:54:07.177435 14110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" is_pre_election: true
I20260207 20:54:07.178100 14110 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57d25f06d55a401cbf9518fc2f95c0a2 in term 1.
I20260207 20:54:07.178241 14242 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" is_pre_election: true
I20260207 20:54:07.178947 14242 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57d25f06d55a401cbf9518fc2f95c0a2 in term 1.
I20260207 20:54:07.179908 14150 leader_election.cc:304] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07b2c5ec4f7049a1af8e6107e6ad21b9, 57d25f06d55a401cbf9518fc2f95c0a2; no voters:
I20260207 20:54:07.183583 14555 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260207 20:54:07.184003 14555 raft_consensus.cc:493] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:07.184383 14555 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:54:07.190003 14555 raft_consensus.cc:515] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:07.191566 14555 leader_election.cc:290] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [CANDIDATE]: Term 2 election: Requested vote from peers 07b2c5ec4f7049a1af8e6107e6ad21b9 (127.2.223.62:35569), 0d67b2a8ab894bc6bd36dbfe7c2db967 (127.2.223.60:37361)
I20260207 20:54:07.192301 14110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9"
I20260207 20:54:07.192487 14242 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967"
I20260207 20:54:07.192940 14110 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:54:07.193121 14242 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 1 FOLLOWER]: Advancing to term 2
I20260207 20:54:07.200959 14242 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57d25f06d55a401cbf9518fc2f95c0a2 in term 2.
I20260207 20:54:07.202071 14153 leader_election.cc:304] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d67b2a8ab894bc6bd36dbfe7c2db967, 57d25f06d55a401cbf9518fc2f95c0a2; no voters:
I20260207 20:54:07.204099 14555 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260207 20:54:07.204146 14110 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57d25f06d55a401cbf9518fc2f95c0a2 in term 2.
I20260207 20:54:07.207707 14555 raft_consensus.cc:697] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 2 LEADER]: Becoming Leader. State: Replica: 57d25f06d55a401cbf9518fc2f95c0a2, State: Running, Role: LEADER
I20260207 20:54:07.208475 14555 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } }
I20260207 20:54:07.213270 14556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57d25f06d55a401cbf9518fc2f95c0a2. Latest consensus state: current_term: 2 leader_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } } }
I20260207 20:54:07.214028 14556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:07.223083 14558 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:54:07.228132 14558 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:54:07.240008 14242 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 2 FOLLOWER]: Refusing update from remote peer 57d25f06d55a401cbf9518fc2f95c0a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260207 20:54:07.241138 14110 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 2 FOLLOWER]: Refusing update from remote peer 57d25f06d55a401cbf9518fc2f95c0a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260207 20:54:07.241351 14556 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:07.242525 14555 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:07.258055 14561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57d25f06d55a401cbf9518fc2f95c0a2. Latest consensus state: current_term: 2 leader_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } } }
I20260207 20:54:07.258966 14561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:07.271838 14560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57d25f06d55a401cbf9518fc2f95c0a2. Latest consensus state: current_term: 2 leader_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } } }
I20260207 20:54:07.272639 14560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:07.274428 14558 catalog_manager.cc:1357] Generated new cluster ID: e271fd5ff31e4b7493543a4da2e013b2
I20260207 20:54:07.274797 14558 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:54:07.275538 14555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } } }
I20260207 20:54:07.276252 14555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:07.284379 14561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } } }
I20260207 20:54:07.285211 14561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:07.293164 14555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } } }
I20260207 20:54:07.293964 14555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:07.299880 14560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07b2c5ec4f7049a1af8e6107e6ad21b9" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35569 } } peers { permanent_uuid: "57d25f06d55a401cbf9518fc2f95c0a2" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 38335 } } peers { permanent_uuid: "0d67b2a8ab894bc6bd36dbfe7c2db967" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 37361 } } }
I20260207 20:54:07.300585 14560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:07.329774 14558 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:54:07.331471 14558 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:54:07.366725 14558 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2: Generated new TSK 0
I20260207 20:54:07.367354 14558 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:54:07.377952 14165 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42722
I20260207 20:54:07.380316 14164 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42714
I20260207 20:54:07.384455 14164 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42720
I20260207 20:54:07.390497 14541 heartbeater.cc:499] Master 127.2.223.61:38335 was elected leader, sending a full tablet report...
I20260207 20:54:07.392875 14384 heartbeater.cc:499] Master 127.2.223.61:38335 was elected leader, sending a full tablet report...
I20260207 20:54:07.396701 14463 heartbeater.cc:499] Master 127.2.223.61:38335 was elected leader, sending a full tablet report...
I20260207 20:54:07.415616 14164 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42726:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:54:07.417640 14164 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:54:07.543227 14347 tablet_service.cc:1505] Processing CreateTablet for tablet c341c7d0ace04d65b982b1daa862a384 (DEFAULT_TABLE table=ksck-test-table [id=c033301219bf49668951a93e21101064]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:07.544497 14347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c341c7d0ace04d65b982b1daa862a384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:07.547318 14426 tablet_service.cc:1505] Processing CreateTablet for tablet 3979fd92a2934bb785f8c1fab6c2b3c0 (DEFAULT_TABLE table=ksck-test-table [id=c033301219bf49668951a93e21101064]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:07.547642 14424 tablet_service.cc:1505] Processing CreateTablet for tablet 3286be2a6d6946599b9402078b794df4 (DEFAULT_TABLE table=ksck-test-table [id=c033301219bf49668951a93e21101064]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:07.548646 14426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3979fd92a2934bb785f8c1fab6c2b3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:07.550186 14424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3286be2a6d6946599b9402078b794df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:07.551448 14425 tablet_service.cc:1505] Processing CreateTablet for tablet c341c7d0ace04d65b982b1daa862a384 (DEFAULT_TABLE table=ksck-test-table [id=c033301219bf49668951a93e21101064]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:07.547370 14348 tablet_service.cc:1505] Processing CreateTablet for tablet 3979fd92a2934bb785f8c1fab6c2b3c0 (DEFAULT_TABLE table=ksck-test-table [id=c033301219bf49668951a93e21101064]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:07.553315 14346 tablet_service.cc:1505] Processing CreateTablet for tablet 3286be2a6d6946599b9402078b794df4 (DEFAULT_TABLE table=ksck-test-table [id=c033301219bf49668951a93e21101064]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:07.554350 14348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3979fd92a2934bb785f8c1fab6c2b3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:07.560016 14346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3286be2a6d6946599b9402078b794df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:07.562368 14425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c341c7d0ace04d65b982b1daa862a384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:07.579473 14505 tablet_service.cc:1505] Processing CreateTablet for tablet 3979fd92a2934bb785f8c1fab6c2b3c0 (DEFAULT_TABLE table=ksck-test-table [id=c033301219bf49668951a93e21101064]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:07.580861 14505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3979fd92a2934bb785f8c1fab6c2b3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:07.583874 14503 tablet_service.cc:1505] Processing CreateTablet for tablet 3286be2a6d6946599b9402078b794df4 (DEFAULT_TABLE table=ksck-test-table [id=c033301219bf49668951a93e21101064]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:07.585177 14503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3286be2a6d6946599b9402078b794df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:07.587613 14504 tablet_service.cc:1505] Processing CreateTablet for tablet c341c7d0ace04d65b982b1daa862a384 (DEFAULT_TABLE table=ksck-test-table [id=c033301219bf49668951a93e21101064]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:07.589097 14504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c341c7d0ace04d65b982b1daa862a384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:07.591799 14576 tablet_bootstrap.cc:492] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa: Bootstrap starting.
I20260207 20:54:07.666571 14577 tablet_bootstrap.cc:492] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402: Bootstrap starting.
I20260207 20:54:07.669947 14576 tablet_bootstrap.cc:654] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:07.677044 14577 tablet_bootstrap.cc:654] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:07.687146 14576 tablet_bootstrap.cc:492] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa: No bootstrap required, opened a new log
I20260207 20:54:07.687606 14576 ts_tablet_manager.cc:1403] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa: Time spent bootstrapping tablet: real 0.096s user 0.014s sys 0.003s
I20260207 20:54:07.689592 14576 raft_consensus.cc:359] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.690373 14576 raft_consensus.cc:385] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:07.690748 14576 raft_consensus.cc:740] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f11703b4cd5049afb15d3a62b97d22fa, State: Initialized, Role: FOLLOWER
I20260207 20:54:07.691636 14576 consensus_queue.cc:260] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.699539 14576 ts_tablet_manager.cc:1434] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
I20260207 20:54:07.711571 14579 tablet_bootstrap.cc:492] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d: Bootstrap starting.
I20260207 20:54:07.713389 14577 tablet_bootstrap.cc:492] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402: No bootstrap required, opened a new log
I20260207 20:54:07.714004 14577 ts_tablet_manager.cc:1403] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402: Time spent bootstrapping tablet: real 0.048s user 0.019s sys 0.012s
I20260207 20:54:07.715437 14576 tablet_bootstrap.cc:492] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa: Bootstrap starting.
I20260207 20:54:07.721151 14576 tablet_bootstrap.cc:654] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:07.723394 14577 raft_consensus.cc:359] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.726222 14577 raft_consensus.cc:385] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:07.727070 14577 raft_consensus.cc:740] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29471cd9f050440d9aad4d1165f19402, State: Initialized, Role: FOLLOWER
I20260207 20:54:07.728454 14577 consensus_queue.cc:260] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.747933 14583 raft_consensus.cc:493] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:07.748348 14583 raft_consensus.cc:515] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.750953 14579 tablet_bootstrap.cc:654] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:07.764556 14577 ts_tablet_manager.cc:1434] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402: Time spent starting tablet: real 0.050s user 0.007s sys 0.001s
I20260207 20:54:07.785514 14577 tablet_bootstrap.cc:492] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402: Bootstrap starting.
I20260207 20:54:07.789773 14576 tablet_bootstrap.cc:492] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa: No bootstrap required, opened a new log
I20260207 20:54:07.790432 14576 ts_tablet_manager.cc:1403] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa: Time spent bootstrapping tablet: real 0.075s user 0.028s sys 0.032s
I20260207 20:54:07.792608 14581 raft_consensus.cc:493] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:07.793059 14581 raft_consensus.cc:515] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.795627 14581 leader_election.cc:290] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29471cd9f050440d9aad4d1165f19402 (127.2.223.2:44443), e506f900f5f34e7bb20c368a8fc9594d (127.2.223.3:39715)
I20260207 20:54:07.817135 14583 leader_election.cc:290] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f11703b4cd5049afb15d3a62b97d22fa (127.2.223.1:37611), e506f900f5f34e7bb20c368a8fc9594d (127.2.223.3:39715)
I20260207 20:54:07.818890 14576 raft_consensus.cc:359] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.823118 14576 raft_consensus.cc:385] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:07.824153 14576 raft_consensus.cc:740] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f11703b4cd5049afb15d3a62b97d22fa, State: Initialized, Role: FOLLOWER
I20260207 20:54:07.824965 14576 consensus_queue.cc:260] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.831727 14576 ts_tablet_manager.cc:1434] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa: Time spent starting tablet: real 0.041s user 0.005s sys 0.001s
I20260207 20:54:07.835269 14579 tablet_bootstrap.cc:492] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d: No bootstrap required, opened a new log
I20260207 20:54:07.835881 14579 ts_tablet_manager.cc:1403] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d: Time spent bootstrapping tablet: real 0.125s user 0.021s sys 0.036s
I20260207 20:54:07.821837 14577 tablet_bootstrap.cc:654] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:07.839115 14576 tablet_bootstrap.cc:492] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa: Bootstrap starting.
I20260207 20:54:07.838829 14358 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3286be2a6d6946599b9402078b794df4" candidate_uuid: "29471cd9f050440d9aad4d1165f19402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11703b4cd5049afb15d3a62b97d22fa" is_pre_election: true
I20260207 20:54:07.839705 14358 raft_consensus.cc:2468] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29471cd9f050440d9aad4d1165f19402 in term 0.
I20260207 20:54:07.838716 14579 raft_consensus.cc:359] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.840956 14515 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3286be2a6d6946599b9402078b794df4" candidate_uuid: "29471cd9f050440d9aad4d1165f19402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e506f900f5f34e7bb20c368a8fc9594d" is_pre_election: true
I20260207 20:54:07.841445 14399 leader_election.cc:304] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29471cd9f050440d9aad4d1165f19402, f11703b4cd5049afb15d3a62b97d22fa; no voters:
I20260207 20:54:07.841207 14579 raft_consensus.cc:385] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:07.842512 14579 raft_consensus.cc:740] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e506f900f5f34e7bb20c368a8fc9594d, State: Initialized, Role: FOLLOWER
I20260207 20:54:07.843431 14579 consensus_queue.cc:260] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.846483 14576 tablet_bootstrap.cc:654] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:07.857178 14577 tablet_bootstrap.cc:492] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402: No bootstrap required, opened a new log
I20260207 20:54:07.858022 14577 ts_tablet_manager.cc:1403] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402: Time spent bootstrapping tablet: real 0.073s user 0.013s sys 0.001s
I20260207 20:54:07.860847 14577 raft_consensus.cc:359] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.861688 14577 raft_consensus.cc:385] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:07.862048 14577 raft_consensus.cc:740] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29471cd9f050440d9aad4d1165f19402, State: Initialized, Role: FOLLOWER
I20260207 20:54:07.863888 14577 consensus_queue.cc:260] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.872391 14577 ts_tablet_manager.cc:1434] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402: Time spent starting tablet: real 0.014s user 0.006s sys 0.001s
I20260207 20:54:07.873569 14577 tablet_bootstrap.cc:492] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402: Bootstrap starting.
W20260207 20:54:07.881637 14402 leader_election.cc:343] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e506f900f5f34e7bb20c368a8fc9594d (127.2.223.3:39715): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:54:07.875762 14583 raft_consensus.cc:2804] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:07.883059 14583 raft_consensus.cc:493] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:07.883417 14583 raft_consensus.cc:3060] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:07.894090 14583 raft_consensus.cc:515] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.894785 14436 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c341c7d0ace04d65b982b1daa862a384" candidate_uuid: "f11703b4cd5049afb15d3a62b97d22fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29471cd9f050440d9aad4d1165f19402" is_pre_election: true
I20260207 20:54:07.895984 14583 leader_election.cc:290] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [CANDIDATE]: Term 1 election: Requested vote from peers f11703b4cd5049afb15d3a62b97d22fa (127.2.223.1:37611), e506f900f5f34e7bb20c368a8fc9594d (127.2.223.3:39715)
W20260207 20:54:07.897051 14321 leader_election.cc:343] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29471cd9f050440d9aad4d1165f19402 (127.2.223.2:44443): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:54:07.898521 14358 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3286be2a6d6946599b9402078b794df4" candidate_uuid: "29471cd9f050440d9aad4d1165f19402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11703b4cd5049afb15d3a62b97d22fa"
I20260207 20:54:07.899117 14358 raft_consensus.cc:3060] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:07.917577 14577 tablet_bootstrap.cc:654] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:07.920666 14358 raft_consensus.cc:2468] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29471cd9f050440d9aad4d1165f19402 in term 1.
I20260207 20:54:07.922081 14399 leader_election.cc:304] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29471cd9f050440d9aad4d1165f19402, f11703b4cd5049afb15d3a62b97d22fa; no voters:
I20260207 20:54:07.922991 14583 raft_consensus.cc:2804] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:07.923504 14583 raft_consensus.cc:697] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [term 1 LEADER]: Becoming Leader. State: Replica: 29471cd9f050440d9aad4d1165f19402, State: Running, Role: LEADER
I20260207 20:54:07.924293 14515 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3286be2a6d6946599b9402078b794df4" candidate_uuid: "29471cd9f050440d9aad4d1165f19402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e506f900f5f34e7bb20c368a8fc9594d"
I20260207 20:54:07.925220 14583 consensus_queue.cc:237] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.931648 14594 raft_consensus.cc:493] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:07.932235 14594 raft_consensus.cc:515] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
W20260207 20:54:07.931278 14402 leader_election.cc:343] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e506f900f5f34e7bb20c368a8fc9594d (127.2.223.3:39715): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:54:07.936646 14515 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c341c7d0ace04d65b982b1daa862a384" candidate_uuid: "f11703b4cd5049afb15d3a62b97d22fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e506f900f5f34e7bb20c368a8fc9594d" is_pre_election: true
I20260207 20:54:07.937286 14515 raft_consensus.cc:2468] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f11703b4cd5049afb15d3a62b97d22fa in term 0.
I20260207 20:54:07.941627 14324 leader_election.cc:304] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e506f900f5f34e7bb20c368a8fc9594d, f11703b4cd5049afb15d3a62b97d22fa; no voters: 29471cd9f050440d9aad4d1165f19402
I20260207 20:54:07.942472 14579 ts_tablet_manager.cc:1434] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d: Time spent starting tablet: real 0.106s user 0.036s sys 0.022s
I20260207 20:54:07.942660 14581 raft_consensus.cc:2804] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:07.943171 14581 raft_consensus.cc:493] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:07.943529 14581 raft_consensus.cc:3060] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:07.943665 14579 tablet_bootstrap.cc:492] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d: Bootstrap starting.
I20260207 20:54:07.948446 14594 leader_election.cc:290] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f11703b4cd5049afb15d3a62b97d22fa (127.2.223.1:37611), 29471cd9f050440d9aad4d1165f19402 (127.2.223.2:44443)
I20260207 20:54:07.951087 14576 tablet_bootstrap.cc:492] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa: No bootstrap required, opened a new log
I20260207 20:54:07.951196 14579 tablet_bootstrap.cc:654] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:07.951804 14576 ts_tablet_manager.cc:1403] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa: Time spent bootstrapping tablet: real 0.113s user 0.024s sys 0.017s
I20260207 20:54:07.969934 14576 raft_consensus.cc:359] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.971153 14576 raft_consensus.cc:385] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:07.971536 14576 raft_consensus.cc:740] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f11703b4cd5049afb15d3a62b97d22fa, State: Initialized, Role: FOLLOWER
I20260207 20:54:07.972596 14576 consensus_queue.cc:260] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.983335 14164 catalog_manager.cc:5654] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29471cd9f050440d9aad4d1165f19402 (127.2.223.2). New cstate: current_term: 1 leader_uuid: "29471cd9f050440d9aad4d1165f19402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } health_report { overall_health: UNKNOWN } } }
I20260207 20:54:07.996934 14583 raft_consensus.cc:493] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:07.997550 14583 raft_consensus.cc:515] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:07.999671 14583 leader_election.cc:290] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f11703b4cd5049afb15d3a62b97d22fa (127.2.223.1:37611), e506f900f5f34e7bb20c368a8fc9594d (127.2.223.3:39715)
I20260207 20:54:08.002348 14358 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3979fd92a2934bb785f8c1fab6c2b3c0" candidate_uuid: "29471cd9f050440d9aad4d1165f19402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11703b4cd5049afb15d3a62b97d22fa" is_pre_election: true
I20260207 20:54:08.003253 14358 raft_consensus.cc:2468] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29471cd9f050440d9aad4d1165f19402 in term 0.
I20260207 20:54:08.006690 14399 leader_election.cc:304] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29471cd9f050440d9aad4d1165f19402, f11703b4cd5049afb15d3a62b97d22fa; no voters:
I20260207 20:54:08.008033 14583 raft_consensus.cc:2804] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:08.008436 14583 raft_consensus.cc:493] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:08.008750 14583 raft_consensus.cc:3060] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:08.024927 14583 raft_consensus.cc:515] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.028342 14577 tablet_bootstrap.cc:492] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402: No bootstrap required, opened a new log
I20260207 20:54:08.029114 14577 ts_tablet_manager.cc:1403] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402: Time spent bootstrapping tablet: real 0.156s user 0.012s sys 0.015s
I20260207 20:54:08.036461 14583 leader_election.cc:290] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [CANDIDATE]: Term 1 election: Requested vote from peers f11703b4cd5049afb15d3a62b97d22fa (127.2.223.1:37611), e506f900f5f34e7bb20c368a8fc9594d (127.2.223.3:39715)
I20260207 20:54:08.039672 14358 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3979fd92a2934bb785f8c1fab6c2b3c0" candidate_uuid: "29471cd9f050440d9aad4d1165f19402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11703b4cd5049afb15d3a62b97d22fa"
I20260207 20:54:08.067268 14358 raft_consensus.cc:3060] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:08.032677 14577 raft_consensus.cc:359] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.079149 14577 raft_consensus.cc:385] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:08.020664 14581 raft_consensus.cc:515] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.081492 14581 leader_election.cc:290] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [CANDIDATE]: Term 1 election: Requested vote from peers 29471cd9f050440d9aad4d1165f19402 (127.2.223.2:44443), e506f900f5f34e7bb20c368a8fc9594d (127.2.223.3:39715)
I20260207 20:54:08.079519 14577 raft_consensus.cc:740] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29471cd9f050440d9aad4d1165f19402, State: Initialized, Role: FOLLOWER
I20260207 20:54:08.083900 14577 consensus_queue.cc:260] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.086611 14577 ts_tablet_manager.cc:1434] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402: Time spent starting tablet: real 0.057s user 0.006s sys 0.000s
I20260207 20:54:08.088547 14579 tablet_bootstrap.cc:492] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d: No bootstrap required, opened a new log
I20260207 20:54:08.089102 14579 ts_tablet_manager.cc:1403] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d: Time spent bootstrapping tablet: real 0.146s user 0.041s sys 0.087s
I20260207 20:54:08.092269 14436 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c341c7d0ace04d65b982b1daa862a384" candidate_uuid: "f11703b4cd5049afb15d3a62b97d22fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29471cd9f050440d9aad4d1165f19402"
I20260207 20:54:08.092883 14436 raft_consensus.cc:3060] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:08.095631 14576 ts_tablet_manager.cc:1434] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa: Time spent starting tablet: real 0.143s user 0.038s sys 0.082s
I20260207 20:54:08.095942 14579 raft_consensus.cc:359] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.096655 14579 raft_consensus.cc:385] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:08.096931 14579 raft_consensus.cc:740] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e506f900f5f34e7bb20c368a8fc9594d, State: Initialized, Role: FOLLOWER
I20260207 20:54:08.097587 14579 consensus_queue.cc:260] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.103219 14436 raft_consensus.cc:2468] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f11703b4cd5049afb15d3a62b97d22fa in term 1.
I20260207 20:54:08.104534 14321 leader_election.cc:304] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29471cd9f050440d9aad4d1165f19402, f11703b4cd5049afb15d3a62b97d22fa; no voters:
I20260207 20:54:08.105309 14579 ts_tablet_manager.cc:1434] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d: Time spent starting tablet: real 0.016s user 0.002s sys 0.005s
I20260207 20:54:08.105363 14599 raft_consensus.cc:2804] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:08.106174 14599 raft_consensus.cc:697] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [term 1 LEADER]: Becoming Leader. State: Replica: f11703b4cd5049afb15d3a62b97d22fa, State: Running, Role: LEADER
I20260207 20:54:08.106422 14579 tablet_bootstrap.cc:492] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d: Bootstrap starting.
I20260207 20:54:08.107028 14599 consensus_queue.cc:237] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.109467 14358 raft_consensus.cc:2468] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29471cd9f050440d9aad4d1165f19402 in term 1.
I20260207 20:54:08.119423 14579 tablet_bootstrap.cc:654] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:08.120934 14399 leader_election.cc:304] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29471cd9f050440d9aad4d1165f19402, f11703b4cd5049afb15d3a62b97d22fa; no voters:
I20260207 20:54:08.121734 14583 raft_consensus.cc:2804] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:08.122255 14583 raft_consensus.cc:697] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [term 1 LEADER]: Becoming Leader. State: Replica: 29471cd9f050440d9aad4d1165f19402, State: Running, Role: LEADER
I20260207 20:54:08.123209 14583 consensus_queue.cc:237] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.134737 14300 catalog_manager.cc:1269] Loaded cluster ID: e271fd5ff31e4b7493543a4da2e013b2
I20260207 20:54:08.135150 14300 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9: loading cluster ID for follower catalog manager: success
I20260207 20:54:08.135932 14515 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c341c7d0ace04d65b982b1daa862a384" candidate_uuid: "f11703b4cd5049afb15d3a62b97d22fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e506f900f5f34e7bb20c368a8fc9594d"
I20260207 20:54:08.136399 14514 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3979fd92a2934bb785f8c1fab6c2b3c0" candidate_uuid: "29471cd9f050440d9aad4d1165f19402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e506f900f5f34e7bb20c368a8fc9594d" is_pre_election: true
I20260207 20:54:08.137055 14514 raft_consensus.cc:2468] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29471cd9f050440d9aad4d1165f19402 in term 0.
I20260207 20:54:08.136549 14515 raft_consensus.cc:3060] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:08.142061 14300 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9: acquiring CA information for follower catalog manager: success
I20260207 20:54:08.145934 14515 raft_consensus.cc:2468] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f11703b4cd5049afb15d3a62b97d22fa in term 1.
I20260207 20:54:08.147298 14300 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:54:08.148710 14515 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3979fd92a2934bb785f8c1fab6c2b3c0" candidate_uuid: "29471cd9f050440d9aad4d1165f19402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e506f900f5f34e7bb20c368a8fc9594d"
I20260207 20:54:08.156471 14311 catalog_manager.cc:1269] Loaded cluster ID: e271fd5ff31e4b7493543a4da2e013b2
I20260207 20:54:08.157600 14311 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967: loading cluster ID for follower catalog manager: success
I20260207 20:54:08.156329 14165 catalog_manager.cc:5654] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29471cd9f050440d9aad4d1165f19402 (127.2.223.2). New cstate: current_term: 1 leader_uuid: "29471cd9f050440d9aad4d1165f19402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } health_report { overall_health: UNKNOWN } } }
I20260207 20:54:08.160306 14436 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c341c7d0ace04d65b982b1daa862a384" candidate_uuid: "e506f900f5f34e7bb20c368a8fc9594d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29471cd9f050440d9aad4d1165f19402" is_pre_election: true
I20260207 20:54:08.161116 14436 raft_consensus.cc:2393] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e506f900f5f34e7bb20c368a8fc9594d in current term 1: Already voted for candidate f11703b4cd5049afb15d3a62b97d22fa in this term.
I20260207 20:54:08.161278 14579 tablet_bootstrap.cc:492] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d: No bootstrap required, opened a new log
I20260207 20:54:08.161784 14579 ts_tablet_manager.cc:1403] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d: Time spent bootstrapping tablet: real 0.056s user 0.010s sys 0.003s
I20260207 20:54:08.165385 14358 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c341c7d0ace04d65b982b1daa862a384" candidate_uuid: "e506f900f5f34e7bb20c368a8fc9594d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11703b4cd5049afb15d3a62b97d22fa" is_pre_election: true
I20260207 20:54:08.165665 14579 raft_consensus.cc:359] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.166410 14579 raft_consensus.cc:385] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:08.166750 14579 raft_consensus.cc:740] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e506f900f5f34e7bb20c368a8fc9594d, State: Initialized, Role: FOLLOWER
I20260207 20:54:08.167654 14579 consensus_queue.cc:260] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.157624 14515 raft_consensus.cc:3060] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:08.170403 14579 ts_tablet_manager.cc:1434] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d: Time spent starting tablet: real 0.008s user 0.004s sys 0.005s
I20260207 20:54:08.175094 14311 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967: acquiring CA information for follower catalog manager: success
I20260207 20:54:08.177239 14515 raft_consensus.cc:2468] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29471cd9f050440d9aad4d1165f19402 in term 1.
I20260207 20:54:08.178498 14478 leader_election.cc:304] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e506f900f5f34e7bb20c368a8fc9594d; no voters: 29471cd9f050440d9aad4d1165f19402, f11703b4cd5049afb15d3a62b97d22fa
I20260207 20:54:08.180065 14594 raft_consensus.cc:2749] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:54:08.180272 14311 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:54:08.194253 14164 catalog_manager.cc:5654] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa reported cstate change: term changed from 0 to 1, leader changed from <none> to f11703b4cd5049afb15d3a62b97d22fa (127.2.223.1). New cstate: current_term: 1 leader_uuid: "f11703b4cd5049afb15d3a62b97d22fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } health_report { overall_health: UNKNOWN } } }
I20260207 20:54:08.236955 14164 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42726:
name: "other-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "value"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\006\001\000\000\000\000\007\001d\000\000\000""\006\001\000\000\000\000\007\001d\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:54:08.238571 14164 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table other-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:54:08.295964 14424 tablet_service.cc:1505] Processing CreateTablet for tablet f979f298ed7c4c8689e6b1bd1a212ad4 (DEFAULT_TABLE table=other-table [id=24bcc8f2427a45dc88ec89b21b5bd087]), partition=RANGE (key) PARTITION 0 <= VALUES < 100
I20260207 20:54:08.297271 14424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f979f298ed7c4c8689e6b1bd1a212ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:08.295974 14346 tablet_service.cc:1505] Processing CreateTablet for tablet f979f298ed7c4c8689e6b1bd1a212ad4 (DEFAULT_TABLE table=other-table [id=24bcc8f2427a45dc88ec89b21b5bd087]), partition=RANGE (key) PARTITION 0 <= VALUES < 100
I20260207 20:54:08.297209 14504 tablet_service.cc:1505] Processing CreateTablet for tablet f979f298ed7c4c8689e6b1bd1a212ad4 (DEFAULT_TABLE table=other-table [id=24bcc8f2427a45dc88ec89b21b5bd087]), partition=RANGE (key) PARTITION 0 <= VALUES < 100
I20260207 20:54:08.298782 14346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f979f298ed7c4c8689e6b1bd1a212ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:08.298782 14504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f979f298ed7c4c8689e6b1bd1a212ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:08.317975 14594 raft_consensus.cc:493] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:08.318513 14594 raft_consensus.cc:515] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.322464 14358 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3286be2a6d6946599b9402078b794df4" candidate_uuid: "e506f900f5f34e7bb20c368a8fc9594d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11703b4cd5049afb15d3a62b97d22fa" is_pre_election: true
I20260207 20:54:08.323254 14358 raft_consensus.cc:2393] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e506f900f5f34e7bb20c368a8fc9594d in current term 1: Already voted for candidate 29471cd9f050440d9aad4d1165f19402 in this term.
I20260207 20:54:08.328398 14594 leader_election.cc:290] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f11703b4cd5049afb15d3a62b97d22fa (127.2.223.1:37611), 29471cd9f050440d9aad4d1165f19402 (127.2.223.2:44443)
I20260207 20:54:08.329504 14579 tablet_bootstrap.cc:492] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d: Bootstrap starting.
I20260207 20:54:08.331137 14577 tablet_bootstrap.cc:492] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402: Bootstrap starting.
I20260207 20:54:08.333448 14576 tablet_bootstrap.cc:492] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa: Bootstrap starting.
I20260207 20:54:08.341080 14436 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3286be2a6d6946599b9402078b794df4" candidate_uuid: "e506f900f5f34e7bb20c368a8fc9594d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29471cd9f050440d9aad4d1165f19402" is_pre_election: true
I20260207 20:54:08.342411 14579 tablet_bootstrap.cc:654] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:08.344169 14576 tablet_bootstrap.cc:654] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:08.347055 14583 consensus_queue.cc:1048] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:08.341543 14577 tablet_bootstrap.cc:654] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:08.349395 14478 leader_election.cc:304] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e506f900f5f34e7bb20c368a8fc9594d; no voters: 29471cd9f050440d9aad4d1165f19402, f11703b4cd5049afb15d3a62b97d22fa
I20260207 20:54:08.350792 14594 raft_consensus.cc:3060] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:08.365651 14579 tablet_bootstrap.cc:492] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d: No bootstrap required, opened a new log
I20260207 20:54:08.368448 14579 ts_tablet_manager.cc:1403] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d: Time spent bootstrapping tablet: real 0.039s user 0.012s sys 0.001s
I20260207 20:54:08.369419 14594 raft_consensus.cc:2749] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:54:08.371809 14579 raft_consensus.cc:359] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.367870 14577 tablet_bootstrap.cc:492] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402: No bootstrap required, opened a new log
I20260207 20:54:08.378623 14577 ts_tablet_manager.cc:1403] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402: Time spent bootstrapping tablet: real 0.048s user 0.012s sys 0.002s
I20260207 20:54:08.381449 14577 raft_consensus.cc:359] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.374399 14576 tablet_bootstrap.cc:492] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa: No bootstrap required, opened a new log
I20260207 20:54:08.382982 14576 ts_tablet_manager.cc:1403] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa: Time spent bootstrapping tablet: real 0.050s user 0.008s sys 0.005s
I20260207 20:54:08.388716 14576 raft_consensus.cc:359] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.389961 14576 raft_consensus.cc:385] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:08.390322 14576 raft_consensus.cc:740] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f11703b4cd5049afb15d3a62b97d22fa, State: Initialized, Role: FOLLOWER
I20260207 20:54:08.382283 14579 raft_consensus.cc:385] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:08.391113 14579 raft_consensus.cc:740] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e506f900f5f34e7bb20c368a8fc9594d, State: Initialized, Role: FOLLOWER
I20260207 20:54:08.389556 14577 raft_consensus.cc:385] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:08.392577 14579 consensus_queue.cc:260] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.391993 14577 raft_consensus.cc:740] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29471cd9f050440d9aad4d1165f19402, State: Initialized, Role: FOLLOWER
I20260207 20:54:08.395406 14577 consensus_queue.cc:260] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.393692 14576 consensus_queue.cc:260] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.400754 14576 ts_tablet_manager.cc:1434] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa: Time spent starting tablet: real 0.017s user 0.002s sys 0.004s
I20260207 20:54:08.402680 14577 ts_tablet_manager.cc:1434] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402: Time spent starting tablet: real 0.024s user 0.006s sys 0.000s
I20260207 20:54:08.406939 14584 raft_consensus.cc:493] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:08.407418 14584 raft_consensus.cc:515] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.408852 14579 ts_tablet_manager.cc:1434] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d: Time spent starting tablet: real 0.039s user 0.008s sys 0.000s
I20260207 20:54:08.409363 14584 leader_election.cc:290] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f11703b4cd5049afb15d3a62b97d22fa (127.2.223.1:37611), e506f900f5f34e7bb20c368a8fc9594d (127.2.223.3:39715)
I20260207 20:54:08.411216 14515 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f979f298ed7c4c8689e6b1bd1a212ad4" candidate_uuid: "29471cd9f050440d9aad4d1165f19402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e506f900f5f34e7bb20c368a8fc9594d" is_pre_election: true
I20260207 20:54:08.411346 14357 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f979f298ed7c4c8689e6b1bd1a212ad4" candidate_uuid: "29471cd9f050440d9aad4d1165f19402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11703b4cd5049afb15d3a62b97d22fa" is_pre_election: true
I20260207 20:54:08.411950 14515 raft_consensus.cc:2468] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29471cd9f050440d9aad4d1165f19402 in term 0.
I20260207 20:54:08.412999 14402 leader_election.cc:304] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29471cd9f050440d9aad4d1165f19402, e506f900f5f34e7bb20c368a8fc9594d; no voters:
I20260207 20:54:08.411950 14357 raft_consensus.cc:2468] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29471cd9f050440d9aad4d1165f19402 in term 0.
I20260207 20:54:08.413810 14584 raft_consensus.cc:2804] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:08.414160 14584 raft_consensus.cc:493] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:08.414467 14584 raft_consensus.cc:3060] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:08.421448 14584 raft_consensus.cc:515] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.424155 14357 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f979f298ed7c4c8689e6b1bd1a212ad4" candidate_uuid: "29471cd9f050440d9aad4d1165f19402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11703b4cd5049afb15d3a62b97d22fa"
I20260207 20:54:08.424793 14357 raft_consensus.cc:3060] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:08.429207 14622 consensus_queue.cc:1048] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260207 20:54:08.434885 14357 raft_consensus.cc:2468] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29471cd9f050440d9aad4d1165f19402 in term 1.
I20260207 20:54:08.437240 14514 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f979f298ed7c4c8689e6b1bd1a212ad4" candidate_uuid: "29471cd9f050440d9aad4d1165f19402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e506f900f5f34e7bb20c368a8fc9594d"
I20260207 20:54:08.437909 14514 raft_consensus.cc:3060] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:08.438035 14399 leader_election.cc:304] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29471cd9f050440d9aad4d1165f19402, f11703b4cd5049afb15d3a62b97d22fa; no voters:
I20260207 20:54:08.441332 14622 raft_consensus.cc:2804] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:08.441907 14622 raft_consensus.cc:697] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [term 1 LEADER]: Becoming Leader. State: Replica: 29471cd9f050440d9aad4d1165f19402, State: Running, Role: LEADER
I20260207 20:54:08.442776 14622 consensus_queue.cc:237] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } }
I20260207 20:54:08.455482 14514 raft_consensus.cc:2468] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29471cd9f050440d9aad4d1165f19402 in term 1.
I20260207 20:54:08.456480 14584 leader_election.cc:290] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [CANDIDATE]: Term 1 election: Requested vote from peers f11703b4cd5049afb15d3a62b97d22fa (127.2.223.1:37611), e506f900f5f34e7bb20c368a8fc9594d (127.2.223.3:39715)
I20260207 20:54:08.483112 14164 catalog_manager.cc:5654] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29471cd9f050440d9aad4d1165f19402 (127.2.223.2). New cstate: current_term: 1 leader_uuid: "29471cd9f050440d9aad4d1165f19402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 } health_report { overall_health: UNKNOWN } } }
I20260207 20:54:08.509682 14166 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42726:
table { table_name: "other-table" } alter_schema_steps { type: DROP_RANGE_PARTITION drop_range_partition { range_bounds { rows: "\006\001\000\000\000\000\007\001d\000\000\000""\006\001\000\000\000\000\007\001d\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "value" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
I20260207 20:54:08.537147 14166 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2: Sending DeleteTablet for 3 replicas of tablet f979f298ed7c4c8689e6b1bd1a212ad4
I20260207 20:54:08.539472 14504 tablet_service.cc:1552] Processing DeleteTablet for tablet f979f298ed7c4c8689e6b1bd1a212ad4 with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-02-07 20:54:08 UTC) from {username='slave'} at 127.0.0.1:41212
I20260207 20:54:08.539992 14346 tablet_service.cc:1552] Processing DeleteTablet for tablet f979f298ed7c4c8689e6b1bd1a212ad4 with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-02-07 20:54:08 UTC) from {username='slave'} at 127.0.0.1:57562
I20260207 20:54:08.540490 14424 tablet_service.cc:1552] Processing DeleteTablet for tablet f979f298ed7c4c8689e6b1bd1a212ad4 with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-02-07 20:54:08 UTC) from {username='slave'} at 127.0.0.1:47652
I20260207 20:54:08.576525 14629 tablet_replica.cc:333] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa: stopping tablet replica
I20260207 20:54:08.579051 14628 tablet_replica.cc:333] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d: stopping tablet replica
I20260207 20:54:08.579416 14630 tablet_replica.cc:333] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402: stopping tablet replica
I20260207 20:54:08.580420 14630 raft_consensus.cc:2243] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:08.581383 14630 pending_rounds.cc:70] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402: Trying to abort 1 pending ops.
I20260207 20:54:08.581715 14630 pending_rounds.cc:77] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7251958368129122304 op_type: NO_OP noop_request { }
I20260207 20:54:08.582360 14630 raft_consensus.cc:2889] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260207 20:54:08.583006 14629 raft_consensus.cc:2243] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:08.583141 14630 raft_consensus.cc:2272] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:08.584429 14628 raft_consensus.cc:2243] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:08.583580 14629 raft_consensus.cc:2272] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:08.588567 14629 ts_tablet_manager.cc:1916] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:54:08.592772 14628 raft_consensus.cc:2272] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:08.601998 14628 ts_tablet_manager.cc:1916] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:54:08.617399 14629 ts_tablet_manager.cc:1929] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260207 20:54:08.617887 14629 log.cc:1199] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-0-root/wals/f979f298ed7c4c8689e6b1bd1a212ad4
I20260207 20:54:08.618541 14629 ts_tablet_manager.cc:1950] T f979f298ed7c4c8689e6b1bd1a212ad4 P f11703b4cd5049afb15d3a62b97d22fa: Deleting consensus metadata
I20260207 20:54:08.588702 14630 ts_tablet_manager.cc:1916] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260207 20:54:08.623004 14150 catalog_manager.cc:4985] TS f11703b4cd5049afb15d3a62b97d22fa (127.2.223.1:37611): tablet f979f298ed7c4c8689e6b1bd1a212ad4 (table other-table [id=24bcc8f2427a45dc88ec89b21b5bd087]) successfully deleted
I20260207 20:54:08.636705 14622 consensus_queue.cc:1048] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:08.694959 14583 consensus_queue.cc:1048] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f11703b4cd5049afb15d3a62b97d22fa" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:08.705804 14599 consensus_queue.cc:1048] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "29471cd9f050440d9aad4d1165f19402" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 44443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:08.709096 14599 consensus_queue.cc:1048] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e506f900f5f34e7bb20c368a8fc9594d" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 39715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:08.737762 14630 ts_tablet_manager.cc:1929] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260207 20:54:08.738243 14630 log.cc:1199] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-1-root/wals/f979f298ed7c4c8689e6b1bd1a212ad4
I20260207 20:54:08.738982 14630 ts_tablet_manager.cc:1950] T f979f298ed7c4c8689e6b1bd1a212ad4 P 29471cd9f050440d9aad4d1165f19402: Deleting consensus metadata
I20260207 20:54:08.741894 14150 catalog_manager.cc:4985] TS 29471cd9f050440d9aad4d1165f19402 (127.2.223.2:44443): tablet f979f298ed7c4c8689e6b1bd1a212ad4 (table other-table [id=24bcc8f2427a45dc88ec89b21b5bd087]) successfully deleted
I20260207 20:54:08.788025 14628 ts_tablet_manager.cc:1929] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260207 20:54:08.788482 14628 log.cc:1199] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d: Deleting WAL directory at /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTableFilters.1770497537224219-2940-0/minicluster-data/ts-2-root/wals/f979f298ed7c4c8689e6b1bd1a212ad4
I20260207 20:54:08.789140 14628 ts_tablet_manager.cc:1950] T f979f298ed7c4c8689e6b1bd1a212ad4 P e506f900f5f34e7bb20c368a8fc9594d: Deleting consensus metadata
I20260207 20:54:08.813446 14153 catalog_manager.cc:4985] TS e506f900f5f34e7bb20c368a8fc9594d (127.2.223.3:39715): tablet f979f298ed7c4c8689e6b1bd1a212ad4 (table other-table [id=24bcc8f2427a45dc88ec89b21b5bd087]) successfully deleted
I20260207 20:54:09.353296 14424 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260207 20:54:09.364629 14504 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:54:09.371053 14346 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:54:09.853237 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:54:09.906301 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:09.907380 2940 tablet_replica.cc:333] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa: stopping tablet replica
I20260207 20:54:09.909289 2940 raft_consensus.cc:2243] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:09.910131 2940 raft_consensus.cc:2272] T 3979fd92a2934bb785f8c1fab6c2b3c0 P f11703b4cd5049afb15d3a62b97d22fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:09.913424 2940 tablet_replica.cc:333] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa: stopping tablet replica
I20260207 20:54:09.913924 2940 raft_consensus.cc:2243] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:09.914367 2940 raft_consensus.cc:2272] T 3286be2a6d6946599b9402078b794df4 P f11703b4cd5049afb15d3a62b97d22fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:09.918660 2940 tablet_replica.cc:333] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa: stopping tablet replica
I20260207 20:54:09.919330 2940 raft_consensus.cc:2243] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:09.920261 2940 raft_consensus.cc:2272] T c341c7d0ace04d65b982b1daa862a384 P f11703b4cd5049afb15d3a62b97d22fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:09.947594 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:54:09.975330 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:54:10.025377 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:10.026198 2940 tablet_replica.cc:333] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402: stopping tablet replica
I20260207 20:54:10.026983 2940 raft_consensus.cc:2243] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:10.027515 2940 raft_consensus.cc:2272] T c341c7d0ace04d65b982b1daa862a384 P 29471cd9f050440d9aad4d1165f19402 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:10.029980 2940 tablet_replica.cc:333] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402: stopping tablet replica
I20260207 20:54:10.030710 2940 raft_consensus.cc:2243] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:10.032461 2940 raft_consensus.cc:2272] T 3979fd92a2934bb785f8c1fab6c2b3c0 P 29471cd9f050440d9aad4d1165f19402 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:10.035058 2940 tablet_replica.cc:333] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402: stopping tablet replica
I20260207 20:54:10.035516 2940 raft_consensus.cc:2243] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:10.036332 2940 raft_consensus.cc:2272] T 3286be2a6d6946599b9402078b794df4 P 29471cd9f050440d9aad4d1165f19402 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:10.061064 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:54:10.082404 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:54:10.119746 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:10.120461 2940 tablet_replica.cc:333] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d: stopping tablet replica
I20260207 20:54:10.121042 2940 raft_consensus.cc:2243] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:10.121520 2940 raft_consensus.cc:2272] T 3286be2a6d6946599b9402078b794df4 P e506f900f5f34e7bb20c368a8fc9594d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:10.123692 2940 tablet_replica.cc:333] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d: stopping tablet replica
I20260207 20:54:10.124173 2940 raft_consensus.cc:2243] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:10.124656 2940 raft_consensus.cc:2272] T 3979fd92a2934bb785f8c1fab6c2b3c0 P e506f900f5f34e7bb20c368a8fc9594d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:10.126704 2940 tablet_replica.cc:333] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d: stopping tablet replica
I20260207 20:54:10.127136 2940 raft_consensus.cc:2243] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:10.127558 2940 raft_consensus.cc:2272] T c341c7d0ace04d65b982b1daa862a384 P e506f900f5f34e7bb20c368a8fc9594d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:10.148398 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:54:10.164983 2940 master.cc:561] Master@127.2.223.62:35569 shutting down...
I20260207 20:54:10.186676 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:10.187341 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:10.187676 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 07b2c5ec4f7049a1af8e6107e6ad21b9: stopping tablet replica
I20260207 20:54:10.207921 2940 master.cc:583] Master@127.2.223.62:35569 shutdown complete.
I20260207 20:54:10.224666 2940 master.cc:561] Master@127.2.223.61:38335 shutting down...
I20260207 20:54:10.242885 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 2 LEADER]: Raft consensus shutting down.
I20260207 20:54:10.243790 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:10.244166 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 57d25f06d55a401cbf9518fc2f95c0a2: stopping tablet replica
I20260207 20:54:10.264590 2940 master.cc:583] Master@127.2.223.61:38335 shutdown complete.
I20260207 20:54:10.284392 2940 master.cc:561] Master@127.2.223.60:37361 shutting down...
I20260207 20:54:10.306146 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:10.306757 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:10.307065 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0d67b2a8ab894bc6bd36dbfe7c2db967: stopping tablet replica
I20260207 20:54:10.327287 2940 master.cc:583] Master@127.2.223.60:37361 shutdown complete.
[ OK ] RemoteKsckTest.TestTableFilters (5606 ms)
[ RUN ] RemoteKsckTest.TestTabletFiltersNoMatch
I20260207 20:54:10.363157 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:35399,127.2.223.61:40787,127.2.223.60:40201
I20260207 20:54:10.364444 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:10.369167 14671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:10.369688 14672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:10.371016 14674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:10.371752 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:10.373654 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:10.373842 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:10.373991 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497650373975 us; error 0 us; skew 500 ppm
I20260207 20:54:10.374523 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:10.377445 2940 webserver.cc:492] Webserver started at http://127.2.223.62:37503/ using document root <none> and password file <none>
I20260207 20:54:10.378067 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:10.378288 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:10.378614 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:10.380053 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "b3e06e8649714971a6b74a09d2adf5e7"
format_stamp: "Formatted at 2026-02-07 20:54:10 on dist-test-slave-kqw4"
I20260207 20:54:10.385844 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260207 20:54:10.390424 14679 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:10.391384 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260207 20:54:10.391697 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "b3e06e8649714971a6b74a09d2adf5e7"
format_stamp: "Formatted at 2026-02-07 20:54:10 on dist-test-slave-kqw4"
I20260207 20:54:10.391952 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:10.405030 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:10.406179 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:10.442909 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:35399
I20260207 20:54:10.443012 14730 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:35399 every 8 connection(s)
I20260207 20:54:10.446609 14731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:10.446765 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:10.452050 14733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:10.457713 14731 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:54:10.459745 14734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:10.463526 14736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:10.464448 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:10.466360 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:10.466645 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:10.466831 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497650466814 us; error 0 us; skew 500 ppm
I20260207 20:54:10.467519 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:10.470214 2940 webserver.cc:492] Webserver started at http://127.2.223.61:42067/ using document root <none> and password file <none>
I20260207 20:54:10.470839 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:10.471078 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:10.471390 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:10.472621 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "ca5406610b4940ca80a46928fe08ef83"
format_stamp: "Formatted at 2026-02-07 20:54:10 on dist-test-slave-kqw4"
I20260207 20:54:10.476989 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:54:10.479422 14731 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:10.480757 14743 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:10.481550 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
W20260207 20:54:10.481712 14681 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.223.61:40787: connect: Connection refused (error 111) [suppressed 11 similar messages]
I20260207 20:54:10.481812 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "ca5406610b4940ca80a46928fe08ef83"
format_stamp: "Formatted at 2026-02-07 20:54:10 on dist-test-slave-kqw4"
I20260207 20:54:10.482195 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:54:10.484733 14731 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:40787: Network error: Client connection negotiation failed: client connection to 127.2.223.61:40787: connect: Connection refused (error 111)
I20260207 20:54:10.504905 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:10.506194 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:10.542496 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:40787
I20260207 20:54:10.542649 14795 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:40787 every 8 connection(s)
I20260207 20:54:10.546311 14796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:10.546314 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:54:10.547250 14731 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } attempt: 1
W20260207 20:54:10.552284 14799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:10.554925 14800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:10.559027 14796 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:10.564139 14731 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:10.566865 2940 server_base.cc:1060] running on GCE node
W20260207 20:54:10.568591 14803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:10.569556 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:10.569757 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:10.570004 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497650569927 us; error 0 us; skew 500 ppm
W20260207 20:54:10.570040 14731 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:40201: Network error: Client connection negotiation failed: client connection to 127.2.223.60:40201: connect: Connection refused (error 111)
I20260207 20:54:10.570816 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:10.573918 2940 webserver.cc:492] Webserver started at http://127.2.223.60:37903/ using document root <none> and password file <none>
I20260207 20:54:10.574472 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:10.574726 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:10.575038 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:10.576442 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "330fd37d4b5d4e6d820ebed07178e968"
format_stamp: "Formatted at 2026-02-07 20:54:10 on dist-test-slave-kqw4"
I20260207 20:54:10.576396 14796 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:10.581918 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260207 20:54:10.585650 14808 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:10.586153 14796 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:10.586539 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260207 20:54:10.586899 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "330fd37d4b5d4e6d820ebed07178e968"
format_stamp: "Formatted at 2026-02-07 20:54:10 on dist-test-slave-kqw4"
I20260207 20:54:10.587229 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:54:10.592038 14796 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:40201: Network error: Client connection negotiation failed: client connection to 127.2.223.60:40201: connect: Connection refused (error 111)
I20260207 20:54:10.626219 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:10.627537 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:10.629562 14731 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } attempt: 1
W20260207 20:54:10.633710 14731 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:40201: Network error: Client connection negotiation failed: client connection to 127.2.223.60:40201: connect: Connection refused (error 111)
I20260207 20:54:10.641594 14796 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } attempt: 1
W20260207 20:54:10.646521 14796 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:40201: Network error: Client connection negotiation failed: client connection to 127.2.223.60:40201: connect: Connection refused (error 111)
I20260207 20:54:10.667546 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:40201
I20260207 20:54:10.667644 14860 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:40201 every 8 connection(s)
I20260207 20:54:10.670619 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:54:10.671470 14861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:10.677893 14861 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:10.685137 14731 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } attempt: 2
I20260207 20:54:10.688808 14861 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:10.694006 14796 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } attempt: 2
I20260207 20:54:10.699892 14861 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:10.707244 14731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7: Bootstrap starting.
I20260207 20:54:10.712561 14731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:10.712908 14796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83: Bootstrap starting.
I20260207 20:54:10.716854 14731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7: No bootstrap required, opened a new log
I20260207 20:54:10.718099 14861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968: Bootstrap starting.
I20260207 20:54:10.719283 14731 raft_consensus.cc:359] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } }
I20260207 20:54:10.719609 14796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:10.719839 14731 raft_consensus.cc:385] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:10.720136 14731 raft_consensus.cc:740] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3e06e8649714971a6b74a09d2adf5e7, State: Initialized, Role: FOLLOWER
I20260207 20:54:10.720716 14731 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } }
I20260207 20:54:10.722942 14867 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } } }
I20260207 20:54:10.723812 14867 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:10.724875 14861 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:10.724825 14731 sys_catalog.cc:565] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:54:10.726857 14796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83: No bootstrap required, opened a new log
I20260207 20:54:10.729398 14796 raft_consensus.cc:359] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } }
I20260207 20:54:10.730060 14796 raft_consensus.cc:385] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:10.730337 14796 raft_consensus.cc:740] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca5406610b4940ca80a46928fe08ef83, State: Initialized, Role: FOLLOWER
I20260207 20:54:10.730533 14861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968: No bootstrap required, opened a new log
I20260207 20:54:10.731112 14796 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } }
I20260207 20:54:10.733392 14861 raft_consensus.cc:359] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } }
I20260207 20:54:10.733357 14874 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } } }
I20260207 20:54:10.734385 14861 raft_consensus.cc:385] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:10.734633 14874 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:10.734766 14861 raft_consensus.cc:740] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330fd37d4b5d4e6d820ebed07178e968, State: Initialized, Role: FOLLOWER
I20260207 20:54:10.734974 14796 sys_catalog.cc:565] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:54:10.735858 14861 consensus_queue.cc:260] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } }
I20260207 20:54:10.738227 14875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } } }
I20260207 20:54:10.739081 14875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:10.739959 14861 sys_catalog.cc:565] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:54:10.753125 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
W20260207 20:54:10.757483 14892 catalog_manager.cc:1568] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:10.757866 14892 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:54:10.761561 14900 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:10.761860 14900 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:54:10.762435 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:54:10.764326 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:10.766438 14904 catalog_manager.cc:1568] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:10.766820 14904 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:54:10.771607 14905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:10.772457 14906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:10.773490 14908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:10.774291 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:10.775059 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:10.775255 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:10.775393 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497650775381 us; error 0 us; skew 500 ppm
I20260207 20:54:10.775875 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:10.777948 2940 webserver.cc:492] Webserver started at http://127.2.223.1:43537/ using document root <none> and password file <none>
I20260207 20:54:10.778374 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:10.778528 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:10.778786 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:10.779829 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "92e90bddaf6e4797add4ab93f51420c1"
format_stamp: "Formatted at 2026-02-07 20:54:10 on dist-test-slave-kqw4"
I20260207 20:54:10.783969 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260207 20:54:10.787150 14913 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:10.787899 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260207 20:54:10.788183 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "92e90bddaf6e4797add4ab93f51420c1"
format_stamp: "Formatted at 2026-02-07 20:54:10 on dist-test-slave-kqw4"
I20260207 20:54:10.788443 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:10.812494 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:10.813674 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:10.815160 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:10.817407 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:10.817600 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:10.817811 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:10.817965 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:10.856434 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:37853
I20260207 20:54:10.856521 14975 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:37853 every 8 connection(s)
I20260207 20:54:10.873673 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:54:10.874135 14977 heartbeater.cc:344] Connected to a master server at 127.2.223.61:40787
I20260207 20:54:10.874403 14976 heartbeater.cc:344] Connected to a master server at 127.2.223.60:40201
I20260207 20:54:10.874735 14977 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:10.874879 14976 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:10.875777 14977 heartbeater.cc:507] Master 127.2.223.61:40787 requested a full tablet report, sending...
I20260207 20:54:10.875878 14976 heartbeater.cc:507] Master 127.2.223.60:40201 requested a full tablet report, sending...
I20260207 20:54:10.878904 14826 ts_manager.cc:194] Registered new tserver with Master: 92e90bddaf6e4797add4ab93f51420c1 (127.2.223.1:37853)
I20260207 20:54:10.879498 14761 ts_manager.cc:194] Registered new tserver with Master: 92e90bddaf6e4797add4ab93f51420c1 (127.2.223.1:37853)
W20260207 20:54:10.883184 14983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:10.885836 14978 heartbeater.cc:344] Connected to a master server at 127.2.223.62:35399
W20260207 20:54:10.886020 14984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:10.886258 14978 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:10.887223 14978 heartbeater.cc:507] Master 127.2.223.62:35399 requested a full tablet report, sending...
W20260207 20:54:10.887854 14986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:10.888602 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:10.890054 14696 ts_manager.cc:194] Registered new tserver with Master: 92e90bddaf6e4797add4ab93f51420c1 (127.2.223.1:37853)
I20260207 20:54:10.890391 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:10.890702 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:10.890924 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497650890904 us; error 0 us; skew 500 ppm
I20260207 20:54:10.891673 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:10.894721 2940 webserver.cc:492] Webserver started at http://127.2.223.2:33265/ using document root <none> and password file <none>
I20260207 20:54:10.895247 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:10.895416 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:10.895614 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:10.896585 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "45e18820062240fea997d924b2d91015"
format_stamp: "Formatted at 2026-02-07 20:54:10 on dist-test-slave-kqw4"
I20260207 20:54:10.900874 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:54:10.904754 14991 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:10.905972 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260207 20:54:10.906340 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "45e18820062240fea997d924b2d91015"
format_stamp: "Formatted at 2026-02-07 20:54:10 on dist-test-slave-kqw4"
I20260207 20:54:10.906677 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:10.937506 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:10.938714 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:10.940114 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:10.942754 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:10.942955 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:10.943187 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:10.943346 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:10.953331 14875 raft_consensus.cc:493] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:10.953909 14875 raft_consensus.cc:515] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } }
I20260207 20:54:10.956085 14875 leader_election.cc:290] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3e06e8649714971a6b74a09d2adf5e7 (127.2.223.62:35399), ca5406610b4940ca80a46928fe08ef83 (127.2.223.61:40787)
I20260207 20:54:10.956984 14706 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "330fd37d4b5d4e6d820ebed07178e968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3e06e8649714971a6b74a09d2adf5e7" is_pre_election: true
I20260207 20:54:10.957855 14706 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 330fd37d4b5d4e6d820ebed07178e968 in term 0.
I20260207 20:54:10.957806 14771 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "330fd37d4b5d4e6d820ebed07178e968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca5406610b4940ca80a46928fe08ef83" is_pre_election: true
I20260207 20:54:10.959678 14810 leader_election.cc:304] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330fd37d4b5d4e6d820ebed07178e968, b3e06e8649714971a6b74a09d2adf5e7; no voters:
I20260207 20:54:10.960112 14771 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 330fd37d4b5d4e6d820ebed07178e968 in term 0.
I20260207 20:54:10.960584 14875 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:10.961098 14875 raft_consensus.cc:493] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:10.961472 14875 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:10.967835 14875 raft_consensus.cc:515] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } }
I20260207 20:54:10.971582 14875 leader_election.cc:290] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [CANDIDATE]: Term 1 election: Requested vote from peers b3e06e8649714971a6b74a09d2adf5e7 (127.2.223.62:35399), ca5406610b4940ca80a46928fe08ef83 (127.2.223.61:40787)
I20260207 20:54:10.972275 14771 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "330fd37d4b5d4e6d820ebed07178e968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca5406610b4940ca80a46928fe08ef83"
I20260207 20:54:10.972376 14706 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "330fd37d4b5d4e6d820ebed07178e968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3e06e8649714971a6b74a09d2adf5e7"
I20260207 20:54:10.973165 14771 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:10.973294 14706 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:10.982134 14706 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330fd37d4b5d4e6d820ebed07178e968 in term 1.
I20260207 20:54:10.983661 14810 leader_election.cc:304] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330fd37d4b5d4e6d820ebed07178e968, b3e06e8649714971a6b74a09d2adf5e7; no voters:
I20260207 20:54:10.982134 14771 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330fd37d4b5d4e6d820ebed07178e968 in term 1.
I20260207 20:54:10.984905 14875 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:10.988554 14875 raft_consensus.cc:697] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [term 1 LEADER]: Becoming Leader. State: Replica: 330fd37d4b5d4e6d820ebed07178e968, State: Running, Role: LEADER
I20260207 20:54:10.989404 14875 consensus_queue.cc:237] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } }
I20260207 20:54:10.995986 15025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 330fd37d4b5d4e6d820ebed07178e968. Latest consensus state: current_term: 1 leader_uuid: "330fd37d4b5d4e6d820ebed07178e968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } } }
I20260207 20:54:10.996778 15025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:10.998673 15033 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:54:11.004271 15033 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:54:11.017045 14706 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [term 1 FOLLOWER]: Refusing update from remote peer 330fd37d4b5d4e6d820ebed07178e968: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:54:11.017037 14771 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [term 1 FOLLOWER]: Refusing update from remote peer 330fd37d4b5d4e6d820ebed07178e968: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:54:11.018981 15025 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:11.019853 14875 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:11.032665 14867 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 330fd37d4b5d4e6d820ebed07178e968. Latest consensus state: current_term: 1 leader_uuid: "330fd37d4b5d4e6d820ebed07178e968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } } }
I20260207 20:54:11.033457 14867 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:11.041857 15025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "330fd37d4b5d4e6d820ebed07178e968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } } }
I20260207 20:54:11.042831 15025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:11.047677 15033 catalog_manager.cc:1357] Generated new cluster ID: 6fbb27fc9d224d30be9dd926ab599414
I20260207 20:54:11.047464 14874 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 330fd37d4b5d4e6d820ebed07178e968. Latest consensus state: current_term: 1 leader_uuid: "330fd37d4b5d4e6d820ebed07178e968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } } }
I20260207 20:54:11.048040 15033 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:54:11.048275 14874 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:11.053104 14875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "330fd37d4b5d4e6d820ebed07178e968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } } }
I20260207 20:54:11.053920 14875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:11.055473 14867 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "330fd37d4b5d4e6d820ebed07178e968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } } }
I20260207 20:54:11.056196 14867 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:11.058238 14874 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "330fd37d4b5d4e6d820ebed07178e968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3e06e8649714971a6b74a09d2adf5e7" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 35399 } } peers { permanent_uuid: "ca5406610b4940ca80a46928fe08ef83" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40787 } } peers { permanent_uuid: "330fd37d4b5d4e6d820ebed07178e968" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 40201 } } }
I20260207 20:54:11.058961 14874 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:11.061954 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:38935
I20260207 20:54:11.062176 15063 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:38935 every 8 connection(s)
I20260207 20:54:11.089386 15066 heartbeater.cc:344] Connected to a master server at 127.2.223.61:40787
I20260207 20:54:11.089900 15066 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:11.090873 15066 heartbeater.cc:507] Master 127.2.223.61:40787 requested a full tablet report, sending...
I20260207 20:54:11.097702 15065 heartbeater.cc:344] Connected to a master server at 127.2.223.60:40201
I20260207 20:54:11.098148 15065 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:11.099056 15065 heartbeater.cc:507] Master 127.2.223.60:40201 requested a full tablet report, sending...
I20260207 20:54:11.101512 14826 ts_manager.cc:194] Registered new tserver with Master: 45e18820062240fea997d924b2d91015 (127.2.223.2:38935)
I20260207 20:54:11.103794 15067 heartbeater.cc:344] Connected to a master server at 127.2.223.62:35399
I20260207 20:54:11.104041 14761 ts_manager.cc:194] Registered new tserver with Master: 45e18820062240fea997d924b2d91015 (127.2.223.2:38935)
I20260207 20:54:11.104218 15067 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:11.105147 15067 heartbeater.cc:507] Master 127.2.223.62:35399 requested a full tablet report, sending...
I20260207 20:54:11.107435 14696 ts_manager.cc:194] Registered new tserver with Master: 45e18820062240fea997d924b2d91015 (127.2.223.2:38935)
I20260207 20:54:11.109455 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:54:11.117368 15033 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:54:11.119143 15033 catalog_manager.cc:1514] Loading token signing keys...
W20260207 20:54:11.125339 15073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:11.131183 15074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:11.146698 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:11.151432 15033 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968: Generated new TSK 0
I20260207 20:54:11.152294 15033 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20260207 20:54:11.155081 15077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:11.157069 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:11.157359 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:11.157564 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497651157548 us; error 0 us; skew 500 ppm
I20260207 20:54:11.158339 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:11.160663 2940 webserver.cc:492] Webserver started at http://127.2.223.3:40371/ using document root <none> and password file <none>
I20260207 20:54:11.161132 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:11.161312 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:11.161542 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:11.162521 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "6c68a1c3858048ff8094d4d6cb5cc157"
format_stamp: "Formatted at 2026-02-07 20:54:11 on dist-test-slave-kqw4"
I20260207 20:54:11.167490 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260207 20:54:11.168152 14825 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39656
I20260207 20:54:11.173962 15081 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:11.174432 14825 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39672
I20260207 20:54:11.174870 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260207 20:54:11.175258 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "6c68a1c3858048ff8094d4d6cb5cc157"
format_stamp: "Formatted at 2026-02-07 20:54:11 on dist-test-slave-kqw4"
I20260207 20:54:11.175581 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFiltersNoMatch.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:11.181772 14976 heartbeater.cc:499] Master 127.2.223.60:40201 was elected leader, sending a full tablet report...
I20260207 20:54:11.186856 15065 heartbeater.cc:499] Master 127.2.223.60:40201 was elected leader, sending a full tablet report...
I20260207 20:54:11.200438 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:11.202302 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:11.203938 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:11.206336 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:11.206529 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:11.206811 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:11.207019 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:11.266355 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:34909
I20260207 20:54:11.266453 15143 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:34909 every 8 connection(s)
I20260207 20:54:11.294226 15145 heartbeater.cc:344] Connected to a master server at 127.2.223.61:40787
I20260207 20:54:11.294701 15145 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:11.295563 15145 heartbeater.cc:507] Master 127.2.223.61:40787 requested a full tablet report, sending...
I20260207 20:54:11.298580 14760 ts_manager.cc:194] Registered new tserver with Master: 6c68a1c3858048ff8094d4d6cb5cc157 (127.2.223.3:34909)
I20260207 20:54:11.303339 15144 heartbeater.cc:344] Connected to a master server at 127.2.223.60:40201
I20260207 20:54:11.303716 15144 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:11.303094 15146 heartbeater.cc:344] Connected to a master server at 127.2.223.62:35399
I20260207 20:54:11.304343 15146 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:11.304543 15144 heartbeater.cc:507] Master 127.2.223.60:40201 requested a full tablet report, sending...
I20260207 20:54:11.305081 15146 heartbeater.cc:507] Master 127.2.223.62:35399 requested a full tablet report, sending...
I20260207 20:54:11.306420 14826 ts_manager.cc:194] Registered new tserver with Master: 6c68a1c3858048ff8094d4d6cb5cc157 (127.2.223.3:34909)
I20260207 20:54:11.307507 14695 ts_manager.cc:194] Registered new tserver with Master: 6c68a1c3858048ff8094d4d6cb5cc157 (127.2.223.3:34909)
I20260207 20:54:11.308355 14826 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39684
I20260207 20:54:11.308658 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.023118331s
I20260207 20:54:11.321148 15144 heartbeater.cc:499] Master 127.2.223.60:40201 was elected leader, sending a full tablet report...
I20260207 20:54:11.368717 14826 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39690:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:54:11.371169 14826 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:54:11.478703 14941 tablet_service.cc:1505] Processing CreateTablet for tablet 05c16266d9984671993178d41623cb4e (DEFAULT_TABLE table=ksck-test-table [id=8a7e815226364610b23f45f9a975ded4]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:11.479971 14941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05c16266d9984671993178d41623cb4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:11.483443 14940 tablet_service.cc:1505] Processing CreateTablet for tablet 585d116daf324d73be438283265fd9fe (DEFAULT_TABLE table=ksck-test-table [id=8a7e815226364610b23f45f9a975ded4]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:11.484527 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585d116daf324d73be438283265fd9fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:11.488032 14939 tablet_service.cc:1505] Processing CreateTablet for tablet 8cd3ef02e08f40ba8dfec9ddebb30485 (DEFAULT_TABLE table=ksck-test-table [id=8a7e815226364610b23f45f9a975ded4]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:11.489336 14939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cd3ef02e08f40ba8dfec9ddebb30485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:11.514971 15165 tablet_bootstrap.cc:492] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1: Bootstrap starting.
I20260207 20:54:11.530917 15165 tablet_bootstrap.cc:654] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:11.538331 15019 tablet_service.cc:1505] Processing CreateTablet for tablet 05c16266d9984671993178d41623cb4e (DEFAULT_TABLE table=ksck-test-table [id=8a7e815226364610b23f45f9a975ded4]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:11.539676 15019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05c16266d9984671993178d41623cb4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:11.543808 15165 tablet_bootstrap.cc:492] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1: No bootstrap required, opened a new log
I20260207 20:54:11.543896 15018 tablet_service.cc:1505] Processing CreateTablet for tablet 585d116daf324d73be438283265fd9fe (DEFAULT_TABLE table=ksck-test-table [id=8a7e815226364610b23f45f9a975ded4]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:11.544525 15165 ts_tablet_manager.cc:1403] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1: Time spent bootstrapping tablet: real 0.030s user 0.013s sys 0.004s
I20260207 20:54:11.545159 15017 tablet_service.cc:1505] Processing CreateTablet for tablet 8cd3ef02e08f40ba8dfec9ddebb30485 (DEFAULT_TABLE table=ksck-test-table [id=8a7e815226364610b23f45f9a975ded4]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:11.545280 15018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585d116daf324d73be438283265fd9fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:11.549896 15017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cd3ef02e08f40ba8dfec9ddebb30485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:11.554317 15165 raft_consensus.cc:359] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.555080 15165 raft_consensus.cc:385] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:11.555369 15165 raft_consensus.cc:740] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e90bddaf6e4797add4ab93f51420c1, State: Initialized, Role: FOLLOWER
I20260207 20:54:11.556042 15165 consensus_queue.cc:260] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.562107 15109 tablet_service.cc:1505] Processing CreateTablet for tablet 05c16266d9984671993178d41623cb4e (DEFAULT_TABLE table=ksck-test-table [id=8a7e815226364610b23f45f9a975ded4]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:11.563465 15109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05c16266d9984671993178d41623cb4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:11.567518 15108 tablet_service.cc:1505] Processing CreateTablet for tablet 585d116daf324d73be438283265fd9fe (DEFAULT_TABLE table=ksck-test-table [id=8a7e815226364610b23f45f9a975ded4]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:11.568780 15108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585d116daf324d73be438283265fd9fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:11.574287 15107 tablet_service.cc:1505] Processing CreateTablet for tablet 8cd3ef02e08f40ba8dfec9ddebb30485 (DEFAULT_TABLE table=ksck-test-table [id=8a7e815226364610b23f45f9a975ded4]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:11.575613 15107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cd3ef02e08f40ba8dfec9ddebb30485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:11.589424 15168 tablet_bootstrap.cc:492] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015: Bootstrap starting.
I20260207 20:54:11.596571 15168 tablet_bootstrap.cc:654] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:11.632308 15168 tablet_bootstrap.cc:492] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015: No bootstrap required, opened a new log
I20260207 20:54:11.632813 15168 ts_tablet_manager.cc:1403] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015: Time spent bootstrapping tablet: real 0.049s user 0.013s sys 0.009s
I20260207 20:54:11.639429 15165 ts_tablet_manager.cc:1434] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1: Time spent starting tablet: real 0.091s user 0.032s sys 0.013s
I20260207 20:54:11.640717 15165 tablet_bootstrap.cc:492] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1: Bootstrap starting.
I20260207 20:54:11.641649 15168 raft_consensus.cc:359] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.642386 15168 raft_consensus.cc:385] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:11.642685 15168 raft_consensus.cc:740] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45e18820062240fea997d924b2d91015, State: Initialized, Role: FOLLOWER
I20260207 20:54:11.643456 15168 consensus_queue.cc:260] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.651340 15165 tablet_bootstrap.cc:654] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:11.663955 15168 ts_tablet_manager.cc:1434] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015: Time spent starting tablet: real 0.030s user 0.007s sys 0.012s
I20260207 20:54:11.665148 15168 tablet_bootstrap.cc:492] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015: Bootstrap starting.
I20260207 20:54:11.669396 15170 tablet_bootstrap.cc:492] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157: Bootstrap starting.
I20260207 20:54:11.673624 15168 tablet_bootstrap.cc:654] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:11.683593 15168 tablet_bootstrap.cc:492] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015: No bootstrap required, opened a new log
I20260207 20:54:11.685451 15168 ts_tablet_manager.cc:1403] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.002s
I20260207 20:54:11.685595 15170 tablet_bootstrap.cc:654] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:11.689013 15168 raft_consensus.cc:359] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } }
I20260207 20:54:11.689849 15168 raft_consensus.cc:385] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:11.690143 15168 raft_consensus.cc:740] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45e18820062240fea997d924b2d91015, State: Initialized, Role: FOLLOWER
I20260207 20:54:11.691023 15168 consensus_queue.cc:260] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } }
I20260207 20:54:11.690173 15165 tablet_bootstrap.cc:492] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1: No bootstrap required, opened a new log
I20260207 20:54:11.692166 15165 ts_tablet_manager.cc:1403] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1: Time spent bootstrapping tablet: real 0.052s user 0.011s sys 0.000s
I20260207 20:54:11.695688 15168 ts_tablet_manager.cc:1434] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260207 20:54:11.696810 15168 tablet_bootstrap.cc:492] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015: Bootstrap starting.
I20260207 20:54:11.703047 15168 tablet_bootstrap.cc:654] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:11.706674 15165 raft_consensus.cc:359] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } }
I20260207 20:54:11.707507 15165 raft_consensus.cc:385] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:11.707798 15165 raft_consensus.cc:740] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e90bddaf6e4797add4ab93f51420c1, State: Initialized, Role: FOLLOWER
I20260207 20:54:11.708786 15165 consensus_queue.cc:260] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } }
I20260207 20:54:11.711167 15165 ts_tablet_manager.cc:1434] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20260207 20:54:11.712345 15165 tablet_bootstrap.cc:492] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1: Bootstrap starting.
I20260207 20:54:11.726424 15170 tablet_bootstrap.cc:492] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157: No bootstrap required, opened a new log
I20260207 20:54:11.727144 15170 ts_tablet_manager.cc:1403] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157: Time spent bootstrapping tablet: real 0.058s user 0.013s sys 0.000s
I20260207 20:54:11.735419 15170 raft_consensus.cc:359] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.737785 15170 raft_consensus.cc:385] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:11.738171 15170 raft_consensus.cc:740] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c68a1c3858048ff8094d4d6cb5cc157, State: Initialized, Role: FOLLOWER
I20260207 20:54:11.739037 15170 consensus_queue.cc:260] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.746773 15168 tablet_bootstrap.cc:492] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015: No bootstrap required, opened a new log
I20260207 20:54:11.747318 15168 ts_tablet_manager.cc:1403] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015: Time spent bootstrapping tablet: real 0.051s user 0.027s sys 0.017s
I20260207 20:54:11.749825 15168 raft_consensus.cc:359] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.750528 15168 raft_consensus.cc:385] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:11.750828 15168 raft_consensus.cc:740] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45e18820062240fea997d924b2d91015, State: Initialized, Role: FOLLOWER
I20260207 20:54:11.751793 15165 tablet_bootstrap.cc:654] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:11.751462 15168 consensus_queue.cc:260] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.755874 15168 ts_tablet_manager.cc:1434] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260207 20:54:11.766414 14892 catalog_manager.cc:1269] Loaded cluster ID: 6fbb27fc9d224d30be9dd926ab599414
I20260207 20:54:11.767081 14892 catalog_manager.cc:1562] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7: loading cluster ID for follower catalog manager: success
I20260207 20:54:11.752604 15170 ts_tablet_manager.cc:1434] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157: Time spent starting tablet: real 0.025s user 0.008s sys 0.000s
I20260207 20:54:11.772235 14904 catalog_manager.cc:1269] Loaded cluster ID: 6fbb27fc9d224d30be9dd926ab599414
I20260207 20:54:11.772547 14904 catalog_manager.cc:1562] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83: loading cluster ID for follower catalog manager: success
I20260207 20:54:11.779194 14904 catalog_manager.cc:1584] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83: acquiring CA information for follower catalog manager: success
I20260207 20:54:11.784037 14904 catalog_manager.cc:1612] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:54:11.785146 14892 catalog_manager.cc:1584] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7: acquiring CA information for follower catalog manager: success
I20260207 20:54:11.789433 15170 tablet_bootstrap.cc:492] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157: Bootstrap starting.
I20260207 20:54:11.791322 14892 catalog_manager.cc:1612] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:54:11.809461 15170 tablet_bootstrap.cc:654] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:11.813575 15165 tablet_bootstrap.cc:492] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1: No bootstrap required, opened a new log
I20260207 20:54:11.814141 15165 ts_tablet_manager.cc:1403] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1: Time spent bootstrapping tablet: real 0.102s user 0.016s sys 0.017s
I20260207 20:54:11.818630 15165 raft_consensus.cc:359] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.819310 15165 raft_consensus.cc:385] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:11.819591 15165 raft_consensus.cc:740] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e90bddaf6e4797add4ab93f51420c1, State: Initialized, Role: FOLLOWER
I20260207 20:54:11.820250 15165 consensus_queue.cc:260] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.822712 15165 ts_tablet_manager.cc:1434] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260207 20:54:11.826989 15170 tablet_bootstrap.cc:492] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157: No bootstrap required, opened a new log
I20260207 20:54:11.827526 15170 ts_tablet_manager.cc:1403] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157: Time spent bootstrapping tablet: real 0.038s user 0.014s sys 0.003s
I20260207 20:54:11.835906 15170 raft_consensus.cc:359] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } }
I20260207 20:54:11.836617 15170 raft_consensus.cc:385] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:11.836872 15170 raft_consensus.cc:740] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c68a1c3858048ff8094d4d6cb5cc157, State: Initialized, Role: FOLLOWER
I20260207 20:54:11.837536 15170 consensus_queue.cc:260] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } }
I20260207 20:54:11.852826 15170 ts_tablet_manager.cc:1434] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157: Time spent starting tablet: real 0.025s user 0.007s sys 0.000s
I20260207 20:54:11.853991 15170 tablet_bootstrap.cc:492] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157: Bootstrap starting.
I20260207 20:54:11.864313 15170 tablet_bootstrap.cc:654] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:11.868979 15170 tablet_bootstrap.cc:492] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157: No bootstrap required, opened a new log
I20260207 20:54:11.869372 15170 ts_tablet_manager.cc:1403] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.007s
I20260207 20:54:11.871436 15170 raft_consensus.cc:359] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.871953 15170 raft_consensus.cc:385] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:11.872193 15170 raft_consensus.cc:740] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c68a1c3858048ff8094d4d6cb5cc157, State: Initialized, Role: FOLLOWER
I20260207 20:54:11.872720 15170 consensus_queue.cc:260] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.874842 15170 ts_tablet_manager.cc:1434] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260207 20:54:11.881148 15167 raft_consensus.cc:493] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:11.881675 15167 raft_consensus.cc:515] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.884078 15167 leader_election.cc:290] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45e18820062240fea997d924b2d91015 (127.2.223.2:38935), 6c68a1c3858048ff8094d4d6cb5cc157 (127.2.223.3:34909)
I20260207 20:54:11.897043 15030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8cd3ef02e08f40ba8dfec9ddebb30485" candidate_uuid: "92e90bddaf6e4797add4ab93f51420c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45e18820062240fea997d924b2d91015" is_pre_election: true
I20260207 20:54:11.897746 15030 raft_consensus.cc:2468] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e90bddaf6e4797add4ab93f51420c1 in term 0.
I20260207 20:54:11.899190 14915 leader_election.cc:304] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45e18820062240fea997d924b2d91015, 92e90bddaf6e4797add4ab93f51420c1; no voters:
I20260207 20:54:11.900379 15167 raft_consensus.cc:2804] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:11.900772 15167 raft_consensus.cc:493] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:11.901114 15167 raft_consensus.cc:3060] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:11.910778 15167 raft_consensus.cc:515] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.912668 15176 raft_consensus.cc:493] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:11.913260 15176 raft_consensus.cc:515] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } }
I20260207 20:54:11.912628 15167 leader_election.cc:290] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [CANDIDATE]: Term 1 election: Requested vote from peers 45e18820062240fea997d924b2d91015 (127.2.223.2:38935), 6c68a1c3858048ff8094d4d6cb5cc157 (127.2.223.3:34909)
I20260207 20:54:11.915535 15176 leader_election.cc:290] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e90bddaf6e4797add4ab93f51420c1 (127.2.223.1:37853), 45e18820062240fea997d924b2d91015 (127.2.223.2:38935)
I20260207 20:54:11.921813 15030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8cd3ef02e08f40ba8dfec9ddebb30485" candidate_uuid: "92e90bddaf6e4797add4ab93f51420c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45e18820062240fea997d924b2d91015"
I20260207 20:54:11.922415 15030 raft_consensus.cc:3060] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:11.929124 15030 raft_consensus.cc:2468] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e90bddaf6e4797add4ab93f51420c1 in term 1.
I20260207 20:54:11.932436 14915 leader_election.cc:304] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45e18820062240fea997d924b2d91015, 92e90bddaf6e4797add4ab93f51420c1; no voters:
I20260207 20:54:11.933282 15167 raft_consensus.cc:2804] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:11.939078 15030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05c16266d9984671993178d41623cb4e" candidate_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45e18820062240fea997d924b2d91015" is_pre_election: true
I20260207 20:54:11.939725 15030 raft_consensus.cc:2468] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c68a1c3858048ff8094d4d6cb5cc157 in term 0.
I20260207 20:54:11.940822 15083 leader_election.cc:304] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45e18820062240fea997d924b2d91015, 6c68a1c3858048ff8094d4d6cb5cc157; no voters:
I20260207 20:54:11.941676 15176 raft_consensus.cc:2804] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:11.942057 15176 raft_consensus.cc:493] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:11.942399 15176 raft_consensus.cc:3060] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:11.947064 15119 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8cd3ef02e08f40ba8dfec9ddebb30485" candidate_uuid: "92e90bddaf6e4797add4ab93f51420c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" is_pre_election: true
I20260207 20:54:11.947872 15119 raft_consensus.cc:2468] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e90bddaf6e4797add4ab93f51420c1 in term 0.
I20260207 20:54:11.949119 15118 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8cd3ef02e08f40ba8dfec9ddebb30485" candidate_uuid: "92e90bddaf6e4797add4ab93f51420c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c68a1c3858048ff8094d4d6cb5cc157"
I20260207 20:54:11.949767 15118 raft_consensus.cc:3060] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:11.950078 15176 raft_consensus.cc:515] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } }
I20260207 20:54:11.955044 15176 leader_election.cc:290] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [CANDIDATE]: Term 1 election: Requested vote from peers 92e90bddaf6e4797add4ab93f51420c1 (127.2.223.1:37853), 45e18820062240fea997d924b2d91015 (127.2.223.2:38935)
I20260207 20:54:11.956737 15030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05c16266d9984671993178d41623cb4e" candidate_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45e18820062240fea997d924b2d91015"
I20260207 20:54:11.957309 15030 raft_consensus.cc:3060] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:11.957445 15118 raft_consensus.cc:2468] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e90bddaf6e4797add4ab93f51420c1 in term 1.
I20260207 20:54:11.959288 15167 raft_consensus.cc:697] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [term 1 LEADER]: Becoming Leader. State: Replica: 92e90bddaf6e4797add4ab93f51420c1, State: Running, Role: LEADER
I20260207 20:54:11.960238 15167 consensus_queue.cc:237] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:11.965520 14951 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05c16266d9984671993178d41623cb4e" candidate_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e90bddaf6e4797add4ab93f51420c1" is_pre_election: true
I20260207 20:54:11.966218 14951 raft_consensus.cc:2468] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c68a1c3858048ff8094d4d6cb5cc157 in term 0.
I20260207 20:54:11.967861 14951 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05c16266d9984671993178d41623cb4e" candidate_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e90bddaf6e4797add4ab93f51420c1"
I20260207 20:54:11.967934 15030 raft_consensus.cc:2468] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c68a1c3858048ff8094d4d6cb5cc157 in term 1.
I20260207 20:54:11.968518 14951 raft_consensus.cc:3060] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:11.971925 15083 leader_election.cc:304] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45e18820062240fea997d924b2d91015, 6c68a1c3858048ff8094d4d6cb5cc157; no voters:
I20260207 20:54:11.972779 15176 raft_consensus.cc:2804] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:11.977079 14951 raft_consensus.cc:2468] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c68a1c3858048ff8094d4d6cb5cc157 in term 1.
I20260207 20:54:11.988517 15176 raft_consensus.cc:697] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [term 1 LEADER]: Becoming Leader. State: Replica: 6c68a1c3858048ff8094d4d6cb5cc157, State: Running, Role: LEADER
I20260207 20:54:11.989460 15176 consensus_queue.cc:237] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } }
I20260207 20:54:11.983273 14826 catalog_manager.cc:5654] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92e90bddaf6e4797add4ab93f51420c1 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "92e90bddaf6e4797add4ab93f51420c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } health_report { overall_health: UNKNOWN } } }
I20260207 20:54:11.999094 14822 catalog_manager.cc:5654] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c68a1c3858048ff8094d4d6cb5cc157 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } health_report { overall_health: UNKNOWN } } }
I20260207 20:54:12.034533 15176 raft_consensus.cc:493] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:12.035128 15176 raft_consensus.cc:515] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:12.037107 15176 leader_election.cc:290] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92e90bddaf6e4797add4ab93f51420c1 (127.2.223.1:37853), 45e18820062240fea997d924b2d91015 (127.2.223.2:38935)
I20260207 20:54:12.039471 15030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "585d116daf324d73be438283265fd9fe" candidate_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45e18820062240fea997d924b2d91015" is_pre_election: true
I20260207 20:54:12.040185 15030 raft_consensus.cc:2468] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c68a1c3858048ff8094d4d6cb5cc157 in term 0.
I20260207 20:54:12.043344 14951 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "585d116daf324d73be438283265fd9fe" candidate_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e90bddaf6e4797add4ab93f51420c1" is_pre_election: true
I20260207 20:54:12.044003 14951 raft_consensus.cc:2468] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c68a1c3858048ff8094d4d6cb5cc157 in term 0.
I20260207 20:54:12.044211 15083 leader_election.cc:304] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45e18820062240fea997d924b2d91015, 6c68a1c3858048ff8094d4d6cb5cc157; no voters:
I20260207 20:54:12.045023 15176 raft_consensus.cc:2804] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:12.045383 15176 raft_consensus.cc:493] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:12.045696 15176 raft_consensus.cc:3060] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:12.052321 15176 raft_consensus.cc:515] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:12.059794 14951 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "585d116daf324d73be438283265fd9fe" candidate_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e90bddaf6e4797add4ab93f51420c1"
I20260207 20:54:12.060387 14951 raft_consensus.cc:3060] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:12.060683 15030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "585d116daf324d73be438283265fd9fe" candidate_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45e18820062240fea997d924b2d91015"
I20260207 20:54:12.061254 15030 raft_consensus.cc:3060] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:12.072836 15030 raft_consensus.cc:2468] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c68a1c3858048ff8094d4d6cb5cc157 in term 1.
I20260207 20:54:12.073414 15176 leader_election.cc:290] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [CANDIDATE]: Term 1 election: Requested vote from peers 92e90bddaf6e4797add4ab93f51420c1 (127.2.223.1:37853), 45e18820062240fea997d924b2d91015 (127.2.223.2:38935)
I20260207 20:54:12.073768 15083 leader_election.cc:304] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45e18820062240fea997d924b2d91015, 6c68a1c3858048ff8094d4d6cb5cc157; no voters:
I20260207 20:54:12.074795 15176 raft_consensus.cc:2804] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:12.075277 15176 raft_consensus.cc:697] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [term 1 LEADER]: Becoming Leader. State: Replica: 6c68a1c3858048ff8094d4d6cb5cc157, State: Running, Role: LEADER
I20260207 20:54:12.078244 15176 consensus_queue.cc:237] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } }
I20260207 20:54:12.075381 14951 raft_consensus.cc:2468] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c68a1c3858048ff8094d4d6cb5cc157 in term 1.
I20260207 20:54:12.086563 14822 catalog_manager.cc:5654] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c68a1c3858048ff8094d4d6cb5cc157 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 } health_report { overall_health: HEALTHY } } }
I20260207 20:54:12.467738 15167 consensus_queue.cc:1048] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c68a1c3858048ff8094d4d6cb5cc157" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 34909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:12.478634 15176 consensus_queue.cc:1048] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:12.481541 15176 consensus_queue.cc:1048] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:12.557557 15176 consensus_queue.cc:1048] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:12.558873 15176 consensus_queue.cc:1048] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e90bddaf6e4797add4ab93f51420c1" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:12.589267 15167 consensus_queue.cc:1048] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45e18820062240fea997d924b2d91015" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260207 20:54:12.658664 15083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.223.2:38935, user_credentials={real_user=slave}} blocked reactor thread for 69941.4us
I20260207 20:54:12.967265 15019 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:54:12.975682 15107 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260207 20:54:12.995811 14940 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:54:13.401808 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:54:13.454438 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:13.455107 2940 tablet_replica.cc:333] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1: stopping tablet replica
I20260207 20:54:13.455690 2940 raft_consensus.cc:2243] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:13.456110 2940 raft_consensus.cc:2272] T 585d116daf324d73be438283265fd9fe P 92e90bddaf6e4797add4ab93f51420c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:13.459566 2940 tablet_replica.cc:333] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1: stopping tablet replica
I20260207 20:54:13.460264 2940 raft_consensus.cc:2243] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:13.460776 2940 raft_consensus.cc:2272] T 05c16266d9984671993178d41623cb4e P 92e90bddaf6e4797add4ab93f51420c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:13.464423 2940 tablet_replica.cc:333] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1: stopping tablet replica
I20260207 20:54:13.465102 2940 raft_consensus.cc:2243] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:13.465999 2940 raft_consensus.cc:2272] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 92e90bddaf6e4797add4ab93f51420c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:13.492872 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:54:13.504607 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:54:13.532943 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:13.533499 2940 tablet_replica.cc:333] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015: stopping tablet replica
I20260207 20:54:13.534026 2940 raft_consensus.cc:2243] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:13.534430 2940 raft_consensus.cc:2272] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 45e18820062240fea997d924b2d91015 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:13.536638 2940 tablet_replica.cc:333] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015: stopping tablet replica
I20260207 20:54:13.537148 2940 raft_consensus.cc:2243] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:13.537572 2940 raft_consensus.cc:2272] T 05c16266d9984671993178d41623cb4e P 45e18820062240fea997d924b2d91015 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:13.539904 2940 tablet_replica.cc:333] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015: stopping tablet replica
I20260207 20:54:13.540364 2940 raft_consensus.cc:2243] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:13.540706 2940 raft_consensus.cc:2272] T 585d116daf324d73be438283265fd9fe P 45e18820062240fea997d924b2d91015 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:13.564087 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:54:13.576584 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:54:13.601838 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:13.602563 2940 tablet_replica.cc:333] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157: stopping tablet replica
I20260207 20:54:13.603215 2940 raft_consensus.cc:2243] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:13.603631 2940 raft_consensus.cc:2272] T 8cd3ef02e08f40ba8dfec9ddebb30485 P 6c68a1c3858048ff8094d4d6cb5cc157 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:13.605861 2940 tablet_replica.cc:333] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157: stopping tablet replica
I20260207 20:54:13.606333 2940 raft_consensus.cc:2243] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:13.607043 2940 raft_consensus.cc:2272] T 05c16266d9984671993178d41623cb4e P 6c68a1c3858048ff8094d4d6cb5cc157 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:13.608664 2940 tablet_replica.cc:333] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157: stopping tablet replica
I20260207 20:54:13.609074 2940 raft_consensus.cc:2243] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:13.609692 2940 raft_consensus.cc:2272] T 585d116daf324d73be438283265fd9fe P 6c68a1c3858048ff8094d4d6cb5cc157 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:13.628777 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:54:13.640195 2940 master.cc:561] Master@127.2.223.62:35399 shutting down...
I20260207 20:54:13.657891 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:13.658428 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:13.658746 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P b3e06e8649714971a6b74a09d2adf5e7: stopping tablet replica
I20260207 20:54:13.677524 2940 master.cc:583] Master@127.2.223.62:35399 shutdown complete.
I20260207 20:54:13.689728 2940 master.cc:561] Master@127.2.223.61:40787 shutting down...
I20260207 20:54:13.705106 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:13.705583 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:13.705838 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P ca5406610b4940ca80a46928fe08ef83: stopping tablet replica
I20260207 20:54:13.724025 2940 master.cc:583] Master@127.2.223.61:40787 shutdown complete.
I20260207 20:54:13.735357 2940 master.cc:561] Master@127.2.223.60:40201 shutting down...
I20260207 20:54:13.750718 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:13.751513 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:13.751850 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 330fd37d4b5d4e6d820ebed07178e968: stopping tablet replica
I20260207 20:54:13.769835 2940 master.cc:583] Master@127.2.223.60:40201 shutdown complete.
[ OK ] RemoteKsckTest.TestTabletFiltersNoMatch (3436 ms)
[ RUN ] RemoteKsckTest.TestTabletFilters
I20260207 20:54:13.799401 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:38535,127.2.223.61:40527,127.2.223.60:34115
I20260207 20:54:13.800621 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:13.805274 15255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:13.806277 15254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:13.806818 15257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:13.808507 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:13.809201 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:13.809383 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:13.809495 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497653809485 us; error 0 us; skew 500 ppm
I20260207 20:54:13.809916 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:13.811932 2940 webserver.cc:492] Webserver started at http://127.2.223.62:42197/ using document root <none> and password file <none>
I20260207 20:54:13.812350 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:13.812628 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:13.812893 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:13.813913 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "04048058127d456da6bb7ff13c8d17e0"
format_stamp: "Formatted at 2026-02-07 20:54:13 on dist-test-slave-kqw4"
I20260207 20:54:13.818159 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260207 20:54:13.821493 15262 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:13.822192 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:54:13.822469 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "04048058127d456da6bb7ff13c8d17e0"
format_stamp: "Formatted at 2026-02-07 20:54:13 on dist-test-slave-kqw4"
I20260207 20:54:13.822751 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:13.840279 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:13.841212 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:13.873895 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:38535
I20260207 20:54:13.873978 15313 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:38535 every 8 connection(s)
I20260207 20:54:13.877652 15314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:13.877802 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:13.882772 15316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:13.883694 15317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:13.885392 15314 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:54:13.885758 15319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:13.886175 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:13.887460 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:13.887739 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:13.887945 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497653887928 us; error 0 us; skew 500 ppm
I20260207 20:54:13.888690 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:13.891535 2940 webserver.cc:492] Webserver started at http://127.2.223.61:33633/ using document root <none> and password file <none>
I20260207 20:54:13.892042 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:13.892221 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:13.892462 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:13.893512 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "99278fc6cdbf436890124a49d95c5f6f"
format_stamp: "Formatted at 2026-02-07 20:54:13 on dist-test-slave-kqw4"
I20260207 20:54:13.897315 15314 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:13.898773 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
W20260207 20:54:13.902773 15314 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:40527: Network error: Client connection negotiation failed: client connection to 127.2.223.61:40527: connect: Connection refused (error 111)
I20260207 20:54:13.903312 15327 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:13.904034 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260207 20:54:13.904307 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "99278fc6cdbf436890124a49d95c5f6f"
format_stamp: "Formatted at 2026-02-07 20:54:13 on dist-test-slave-kqw4"
I20260207 20:54:13.904560 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:13.914561 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:13.915467 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:13.928292 15314 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } attempt: 1
W20260207 20:54:13.932814 15314 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:40527: Network error: Client connection negotiation failed: client connection to 127.2.223.61:40527: connect: Connection refused (error 111)
I20260207 20:54:13.949982 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:40527
I20260207 20:54:13.950090 15378 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:40527 every 8 connection(s)
I20260207 20:54:13.953538 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:54:13.953656 15379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260207 20:54:13.958634 15381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:13.960650 15382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:13.961266 15384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:13.961982 15379 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:13.962893 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:13.963762 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:13.964062 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:13.964282 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497653964267 us; error 0 us; skew 500 ppm
I20260207 20:54:13.964773 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:13.967092 2940 webserver.cc:492] Webserver started at http://127.2.223.60:43583/ using document root <none> and password file <none>
I20260207 20:54:13.967664 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:13.967880 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:13.968178 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:13.969110 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "cc0fd7844b1447239b8606050bf6bc94"
format_stamp: "Formatted at 2026-02-07 20:54:13 on dist-test-slave-kqw4"
I20260207 20:54:13.972582 15379 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:13.974468 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260207 20:54:13.978524 15391 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:13.979353 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260207 20:54:13.979647 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "cc0fd7844b1447239b8606050bf6bc94"
format_stamp: "Formatted at 2026-02-07 20:54:13 on dist-test-slave-kqw4"
I20260207 20:54:13.979969 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:13.985167 15379 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:13.990362 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
W20260207 20:54:13.990435 15379 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:34115: Network error: Client connection negotiation failed: client connection to 127.2.223.60:34115: connect: Connection refused (error 111)
I20260207 20:54:13.991381 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:14.009305 15314 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } attempt: 2
I20260207 20:54:14.020493 15314 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:54:14.025309 15314 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:34115: Network error: Client connection negotiation failed: client connection to 127.2.223.60:34115: connect: Connection refused (error 111)
I20260207 20:54:14.028990 15379 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } attempt: 1
I20260207 20:54:14.029811 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:34115
I20260207 20:54:14.029915 15443 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:34115 every 8 connection(s)
I20260207 20:54:14.033555 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:54:14.034458 15445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:14.042301 15445 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:14.046464 15379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f: Bootstrap starting.
I20260207 20:54:14.051896 15379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:14.053376 15445 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:14.056458 15379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f: No bootstrap required, opened a new log
I20260207 20:54:14.058887 15379 raft_consensus.cc:359] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } }
I20260207 20:54:14.059499 15379 raft_consensus.cc:385] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:14.059777 15379 raft_consensus.cc:740] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99278fc6cdbf436890124a49d95c5f6f, State: Initialized, Role: FOLLOWER
I20260207 20:54:14.060468 15379 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } }
I20260207 20:54:14.062312 15449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } } }
I20260207 20:54:14.062745 15445 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:14.063015 15449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:14.063740 15379 sys_catalog.cc:565] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:54:14.071820 15314 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } attempt: 1
W20260207 20:54:14.079176 15460 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:14.079502 15460 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:54:14.080423 15445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94: Bootstrap starting.
I20260207 20:54:14.085479 15445 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:14.088068 15314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0: Bootstrap starting.
I20260207 20:54:14.089530 15445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94: No bootstrap required, opened a new log
I20260207 20:54:14.091522 15445 raft_consensus.cc:359] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } }
I20260207 20:54:14.092023 15445 raft_consensus.cc:385] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:14.092231 15445 raft_consensus.cc:740] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc0fd7844b1447239b8606050bf6bc94, State: Initialized, Role: FOLLOWER
I20260207 20:54:14.092686 15314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:14.092764 15445 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } }
I20260207 20:54:14.094635 15462 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } } }
I20260207 20:54:14.095394 15462 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:14.096117 15445 sys_catalog.cc:565] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:54:14.096973 15314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0: No bootstrap required, opened a new log
I20260207 20:54:14.098875 15314 raft_consensus.cc:359] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } }
I20260207 20:54:14.099489 15314 raft_consensus.cc:385] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:14.099732 15314 raft_consensus.cc:740] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04048058127d456da6bb7ff13c8d17e0, State: Initialized, Role: FOLLOWER
I20260207 20:54:14.100378 15314 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } }
I20260207 20:54:14.102213 15469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } } }
I20260207 20:54:14.102921 15469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:14.103788 15314 sys_catalog.cc:565] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [sys.catalog]: configured and running, proceeding with master startup.
W20260207 20:54:14.111340 15477 catalog_manager.cc:1568] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:14.111729 15477 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:54:14.114722 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:54:14.115001 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:54:14.116274 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:14.117470 15486 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:14.117743 15486 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:54:14.122098 15487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:14.122740 15488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:14.124595 15490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:14.124877 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:14.126540 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:14.126757 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:14.126888 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497654126877 us; error 0 us; skew 500 ppm
I20260207 20:54:14.127329 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:14.129328 2940 webserver.cc:492] Webserver started at http://127.2.223.1:40621/ using document root <none> and password file <none>
I20260207 20:54:14.129739 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:14.129884 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:14.130084 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:14.131054 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "736d30bec6124579b58ff004aa8a1f44"
format_stamp: "Formatted at 2026-02-07 20:54:14 on dist-test-slave-kqw4"
I20260207 20:54:14.134927 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260207 20:54:14.137843 15495 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:14.138540 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260207 20:54:14.138840 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "736d30bec6124579b58ff004aa8a1f44"
format_stamp: "Formatted at 2026-02-07 20:54:14 on dist-test-slave-kqw4"
I20260207 20:54:14.139104 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:14.152235 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:14.153141 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:14.154410 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:14.156512 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:14.156697 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:14.156898 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:14.157049 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:14.192814 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:45463
I20260207 20:54:14.192899 15557 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:45463 every 8 connection(s)
I20260207 20:54:14.208846 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:54:14.220489 15559 heartbeater.cc:344] Connected to a master server at 127.2.223.61:40527
I20260207 20:54:14.220901 15559 heartbeater.cc:461] Registering TS with master...
W20260207 20:54:14.221132 15566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:14.221709 15560 heartbeater.cc:344] Connected to a master server at 127.2.223.62:38535
I20260207 20:54:14.221827 15559 heartbeater.cc:507] Master 127.2.223.61:40527 requested a full tablet report, sending...
I20260207 20:54:14.222154 15560 heartbeater.cc:461] Registering TS with master...
W20260207 20:54:14.222728 15565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:14.223073 15560 heartbeater.cc:507] Master 127.2.223.62:38535 requested a full tablet report, sending...
I20260207 20:54:14.223168 15558 heartbeater.cc:344] Connected to a master server at 127.2.223.60:34115
I20260207 20:54:14.224313 15558 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:14.225128 15558 heartbeater.cc:507] Master 127.2.223.60:34115 requested a full tablet report, sending...
I20260207 20:54:14.225617 15344 ts_manager.cc:194] Registered new tserver with Master: 736d30bec6124579b58ff004aa8a1f44 (127.2.223.1:45463)
I20260207 20:54:14.226001 15279 ts_manager.cc:194] Registered new tserver with Master: 736d30bec6124579b58ff004aa8a1f44 (127.2.223.1:45463)
I20260207 20:54:14.226409 2940 server_base.cc:1060] running on GCE node
W20260207 20:54:14.228219 15569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:14.228286 15409 ts_manager.cc:194] Registered new tserver with Master: 736d30bec6124579b58ff004aa8a1f44 (127.2.223.1:45463)
I20260207 20:54:14.229091 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:14.229347 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:14.229518 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497654229504 us; error 0 us; skew 500 ppm
I20260207 20:54:14.230057 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:14.232138 2940 webserver.cc:492] Webserver started at http://127.2.223.2:39749/ using document root <none> and password file <none>
I20260207 20:54:14.232580 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:14.232750 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:14.232977 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:14.233947 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "7e64ffb5141a476f84dd8a392043dd55"
format_stamp: "Formatted at 2026-02-07 20:54:14 on dist-test-slave-kqw4"
I20260207 20:54:14.238014 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260207 20:54:14.242038 15573 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:14.242904 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260207 20:54:14.243175 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "7e64ffb5141a476f84dd8a392043dd55"
format_stamp: "Formatted at 2026-02-07 20:54:14 on dist-test-slave-kqw4"
I20260207 20:54:14.243407 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:14.271538 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:14.272437 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:14.273746 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:14.275975 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:14.276152 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:14.276372 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:14.276510 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:14.323426 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:42819
I20260207 20:54:14.323650 15469 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:14.324131 15469 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } }
I20260207 20:54:14.325840 15635 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:42819 every 8 connection(s)
I20260207 20:54:14.326021 15469 leader_election.cc:290] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99278fc6cdbf436890124a49d95c5f6f (127.2.223.61:40527), cc0fd7844b1447239b8606050bf6bc94 (127.2.223.60:34115)
I20260207 20:54:14.327347 15419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04048058127d456da6bb7ff13c8d17e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc0fd7844b1447239b8606050bf6bc94" is_pre_election: true
I20260207 20:54:14.328006 15419 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04048058127d456da6bb7ff13c8d17e0 in term 0.
I20260207 20:54:14.327358 15354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04048058127d456da6bb7ff13c8d17e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99278fc6cdbf436890124a49d95c5f6f" is_pre_election: true
I20260207 20:54:14.329340 15354 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04048058127d456da6bb7ff13c8d17e0 in term 0.
I20260207 20:54:14.331120 15265 leader_election.cc:304] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04048058127d456da6bb7ff13c8d17e0, cc0fd7844b1447239b8606050bf6bc94; no voters:
I20260207 20:54:14.331966 15469 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:14.332358 15469 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:14.332675 15469 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:14.338985 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:54:14.343029 15469 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } }
I20260207 20:54:14.346020 15469 leader_election.cc:290] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [CANDIDATE]: Term 1 election: Requested vote from peers 99278fc6cdbf436890124a49d95c5f6f (127.2.223.61:40527), cc0fd7844b1447239b8606050bf6bc94 (127.2.223.60:34115)
I20260207 20:54:14.347754 15354 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04048058127d456da6bb7ff13c8d17e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99278fc6cdbf436890124a49d95c5f6f"
I20260207 20:54:14.348416 15354 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [term 0 FOLLOWER]: Advancing to term 1
W20260207 20:54:14.353585 15642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:14.359305 15419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04048058127d456da6bb7ff13c8d17e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc0fd7844b1447239b8606050bf6bc94"
I20260207 20:54:14.359992 15419 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:14.368767 15354 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04048058127d456da6bb7ff13c8d17e0 in term 1.
I20260207 20:54:14.370484 15419 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04048058127d456da6bb7ff13c8d17e0 in term 1.
I20260207 20:54:14.373183 15265 leader_election.cc:304] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04048058127d456da6bb7ff13c8d17e0, cc0fd7844b1447239b8606050bf6bc94; no voters:
I20260207 20:54:14.374130 15469 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:14.375283 15636 heartbeater.cc:344] Connected to a master server at 127.2.223.60:34115
I20260207 20:54:14.376161 15636 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:14.376801 15636 heartbeater.cc:507] Master 127.2.223.60:34115 requested a full tablet report, sending...
I20260207 20:54:14.379076 15409 ts_manager.cc:194] Registered new tserver with Master: 7e64ffb5141a476f84dd8a392043dd55 (127.2.223.2:42819)
W20260207 20:54:14.381063 15643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:14.384032 15637 heartbeater.cc:344] Connected to a master server at 127.2.223.61:40527
I20260207 20:54:14.384431 15637 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:14.385267 15637 heartbeater.cc:507] Master 127.2.223.61:40527 requested a full tablet report, sending...
I20260207 20:54:14.385939 15469 raft_consensus.cc:697] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [term 1 LEADER]: Becoming Leader. State: Replica: 04048058127d456da6bb7ff13c8d17e0, State: Running, Role: LEADER
I20260207 20:54:14.386858 15469 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } }
I20260207 20:54:14.387786 15344 ts_manager.cc:194] Registered new tserver with Master: 7e64ffb5141a476f84dd8a392043dd55 (127.2.223.2:42819)
W20260207 20:54:14.392871 15647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:14.398484 15646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04048058127d456da6bb7ff13c8d17e0. Latest consensus state: current_term: 1 leader_uuid: "04048058127d456da6bb7ff13c8d17e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } } }
I20260207 20:54:14.398941 15638 heartbeater.cc:344] Connected to a master server at 127.2.223.62:38535
I20260207 20:54:14.399246 15646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:14.399489 15638 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:14.400297 15638 heartbeater.cc:507] Master 127.2.223.62:38535 requested a full tablet report, sending...
I20260207 20:54:14.402027 15650 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:54:14.403162 15279 ts_manager.cc:194] Registered new tserver with Master: 7e64ffb5141a476f84dd8a392043dd55 (127.2.223.2:42819)
I20260207 20:54:14.406852 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:14.407733 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:14.407924 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:14.408115 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497654408098 us; error 0 us; skew 500 ppm
I20260207 20:54:14.408555 15650 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:54:14.408656 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:14.414825 2940 webserver.cc:492] Webserver started at http://127.2.223.3:33975/ using document root <none> and password file <none>
I20260207 20:54:14.415467 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:14.415699 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:14.416033 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:14.417407 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "9090d00c580e4119ba04c4f9421328e9"
format_stamp: "Formatted at 2026-02-07 20:54:14 on dist-test-slave-kqw4"
I20260207 20:54:14.423061 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260207 20:54:14.427140 15419 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [term 1 FOLLOWER]: Refusing update from remote peer 04048058127d456da6bb7ff13c8d17e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:54:14.427140 15354 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [term 1 FOLLOWER]: Refusing update from remote peer 04048058127d456da6bb7ff13c8d17e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:54:14.429289 15646 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:14.430064 15469 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:14.433225 15655 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:14.434201 2940 fs_manager.cc:730] Time spent opening block manager: real 0.008s user 0.008s sys 0.000s
I20260207 20:54:14.434540 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "9090d00c580e4119ba04c4f9421328e9"
format_stamp: "Formatted at 2026-02-07 20:54:14 on dist-test-slave-kqw4"
I20260207 20:54:14.434937 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.TestTabletFilters.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:14.447214 15462 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04048058127d456da6bb7ff13c8d17e0. Latest consensus state: current_term: 1 leader_uuid: "04048058127d456da6bb7ff13c8d17e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } } }
I20260207 20:54:14.448032 15462 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:14.470835 15449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04048058127d456da6bb7ff13c8d17e0. Latest consensus state: current_term: 1 leader_uuid: "04048058127d456da6bb7ff13c8d17e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } } }
I20260207 20:54:14.471650 15449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:14.477406 15469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04048058127d456da6bb7ff13c8d17e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } } }
I20260207 20:54:14.478271 15469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:14.478938 15469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04048058127d456da6bb7ff13c8d17e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } } }
I20260207 20:54:14.479704 15469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:14.482681 15650 catalog_manager.cc:1357] Generated new cluster ID: 696234a3a35b4c59a07facbff17884a6
I20260207 20:54:14.483035 15650 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:54:14.489058 15462 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "04048058127d456da6bb7ff13c8d17e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } } }
I20260207 20:54:14.489771 15462 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:14.499248 15449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "04048058127d456da6bb7ff13c8d17e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04048058127d456da6bb7ff13c8d17e0" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 38535 } } peers { permanent_uuid: "99278fc6cdbf436890124a49d95c5f6f" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 40527 } } peers { permanent_uuid: "cc0fd7844b1447239b8606050bf6bc94" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 34115 } } }
I20260207 20:54:14.499814 15449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:14.511338 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:14.512905 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:14.514266 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:14.516863 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:14.517055 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:14.517298 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:14.517441 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:14.538810 15650 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:54:14.540498 15650 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:54:14.579278 15650 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0: Generated new TSK 0
I20260207 20:54:14.579962 15650 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:54:14.592264 15279 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38292
I20260207 20:54:14.599646 15279 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38302
I20260207 20:54:14.609282 15560 heartbeater.cc:499] Master 127.2.223.62:38535 was elected leader, sending a full tablet report...
I20260207 20:54:14.612668 15638 heartbeater.cc:499] Master 127.2.223.62:38535 was elected leader, sending a full tablet report...
I20260207 20:54:14.634932 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:46725
I20260207 20:54:14.635083 15725 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:46725 every 8 connection(s)
I20260207 20:54:14.665565 15728 heartbeater.cc:344] Connected to a master server at 127.2.223.62:38535
I20260207 20:54:14.666016 15728 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:14.666101 15726 heartbeater.cc:344] Connected to a master server at 127.2.223.60:34115
I20260207 20:54:14.666579 15726 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:14.666910 15728 heartbeater.cc:507] Master 127.2.223.62:38535 requested a full tablet report, sending...
I20260207 20:54:14.667308 15726 heartbeater.cc:507] Master 127.2.223.60:34115 requested a full tablet report, sending...
I20260207 20:54:14.669302 15279 ts_manager.cc:194] Registered new tserver with Master: 9090d00c580e4119ba04c4f9421328e9 (127.2.223.3:46725)
I20260207 20:54:14.671010 15279 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38304
I20260207 20:54:14.670915 15408 ts_manager.cc:194] Registered new tserver with Master: 9090d00c580e4119ba04c4f9421328e9 (127.2.223.3:46725)
I20260207 20:54:14.671787 15727 heartbeater.cc:344] Connected to a master server at 127.2.223.61:40527
I20260207 20:54:14.672168 15727 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:14.673255 15727 heartbeater.cc:507] Master 127.2.223.61:40527 requested a full tablet report, sending...
I20260207 20:54:14.676579 15343 ts_manager.cc:194] Registered new tserver with Master: 9090d00c580e4119ba04c4f9421328e9 (127.2.223.3:46725)
I20260207 20:54:14.676734 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.021837371s
I20260207 20:54:14.685091 15728 heartbeater.cc:499] Master 127.2.223.62:38535 was elected leader, sending a full tablet report...
I20260207 20:54:14.727478 15278 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38308:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:54:14.729920 15278 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:54:14.830107 15601 tablet_service.cc:1505] Processing CreateTablet for tablet 9f0c26d2487c4d5db5b1c8d0b1110cd1 (DEFAULT_TABLE table=ksck-test-table [id=8d16f2bdd57f4c239f09f8c6168ad367]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:14.831513 15601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0c26d2487c4d5db5b1c8d0b1110cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:14.833261 15523 tablet_service.cc:1505] Processing CreateTablet for tablet 9f0c26d2487c4d5db5b1c8d0b1110cd1 (DEFAULT_TABLE table=ksck-test-table [id=8d16f2bdd57f4c239f09f8c6168ad367]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:14.834743 15523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0c26d2487c4d5db5b1c8d0b1110cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:14.836423 15600 tablet_service.cc:1505] Processing CreateTablet for tablet 7ff641cf10374b208cd6bac91c288e0b (DEFAULT_TABLE table=ksck-test-table [id=8d16f2bdd57f4c239f09f8c6168ad367]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:14.837414 15521 tablet_service.cc:1505] Processing CreateTablet for tablet 24fb73299efa4a008264946e62019f65 (DEFAULT_TABLE table=ksck-test-table [id=8d16f2bdd57f4c239f09f8c6168ad367]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:14.838049 15599 tablet_service.cc:1505] Processing CreateTablet for tablet 24fb73299efa4a008264946e62019f65 (DEFAULT_TABLE table=ksck-test-table [id=8d16f2bdd57f4c239f09f8c6168ad367]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:14.838793 15521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24fb73299efa4a008264946e62019f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:14.836344 15522 tablet_service.cc:1505] Processing CreateTablet for tablet 7ff641cf10374b208cd6bac91c288e0b (DEFAULT_TABLE table=ksck-test-table [id=8d16f2bdd57f4c239f09f8c6168ad367]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:14.841259 15522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff641cf10374b208cd6bac91c288e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:14.837781 15600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff641cf10374b208cd6bac91c288e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:14.844288 15599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24fb73299efa4a008264946e62019f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:14.854944 15691 tablet_service.cc:1505] Processing CreateTablet for tablet 9f0c26d2487c4d5db5b1c8d0b1110cd1 (DEFAULT_TABLE table=ksck-test-table [id=8d16f2bdd57f4c239f09f8c6168ad367]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:14.856364 15691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0c26d2487c4d5db5b1c8d0b1110cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:14.859032 15690 tablet_service.cc:1505] Processing CreateTablet for tablet 7ff641cf10374b208cd6bac91c288e0b (DEFAULT_TABLE table=ksck-test-table [id=8d16f2bdd57f4c239f09f8c6168ad367]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:14.860375 15690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff641cf10374b208cd6bac91c288e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:14.863582 15689 tablet_service.cc:1505] Processing CreateTablet for tablet 24fb73299efa4a008264946e62019f65 (DEFAULT_TABLE table=ksck-test-table [id=8d16f2bdd57f4c239f09f8c6168ad367]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:14.864912 15689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24fb73299efa4a008264946e62019f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:14.908130 15747 tablet_bootstrap.cc:492] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44: Bootstrap starting.
I20260207 20:54:14.916797 15747 tablet_bootstrap.cc:654] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:14.934230 15748 tablet_bootstrap.cc:492] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55: Bootstrap starting.
I20260207 20:54:14.936812 15749 tablet_bootstrap.cc:492] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9: Bootstrap starting.
I20260207 20:54:14.948448 15749 tablet_bootstrap.cc:654] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:14.952579 15747 tablet_bootstrap.cc:492] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44: No bootstrap required, opened a new log
I20260207 20:54:14.953130 15747 ts_tablet_manager.cc:1403] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44: Time spent bootstrapping tablet: real 0.045s user 0.015s sys 0.004s
I20260207 20:54:14.955761 15747 raft_consensus.cc:359] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:14.956503 15747 raft_consensus.cc:385] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:14.956772 15747 raft_consensus.cc:740] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736d30bec6124579b58ff004aa8a1f44, State: Initialized, Role: FOLLOWER
I20260207 20:54:14.957356 15747 consensus_queue.cc:260] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:14.960079 15747 ts_tablet_manager.cc:1434] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44: Time spent starting tablet: real 0.007s user 0.003s sys 0.002s
I20260207 20:54:14.970388 15747 tablet_bootstrap.cc:492] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44: Bootstrap starting.
I20260207 20:54:14.977489 15748 tablet_bootstrap.cc:654] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:14.983835 15749 tablet_bootstrap.cc:492] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9: No bootstrap required, opened a new log
I20260207 20:54:14.984434 15749 ts_tablet_manager.cc:1403] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9: Time spent bootstrapping tablet: real 0.048s user 0.013s sys 0.004s
I20260207 20:54:14.992132 15747 tablet_bootstrap.cc:654] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:14.987906 15749 raft_consensus.cc:359] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:14.993119 15749 raft_consensus.cc:385] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:14.993498 15749 raft_consensus.cc:740] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9090d00c580e4119ba04c4f9421328e9, State: Initialized, Role: FOLLOWER
I20260207 20:54:14.994238 15749 consensus_queue.cc:260] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.054736 15749 ts_tablet_manager.cc:1434] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9: Time spent starting tablet: real 0.070s user 0.026s sys 0.034s
I20260207 20:54:15.058130 15749 tablet_bootstrap.cc:492] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9: Bootstrap starting.
I20260207 20:54:15.065495 15749 tablet_bootstrap.cc:654] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:15.088660 15747 tablet_bootstrap.cc:492] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44: No bootstrap required, opened a new log
I20260207 20:54:15.104285 15747 ts_tablet_manager.cc:1403] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44: Time spent bootstrapping tablet: real 0.134s user 0.010s sys 0.001s
I20260207 20:54:15.090941 15460 catalog_manager.cc:1269] Loaded cluster ID: 696234a3a35b4c59a07facbff17884a6
I20260207 20:54:15.106006 15460 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f: loading cluster ID for follower catalog manager: success
I20260207 20:54:15.117769 15477 catalog_manager.cc:1269] Loaded cluster ID: 696234a3a35b4c59a07facbff17884a6
I20260207 20:54:15.118302 15477 catalog_manager.cc:1562] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94: loading cluster ID for follower catalog manager: success
I20260207 20:54:15.134747 15477 catalog_manager.cc:1584] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94: acquiring CA information for follower catalog manager: success
I20260207 20:54:15.167403 15747 raft_consensus.cc:359] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.168270 15747 raft_consensus.cc:385] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:15.168572 15747 raft_consensus.cc:740] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736d30bec6124579b58ff004aa8a1f44, State: Initialized, Role: FOLLOWER
I20260207 20:54:15.169245 15755 raft_consensus.cc:493] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:15.170017 15755 raft_consensus.cc:515] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.207501 15747 consensus_queue.cc:260] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.208818 15755 leader_election.cc:290] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736d30bec6124579b58ff004aa8a1f44 (127.2.223.1:45463), 7e64ffb5141a476f84dd8a392043dd55 (127.2.223.2:42819)
I20260207 20:54:15.210142 15747 ts_tablet_manager.cc:1434] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44: Time spent starting tablet: real 0.072s user 0.005s sys 0.000s
I20260207 20:54:15.213969 15477 catalog_manager.cc:1612] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:54:15.215719 15748 tablet_bootstrap.cc:492] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55: No bootstrap required, opened a new log
I20260207 20:54:15.216686 15460 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f: acquiring CA information for follower catalog manager: success
I20260207 20:54:15.216679 15748 ts_tablet_manager.cc:1403] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55: Time spent bootstrapping tablet: real 0.283s user 0.090s sys 0.112s
I20260207 20:54:15.228161 15611 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "24fb73299efa4a008264946e62019f65" candidate_uuid: "9090d00c580e4119ba04c4f9421328e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e64ffb5141a476f84dd8a392043dd55" is_pre_election: true
I20260207 20:54:15.245468 15748 raft_consensus.cc:359] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.246274 15748 raft_consensus.cc:385] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:15.246610 15748 raft_consensus.cc:740] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e64ffb5141a476f84dd8a392043dd55, State: Initialized, Role: FOLLOWER
I20260207 20:54:15.247362 15748 consensus_queue.cc:260] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
W20260207 20:54:15.248682 15657 leader_election.cc:343] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e64ffb5141a476f84dd8a392043dd55 (127.2.223.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:54:15.258800 15749 tablet_bootstrap.cc:492] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9: No bootstrap required, opened a new log
I20260207 20:54:15.259374 15749 ts_tablet_manager.cc:1403] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9: Time spent bootstrapping tablet: real 0.204s user 0.072s sys 0.078s
I20260207 20:54:15.262286 15747 tablet_bootstrap.cc:492] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44: Bootstrap starting.
I20260207 20:54:15.263420 15460 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:54:15.263703 15749 raft_consensus.cc:359] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } }
I20260207 20:54:15.264703 15749 raft_consensus.cc:385] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:15.265157 15749 raft_consensus.cc:740] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9090d00c580e4119ba04c4f9421328e9, State: Initialized, Role: FOLLOWER
I20260207 20:54:15.265898 15749 consensus_queue.cc:260] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } }
I20260207 20:54:15.269184 15749 ts_tablet_manager.cc:1434] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9: Time spent starting tablet: real 0.008s user 0.004s sys 0.002s
I20260207 20:54:15.270251 15749 tablet_bootstrap.cc:492] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9: Bootstrap starting.
I20260207 20:54:15.274144 15747 tablet_bootstrap.cc:654] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:15.275990 15749 tablet_bootstrap.cc:654] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:15.284498 15749 tablet_bootstrap.cc:492] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9: No bootstrap required, opened a new log
I20260207 20:54:15.285430 15749 ts_tablet_manager.cc:1403] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.001s
I20260207 20:54:15.289772 15749 raft_consensus.cc:359] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.290539 15749 raft_consensus.cc:385] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:15.290879 15749 raft_consensus.cc:740] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9090d00c580e4119ba04c4f9421328e9, State: Initialized, Role: FOLLOWER
I20260207 20:54:15.292776 15747 tablet_bootstrap.cc:492] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44: No bootstrap required, opened a new log
I20260207 20:54:15.295042 15747 ts_tablet_manager.cc:1403] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44: Time spent bootstrapping tablet: real 0.033s user 0.009s sys 0.003s
I20260207 20:54:15.291580 15749 consensus_queue.cc:260] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.294450 15748 ts_tablet_manager.cc:1434] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55: Time spent starting tablet: real 0.052s user 0.012s sys 0.009s
I20260207 20:54:15.298316 15749 ts_tablet_manager.cc:1434] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260207 20:54:15.299700 15748 tablet_bootstrap.cc:492] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55: Bootstrap starting.
I20260207 20:54:15.305359 15748 tablet_bootstrap.cc:654] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:15.309162 15533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "24fb73299efa4a008264946e62019f65" candidate_uuid: "9090d00c580e4119ba04c4f9421328e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736d30bec6124579b58ff004aa8a1f44" is_pre_election: true
I20260207 20:54:15.310812 15533 raft_consensus.cc:2468] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9090d00c580e4119ba04c4f9421328e9 in term 0.
I20260207 20:54:15.306937 15747 raft_consensus.cc:359] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } }
I20260207 20:54:15.312642 15747 raft_consensus.cc:385] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:15.312988 15747 raft_consensus.cc:740] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736d30bec6124579b58ff004aa8a1f44, State: Initialized, Role: FOLLOWER
I20260207 20:54:15.313689 15747 consensus_queue.cc:260] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } }
I20260207 20:54:15.312112 15662 leader_election.cc:304] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736d30bec6124579b58ff004aa8a1f44, 9090d00c580e4119ba04c4f9421328e9; no voters: 7e64ffb5141a476f84dd8a392043dd55
I20260207 20:54:15.315897 15755 raft_consensus.cc:2804] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:15.316251 15755 raft_consensus.cc:493] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:15.316573 15755 raft_consensus.cc:3060] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:15.325580 15747 ts_tablet_manager.cc:1434] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44: Time spent starting tablet: real 0.030s user 0.003s sys 0.003s
I20260207 20:54:15.328100 15755 raft_consensus.cc:515] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.332262 15533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "24fb73299efa4a008264946e62019f65" candidate_uuid: "9090d00c580e4119ba04c4f9421328e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736d30bec6124579b58ff004aa8a1f44"
I20260207 20:54:15.332863 15533 raft_consensus.cc:3060] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:15.341300 15755 leader_election.cc:290] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [CANDIDATE]: Term 1 election: Requested vote from peers 736d30bec6124579b58ff004aa8a1f44 (127.2.223.1:45463), 7e64ffb5141a476f84dd8a392043dd55 (127.2.223.2:42819)
I20260207 20:54:15.342214 15748 tablet_bootstrap.cc:492] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55: No bootstrap required, opened a new log
I20260207 20:54:15.342836 15748 ts_tablet_manager.cc:1403] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55: Time spent bootstrapping tablet: real 0.043s user 0.016s sys 0.017s
I20260207 20:54:15.343703 15611 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "24fb73299efa4a008264946e62019f65" candidate_uuid: "9090d00c580e4119ba04c4f9421328e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e64ffb5141a476f84dd8a392043dd55"
W20260207 20:54:15.345091 15657 leader_election.cc:343] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e64ffb5141a476f84dd8a392043dd55 (127.2.223.2:42819): Illegal state: must be running to vote when last-logged opid is not known
I20260207 20:54:15.346493 15748 raft_consensus.cc:359] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } }
I20260207 20:54:15.347292 15748 raft_consensus.cc:385] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:15.347615 15748 raft_consensus.cc:740] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e64ffb5141a476f84dd8a392043dd55, State: Initialized, Role: FOLLOWER
I20260207 20:54:15.347658 15533 raft_consensus.cc:2468] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9090d00c580e4119ba04c4f9421328e9 in term 1.
I20260207 20:54:15.348444 15748 consensus_queue.cc:260] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } }
I20260207 20:54:15.351181 15748 ts_tablet_manager.cc:1434] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260207 20:54:15.352046 15748 tablet_bootstrap.cc:492] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55: Bootstrap starting.
I20260207 20:54:15.357000 15748 tablet_bootstrap.cc:654] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:15.357683 15662 leader_election.cc:304] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736d30bec6124579b58ff004aa8a1f44, 9090d00c580e4119ba04c4f9421328e9; no voters: 7e64ffb5141a476f84dd8a392043dd55
I20260207 20:54:15.362013 15755 raft_consensus.cc:2804] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:15.369998 15755 raft_consensus.cc:697] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [term 1 LEADER]: Becoming Leader. State: Replica: 9090d00c580e4119ba04c4f9421328e9, State: Running, Role: LEADER
I20260207 20:54:15.371268 15755 consensus_queue.cc:237] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.373451 15748 tablet_bootstrap.cc:492] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55: No bootstrap required, opened a new log
I20260207 20:54:15.373988 15748 ts_tablet_manager.cc:1403] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55: Time spent bootstrapping tablet: real 0.022s user 0.010s sys 0.011s
I20260207 20:54:15.378014 15748 raft_consensus.cc:359] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.378757 15748 raft_consensus.cc:385] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:15.379089 15748 raft_consensus.cc:740] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e64ffb5141a476f84dd8a392043dd55, State: Initialized, Role: FOLLOWER
I20260207 20:54:15.379815 15748 consensus_queue.cc:260] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.382364 15748 ts_tablet_manager.cc:1434] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55: Time spent starting tablet: real 0.008s user 0.000s sys 0.006s
I20260207 20:54:15.392432 15279 catalog_manager.cc:5654] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9090d00c580e4119ba04c4f9421328e9 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "9090d00c580e4119ba04c4f9421328e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } health_report { overall_health: HEALTHY } } }
I20260207 20:54:15.468343 15758 raft_consensus.cc:493] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:15.468854 15758 raft_consensus.cc:515] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.472681 15758 leader_election.cc:290] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736d30bec6124579b58ff004aa8a1f44 (127.2.223.1:45463), 9090d00c580e4119ba04c4f9421328e9 (127.2.223.3:46725)
I20260207 20:54:15.487872 15533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "24fb73299efa4a008264946e62019f65" candidate_uuid: "7e64ffb5141a476f84dd8a392043dd55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736d30bec6124579b58ff004aa8a1f44" is_pre_election: true
I20260207 20:54:15.488258 15701 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "24fb73299efa4a008264946e62019f65" candidate_uuid: "7e64ffb5141a476f84dd8a392043dd55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9090d00c580e4119ba04c4f9421328e9" is_pre_election: true
I20260207 20:54:15.489555 15533 raft_consensus.cc:2393] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e64ffb5141a476f84dd8a392043dd55 in current term 1: Already voted for candidate 9090d00c580e4119ba04c4f9421328e9 in this term.
I20260207 20:54:15.490418 15576 leader_election.cc:304] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e64ffb5141a476f84dd8a392043dd55; no voters: 736d30bec6124579b58ff004aa8a1f44, 9090d00c580e4119ba04c4f9421328e9
I20260207 20:54:15.491217 15758 raft_consensus.cc:3060] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:15.496937 15758 raft_consensus.cc:2749] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260207 20:54:15.510960 15752 raft_consensus.cc:493] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:15.511543 15752 raft_consensus.cc:515] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.513993 15752 leader_election.cc:290] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e64ffb5141a476f84dd8a392043dd55 (127.2.223.2:42819), 9090d00c580e4119ba04c4f9421328e9 (127.2.223.3:46725)
I20260207 20:54:15.527488 15701 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ff641cf10374b208cd6bac91c288e0b" candidate_uuid: "736d30bec6124579b58ff004aa8a1f44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9090d00c580e4119ba04c4f9421328e9" is_pre_election: true
I20260207 20:54:15.528083 15701 raft_consensus.cc:2468] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736d30bec6124579b58ff004aa8a1f44 in term 0.
I20260207 20:54:15.529249 15499 leader_election.cc:304] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736d30bec6124579b58ff004aa8a1f44, 9090d00c580e4119ba04c4f9421328e9; no voters:
I20260207 20:54:15.530128 15752 raft_consensus.cc:2804] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:15.530205 15755 raft_consensus.cc:493] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:15.530555 15752 raft_consensus.cc:493] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:15.531100 15752 raft_consensus.cc:3060] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:15.530817 15755 raft_consensus.cc:515] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } }
I20260207 20:54:15.532823 15755 leader_election.cc:290] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e64ffb5141a476f84dd8a392043dd55 (127.2.223.2:42819), 736d30bec6124579b58ff004aa8a1f44 (127.2.223.1:45463)
I20260207 20:54:15.535298 15611 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ff641cf10374b208cd6bac91c288e0b" candidate_uuid: "736d30bec6124579b58ff004aa8a1f44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e64ffb5141a476f84dd8a392043dd55" is_pre_election: true
I20260207 20:54:15.535976 15611 raft_consensus.cc:2468] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736d30bec6124579b58ff004aa8a1f44 in term 0.
I20260207 20:54:15.540784 15533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f0c26d2487c4d5db5b1c8d0b1110cd1" candidate_uuid: "9090d00c580e4119ba04c4f9421328e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736d30bec6124579b58ff004aa8a1f44" is_pre_election: true
I20260207 20:54:15.541440 15533 raft_consensus.cc:2468] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9090d00c580e4119ba04c4f9421328e9 in term 0.
I20260207 20:54:15.538317 15752 raft_consensus.cc:515] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.544323 15611 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f0c26d2487c4d5db5b1c8d0b1110cd1" candidate_uuid: "9090d00c580e4119ba04c4f9421328e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e64ffb5141a476f84dd8a392043dd55" is_pre_election: true
I20260207 20:54:15.544190 15662 leader_election.cc:304] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736d30bec6124579b58ff004aa8a1f44, 9090d00c580e4119ba04c4f9421328e9; no voters:
I20260207 20:54:15.544975 15611 raft_consensus.cc:2468] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9090d00c580e4119ba04c4f9421328e9 in term 0.
I20260207 20:54:15.545260 15755 raft_consensus.cc:2804] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:15.545645 15755 raft_consensus.cc:493] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:15.546021 15755 raft_consensus.cc:3060] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:15.547695 15611 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ff641cf10374b208cd6bac91c288e0b" candidate_uuid: "736d30bec6124579b58ff004aa8a1f44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e64ffb5141a476f84dd8a392043dd55"
I20260207 20:54:15.548260 15752 leader_election.cc:290] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [CANDIDATE]: Term 1 election: Requested vote from peers 7e64ffb5141a476f84dd8a392043dd55 (127.2.223.2:42819), 9090d00c580e4119ba04c4f9421328e9 (127.2.223.3:46725)
I20260207 20:54:15.548367 15611 raft_consensus.cc:3060] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:15.553833 15701 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ff641cf10374b208cd6bac91c288e0b" candidate_uuid: "736d30bec6124579b58ff004aa8a1f44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9090d00c580e4119ba04c4f9421328e9"
I20260207 20:54:15.554437 15701 raft_consensus.cc:3060] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:15.556556 15755 raft_consensus.cc:515] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } }
I20260207 20:54:15.558512 15755 leader_election.cc:290] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [CANDIDATE]: Term 1 election: Requested vote from peers 7e64ffb5141a476f84dd8a392043dd55 (127.2.223.2:42819), 736d30bec6124579b58ff004aa8a1f44 (127.2.223.1:45463)
I20260207 20:54:15.559966 15533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f0c26d2487c4d5db5b1c8d0b1110cd1" candidate_uuid: "9090d00c580e4119ba04c4f9421328e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736d30bec6124579b58ff004aa8a1f44"
I20260207 20:54:15.560568 15533 raft_consensus.cc:3060] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:15.561510 15611 raft_consensus.cc:2468] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736d30bec6124579b58ff004aa8a1f44 in term 1.
I20260207 20:54:15.568553 15533 raft_consensus.cc:2468] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9090d00c580e4119ba04c4f9421328e9 in term 1.
I20260207 20:54:15.568774 15496 leader_election.cc:304] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736d30bec6124579b58ff004aa8a1f44, 7e64ffb5141a476f84dd8a392043dd55; no voters:
I20260207 20:54:15.569638 15752 raft_consensus.cc:2804] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:15.570276 15701 raft_consensus.cc:2468] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736d30bec6124579b58ff004aa8a1f44 in term 1.
I20260207 20:54:15.571107 15752 raft_consensus.cc:697] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [term 1 LEADER]: Becoming Leader. State: Replica: 736d30bec6124579b58ff004aa8a1f44, State: Running, Role: LEADER
I20260207 20:54:15.572373 15611 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f0c26d2487c4d5db5b1c8d0b1110cd1" candidate_uuid: "9090d00c580e4119ba04c4f9421328e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e64ffb5141a476f84dd8a392043dd55"
I20260207 20:54:15.572985 15611 raft_consensus.cc:3060] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:15.572522 15752 consensus_queue.cc:237] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } }
I20260207 20:54:15.573613 15662 leader_election.cc:304] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736d30bec6124579b58ff004aa8a1f44, 9090d00c580e4119ba04c4f9421328e9; no voters:
I20260207 20:54:15.574717 15755 raft_consensus.cc:2804] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:15.576490 15755 raft_consensus.cc:697] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [term 1 LEADER]: Becoming Leader. State: Replica: 9090d00c580e4119ba04c4f9421328e9, State: Running, Role: LEADER
I20260207 20:54:15.577174 15755 consensus_queue.cc:237] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } } peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } }
I20260207 20:54:15.579777 15611 raft_consensus.cc:2468] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9090d00c580e4119ba04c4f9421328e9 in term 1.
I20260207 20:54:15.586110 15277 catalog_manager.cc:5654] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736d30bec6124579b58ff004aa8a1f44 (127.2.223.1). New cstate: current_term: 1 leader_uuid: "736d30bec6124579b58ff004aa8a1f44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } health_report { overall_health: UNKNOWN } } }
I20260207 20:54:15.595271 15279 catalog_manager.cc:5654] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9090d00c580e4119ba04c4f9421328e9 (127.2.223.3). New cstate: current_term: 1 leader_uuid: "9090d00c580e4119ba04c4f9421328e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 } health_report { overall_health: UNKNOWN } } }
I20260207 20:54:15.777997 15755 consensus_queue.cc:1048] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:15.842437 15755 consensus_queue.cc:1048] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:15.991597 15752 consensus_queue.cc:1048] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9090d00c580e4119ba04c4f9421328e9" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:16.018545 15755 consensus_queue.cc:1048] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260207 20:54:16.045030 15763 consensus_queue.cc:1048] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "736d30bec6124579b58ff004aa8a1f44" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:16.065629 15777 consensus_queue.cc:1048] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e64ffb5141a476f84dd8a392043dd55" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 42819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:16.391359 15690 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260207 20:54:16.397764 15600 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260207 20:54:16.404827 15521 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260207 20:54:16.795575 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:54:16.852101 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:16.852809 2940 tablet_replica.cc:333] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44: stopping tablet replica
I20260207 20:54:16.853418 2940 raft_consensus.cc:2243] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:16.853830 2940 raft_consensus.cc:2272] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 736d30bec6124579b58ff004aa8a1f44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:16.856664 2940 tablet_replica.cc:333] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44: stopping tablet replica
I20260207 20:54:16.857350 2940 raft_consensus.cc:2243] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [term 1 LEADER]: Raft consensus shutting down.
W20260207 20:54:16.858137 15662 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
I20260207 20:54:16.858290 2940 raft_consensus.cc:2272] T 7ff641cf10374b208cd6bac91c288e0b P 736d30bec6124579b58ff004aa8a1f44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:16.862138 2940 tablet_replica.cc:333] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44: stopping tablet replica
I20260207 20:54:16.862720 2940 raft_consensus.cc:2243] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:16.863209 2940 raft_consensus.cc:2272] T 24fb73299efa4a008264946e62019f65 P 736d30bec6124579b58ff004aa8a1f44 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260207 20:54:16.874346 15662 consensus_peers.cc:597] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 -> Peer 736d30bec6124579b58ff004aa8a1f44 (127.2.223.1:45463): Couldn't send request to peer 736d30bec6124579b58ff004aa8a1f44. Status: Network error: recv got EOF from 127.2.223.1:45463 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260207 20:54:16.875262 2940 connection.cc:441] server connection from 127.0.0.1:47190 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47190 (request call id 11) could send its response
I20260207 20:54:16.883383 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
W20260207 20:54:16.897426 15662 consensus_peers.cc:597] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 -> Peer 736d30bec6124579b58ff004aa8a1f44 (127.2.223.1:45463): Couldn't send request to peer 736d30bec6124579b58ff004aa8a1f44. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:45463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:54:16.898700 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
I20260207 20:54:16.928920 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:16.929530 2940 tablet_replica.cc:333] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55: stopping tablet replica
I20260207 20:54:16.930095 2940 raft_consensus.cc:2243] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:16.930507 2940 raft_consensus.cc:2272] T 24fb73299efa4a008264946e62019f65 P 7e64ffb5141a476f84dd8a392043dd55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:16.932281 2940 tablet_replica.cc:333] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55: stopping tablet replica
I20260207 20:54:16.932729 2940 raft_consensus.cc:2243] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:16.933091 2940 raft_consensus.cc:2272] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 7e64ffb5141a476f84dd8a392043dd55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:16.935204 2940 tablet_replica.cc:333] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55: stopping tablet replica
I20260207 20:54:16.935669 2940 raft_consensus.cc:2243] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:16.936064 2940 raft_consensus.cc:2272] T 7ff641cf10374b208cd6bac91c288e0b P 7e64ffb5141a476f84dd8a392043dd55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:16.957152 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
I20260207 20:54:16.970791 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:54:16.998369 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:16.998998 2940 tablet_replica.cc:333] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9: stopping tablet replica
I20260207 20:54:16.999593 2940 raft_consensus.cc:2243] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:16.999985 2940 raft_consensus.cc:2272] T 7ff641cf10374b208cd6bac91c288e0b P 9090d00c580e4119ba04c4f9421328e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:17.002002 2940 tablet_replica.cc:333] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9: stopping tablet replica
I20260207 20:54:17.002471 2940 raft_consensus.cc:2243] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:17.003225 2940 raft_consensus.cc:2272] T 9f0c26d2487c4d5db5b1c8d0b1110cd1 P 9090d00c580e4119ba04c4f9421328e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:17.005280 2940 tablet_replica.cc:333] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9: stopping tablet replica
I20260207 20:54:17.005700 2940 raft_consensus.cc:2243] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:17.006412 2940 raft_consensus.cc:2272] T 24fb73299efa4a008264946e62019f65 P 9090d00c580e4119ba04c4f9421328e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:17.027568 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:54:17.039973 2940 master.cc:561] Master@127.2.223.62:38535 shutting down...
I20260207 20:54:17.055804 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:17.056675 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:17.056998 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 04048058127d456da6bb7ff13c8d17e0: stopping tablet replica
I20260207 20:54:17.076227 2940 master.cc:583] Master@127.2.223.62:38535 shutdown complete.
I20260207 20:54:17.087839 2940 master.cc:561] Master@127.2.223.61:40527 shutting down...
I20260207 20:54:17.103576 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:17.104063 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:17.104337 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P 99278fc6cdbf436890124a49d95c5f6f: stopping tablet replica
I20260207 20:54:17.122294 2940 master.cc:583] Master@127.2.223.61:40527 shutdown complete.
I20260207 20:54:17.134085 2940 master.cc:561] Master@127.2.223.60:34115 shutting down...
I20260207 20:54:17.149236 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:17.149751 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:17.150046 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P cc0fd7844b1447239b8606050bf6bc94: stopping tablet replica
I20260207 20:54:17.168205 2940 master.cc:583] Master@127.2.223.60:34115 shutdown complete.
[ OK ] RemoteKsckTest.TestTabletFilters (3397 ms)
[ RUN ] RemoteKsckTest.RangeKeysInTabletSummaries
I20260207 20:54:17.196740 2940 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.223.62:41299,127.2.223.61:41183,127.2.223.60:35539
I20260207 20:54:17.197986 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:17.202877 15831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:17.203406 15830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:17.204030 15833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:17.204732 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:17.205559 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:17.205727 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:17.205860 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497657205844 us; error 0 us; skew 500 ppm
I20260207 20:54:17.206337 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:17.208374 2940 webserver.cc:492] Webserver started at http://127.2.223.62:43197/ using document root <none> and password file <none>
I20260207 20:54:17.208808 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:17.208968 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:17.209203 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:17.210186 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-0-root/instance:
uuid: "fc057bb7584a49ee8338d84886240f67"
format_stamp: "Formatted at 2026-02-07 20:54:17 on dist-test-slave-kqw4"
I20260207 20:54:17.214161 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s
I20260207 20:54:17.217375 15838 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:17.218128 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:54:17.218410 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-0-root
uuid: "fc057bb7584a49ee8338d84886240f67"
format_stamp: "Formatted at 2026-02-07 20:54:17 on dist-test-slave-kqw4"
I20260207 20:54:17.218684 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:17.232661 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:17.233609 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:17.266008 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.62:41299
I20260207 20:54:17.266103 15889 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.62:41299 every 8 connection(s)
I20260207 20:54:17.269536 15890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:17.269703 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:17.274637 15892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:17.275571 15893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:17.277603 15890 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } has no permanent_uuid. Determining permanent_uuid...
W20260207 20:54:17.277974 15895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:17.278524 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:17.279405 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:17.279601 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:17.279754 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497657279737 us; error 0 us; skew 500 ppm
I20260207 20:54:17.280231 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:17.283355 2940 webserver.cc:492] Webserver started at http://127.2.223.61:38561/ using document root <none> and password file <none>
I20260207 20:54:17.283982 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:17.284210 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:17.284507 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:17.285665 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-1-root/instance:
uuid: "ed167cc66b0449abbc7e8461254ce81e"
format_stamp: "Formatted at 2026-02-07 20:54:17 on dist-test-slave-kqw4"
I20260207 20:54:17.291139 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260207 20:54:17.291572 15890 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:17.295312 15903 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:17.296108 2940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260207 20:54:17.296371 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-1-root
uuid: "ed167cc66b0449abbc7e8461254ce81e"
format_stamp: "Formatted at 2026-02-07 20:54:17 on dist-test-slave-kqw4"
W20260207 20:54:17.296680 15890 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.61:41183: Network error: Client connection negotiation failed: client connection to 127.2.223.61:41183: connect: Connection refused (error 111)
I20260207 20:54:17.296687 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:17.307463 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:17.308389 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:17.342032 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.61:41183
I20260207 20:54:17.342139 15954 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.61:41183 every 8 connection(s)
I20260207 20:54:17.345196 15890 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } attempt: 1
I20260207 20:54:17.345801 15955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:17.345816 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:17.351769 15958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:17.352878 15959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:17.357191 15955 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:17.360718 15890 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:17.363044 2940 server_base.cc:1060] running on GCE node
W20260207 20:54:17.363758 15961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:17.364794 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:17.365064 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:17.365259 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497657365241 us; error 0 us; skew 500 ppm
I20260207 20:54:17.365970 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260207 20:54:17.365829 15890 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:35539: Network error: Client connection negotiation failed: client connection to 127.2.223.60:35539: connect: Connection refused (error 111)
I20260207 20:54:17.368584 2940 webserver.cc:492] Webserver started at http://127.2.223.60:44819/ using document root <none> and password file <none>
I20260207 20:54:17.369203 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:17.369439 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:17.369441 15955 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:17.369926 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:17.371255 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-2-root/instance:
uuid: "ec0995e277f24292923136167b8a3c62"
format_stamp: "Formatted at 2026-02-07 20:54:17 on dist-test-slave-kqw4"
I20260207 20:54:17.375792 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260207 20:54:17.378927 15955 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:17.379678 15967 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:17.380512 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260207 20:54:17.380843 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-2-root
uuid: "ec0995e277f24292923136167b8a3c62"
format_stamp: "Formatted at 2026-02-07 20:54:17 on dist-test-slave-kqw4"
I20260207 20:54:17.381160 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260207 20:54:17.384234 15955 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:35539: Network error: Client connection negotiation failed: client connection to 127.2.223.60:35539: connect: Connection refused (error 111)
I20260207 20:54:17.395955 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:17.397038 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:17.404672 15890 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } attempt: 1
W20260207 20:54:17.409430 15890 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:35539: Network error: Client connection negotiation failed: client connection to 127.2.223.60:35539: connect: Connection refused (error 111)
I20260207 20:54:17.422705 15955 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } attempt: 1
W20260207 20:54:17.427197 15955 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.223.60:35539: Network error: Client connection negotiation failed: client connection to 127.2.223.60:35539: connect: Connection refused (error 111)
I20260207 20:54:17.434638 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.60:35539
I20260207 20:54:17.434710 16019 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.60:35539 every 8 connection(s)
I20260207 20:54:17.438351 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260207 20:54:17.439030 16020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:17.445075 16020 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:17.450918 15890 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } attempt: 2
I20260207 20:54:17.455783 16020 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:17.465438 16020 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } has no permanent_uuid. Determining permanent_uuid...
I20260207 20:54:17.467914 15890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67: Bootstrap starting.
I20260207 20:54:17.472389 15890 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:17.476562 15890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67: No bootstrap required, opened a new log
I20260207 20:54:17.477632 15955 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } attempt: 2
I20260207 20:54:17.478648 15890 raft_consensus.cc:359] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } }
I20260207 20:54:17.479368 15890 raft_consensus.cc:385] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:17.479635 15890 raft_consensus.cc:740] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc057bb7584a49ee8338d84886240f67, State: Initialized, Role: FOLLOWER
I20260207 20:54:17.480664 16020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62: Bootstrap starting.
I20260207 20:54:17.480317 15890 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } }
I20260207 20:54:17.482273 16025 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } } }
I20260207 20:54:17.483183 16025 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:17.483939 15890 sys_catalog.cc:565] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:54:17.486522 16020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:17.491496 16020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62: No bootstrap required, opened a new log
I20260207 20:54:17.494056 16020 raft_consensus.cc:359] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } }
I20260207 20:54:17.494755 16020 raft_consensus.cc:385] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:17.495031 16020 raft_consensus.cc:740] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec0995e277f24292923136167b8a3c62, State: Initialized, Role: FOLLOWER
I20260207 20:54:17.495772 16020 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } }
I20260207 20:54:17.497160 15955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e: Bootstrap starting.
I20260207 20:54:17.497905 16035 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } } }
I20260207 20:54:17.498888 16035 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:17.499770 16020 sys_catalog.cc:565] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [sys.catalog]: configured and running, proceeding with master startup.
I20260207 20:54:17.501466 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260207 20:54:17.503417 15955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e: Neither blocks nor log segments found. Creating new log.
W20260207 20:54:17.504595 16038 catalog_manager.cc:1568] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:17.504859 16038 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:54:17.508569 15955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e: No bootstrap required, opened a new log
I20260207 20:54:17.511476 15955 raft_consensus.cc:359] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } }
I20260207 20:54:17.512198 15955 raft_consensus.cc:385] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:17.512488 15955 raft_consensus.cc:740] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed167cc66b0449abbc7e8461254ce81e, State: Initialized, Role: FOLLOWER
I20260207 20:54:17.513307 15955 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } }
I20260207 20:54:17.515293 16051 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } } }
I20260207 20:54:17.516018 16051 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [sys.catalog]: This master's current role is: FOLLOWER
W20260207 20:54:17.516737 16050 catalog_manager.cc:1568] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260207 20:54:17.516867 15955 sys_catalog.cc:565] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [sys.catalog]: configured and running, proceeding with master startup.
W20260207 20:54:17.517024 16050 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260207 20:54:17.526192 2940 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260207 20:54:17.527995 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260207 20:54:17.530002 16062 catalog_manager.cc:1568] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260207 20:54:17.530364 16062 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260207 20:54:17.534406 16063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:17.535010 16064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260207 20:54:17.536756 16066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:17.537153 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:17.537887 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:17.538085 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:17.538244 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497657538231 us; error 0 us; skew 500 ppm
I20260207 20:54:17.538754 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:17.540764 2940 webserver.cc:492] Webserver started at http://127.2.223.1:42917/ using document root <none> and password file <none>
I20260207 20:54:17.541190 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:17.541368 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:17.541594 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:17.542636 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-0-root/instance:
uuid: "2e1dd5c7b4e7462398fb6aee845139ec"
format_stamp: "Formatted at 2026-02-07 20:54:17 on dist-test-slave-kqw4"
I20260207 20:54:17.546536 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260207 20:54:17.549436 16071 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:17.549399 16051 raft_consensus.cc:493] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:17.549952 16051 raft_consensus.cc:515] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } }
I20260207 20:54:17.550351 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260207 20:54:17.550721 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-0-root
uuid: "2e1dd5c7b4e7462398fb6aee845139ec"
format_stamp: "Formatted at 2026-02-07 20:54:17 on dist-test-slave-kqw4"
I20260207 20:54:17.550951 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:17.551568 16051 leader_election.cc:290] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc057bb7584a49ee8338d84886240f67 (127.2.223.62:41299), ec0995e277f24292923136167b8a3c62 (127.2.223.60:35539)
I20260207 20:54:17.552263 15865 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed167cc66b0449abbc7e8461254ce81e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc057bb7584a49ee8338d84886240f67" is_pre_election: true
I20260207 20:54:17.552641 15995 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed167cc66b0449abbc7e8461254ce81e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec0995e277f24292923136167b8a3c62" is_pre_election: true
I20260207 20:54:17.552922 15865 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed167cc66b0449abbc7e8461254ce81e in term 0.
I20260207 20:54:17.553289 15995 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed167cc66b0449abbc7e8461254ce81e in term 0.
I20260207 20:54:17.554153 15906 leader_election.cc:304] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed167cc66b0449abbc7e8461254ce81e, fc057bb7584a49ee8338d84886240f67; no voters:
I20260207 20:54:17.554947 16051 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:17.555255 16051 raft_consensus.cc:493] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:17.555583 16051 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:17.560266 16051 raft_consensus.cc:515] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } }
I20260207 20:54:17.561678 16051 leader_election.cc:290] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [CANDIDATE]: Term 1 election: Requested vote from peers fc057bb7584a49ee8338d84886240f67 (127.2.223.62:41299), ec0995e277f24292923136167b8a3c62 (127.2.223.60:35539)
I20260207 20:54:17.562307 15865 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed167cc66b0449abbc7e8461254ce81e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc057bb7584a49ee8338d84886240f67"
I20260207 20:54:17.562577 15995 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed167cc66b0449abbc7e8461254ce81e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec0995e277f24292923136167b8a3c62"
I20260207 20:54:17.562883 15865 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:17.563143 15995 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:17.567732 15995 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed167cc66b0449abbc7e8461254ce81e in term 1.
I20260207 20:54:17.568579 15906 leader_election.cc:304] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec0995e277f24292923136167b8a3c62, ed167cc66b0449abbc7e8461254ce81e; no voters:
I20260207 20:54:17.569228 16051 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:17.569196 15865 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed167cc66b0449abbc7e8461254ce81e in term 1.
I20260207 20:54:17.570803 16051 raft_consensus.cc:697] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [term 1 LEADER]: Becoming Leader. State: Replica: ed167cc66b0449abbc7e8461254ce81e, State: Running, Role: LEADER
I20260207 20:54:17.571555 16051 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } }
I20260207 20:54:17.576314 16076 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed167cc66b0449abbc7e8461254ce81e. Latest consensus state: current_term: 1 leader_uuid: "ed167cc66b0449abbc7e8461254ce81e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } } }
I20260207 20:54:17.576979 16076 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:17.578364 16078 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260207 20:54:17.582792 16078 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260207 20:54:17.588696 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:17.590075 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:17.590801 15865 raft_consensus.cc:1275] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [term 1 FOLLOWER]: Refusing update from remote peer ed167cc66b0449abbc7e8461254ce81e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:54:17.590744 15995 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [term 1 FOLLOWER]: Refusing update from remote peer ed167cc66b0449abbc7e8461254ce81e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260207 20:54:17.591874 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:17.592332 16076 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:17.593053 16051 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260207 20:54:17.594856 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:17.595085 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:17.595369 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:17.595568 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:17.600911 16035 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed167cc66b0449abbc7e8461254ce81e. Latest consensus state: current_term: 1 leader_uuid: "ed167cc66b0449abbc7e8461254ce81e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } } }
I20260207 20:54:17.601622 16035 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:17.604084 16025 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed167cc66b0449abbc7e8461254ce81e. Latest consensus state: current_term: 1 leader_uuid: "ed167cc66b0449abbc7e8461254ce81e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } } }
I20260207 20:54:17.604862 16025 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:17.609285 16076 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ed167cc66b0449abbc7e8461254ce81e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } } }
I20260207 20:54:17.610018 16076 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:17.611320 16078 catalog_manager.cc:1357] Generated new cluster ID: 7cc324411d7649e79257575f06a118c1
I20260207 20:54:17.611620 16078 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260207 20:54:17.611758 16051 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ed167cc66b0449abbc7e8461254ce81e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } } }
I20260207 20:54:17.612438 16051 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [sys.catalog]: This master's current role is: LEADER
I20260207 20:54:17.614416 16035 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ed167cc66b0449abbc7e8461254ce81e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } } }
I20260207 20:54:17.615161 16035 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:17.615298 16025 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ed167cc66b0449abbc7e8461254ce81e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc057bb7584a49ee8338d84886240f67" member_type: VOTER last_known_addr { host: "127.2.223.62" port: 41299 } } peers { permanent_uuid: "ed167cc66b0449abbc7e8461254ce81e" member_type: VOTER last_known_addr { host: "127.2.223.61" port: 41183 } } peers { permanent_uuid: "ec0995e277f24292923136167b8a3c62" member_type: VOTER last_known_addr { host: "127.2.223.60" port: 35539 } } }
I20260207 20:54:17.616195 16025 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [sys.catalog]: This master's current role is: FOLLOWER
I20260207 20:54:17.637658 16078 catalog_manager.cc:1380] Generated new certificate authority record
I20260207 20:54:17.639375 16078 catalog_manager.cc:1514] Loading token signing keys...
I20260207 20:54:17.661082 16078 catalog_manager.cc:6027] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e: Generated new TSK 0
I20260207 20:54:17.661751 16078 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260207 20:54:17.679883 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.1:42987
I20260207 20:54:17.679970 16146 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.1:42987 every 8 connection(s)
I20260207 20:54:17.686931 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:54:17.703328 16147 heartbeater.cc:344] Connected to a master server at 127.2.223.60:35539
I20260207 20:54:17.703852 16147 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:17.704979 16147 heartbeater.cc:507] Master 127.2.223.60:35539 requested a full tablet report, sending...
W20260207 20:54:17.705425 16154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:17.707775 15985 ts_manager.cc:194] Registered new tserver with Master: 2e1dd5c7b4e7462398fb6aee845139ec (127.2.223.1:42987)
I20260207 20:54:17.708784 16148 heartbeater.cc:344] Connected to a master server at 127.2.223.61:41183
I20260207 20:54:17.709184 16148 heartbeater.cc:461] Registering TS with master...
W20260207 20:54:17.709825 16155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:17.710047 16148 heartbeater.cc:507] Master 127.2.223.61:41183 requested a full tablet report, sending...
I20260207 20:54:17.712419 15920 ts_manager.cc:194] Registered new tserver with Master: 2e1dd5c7b4e7462398fb6aee845139ec (127.2.223.1:42987)
W20260207 20:54:17.714430 16158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:17.714624 15920 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58618
I20260207 20:54:17.716361 16149 heartbeater.cc:344] Connected to a master server at 127.2.223.62:41299
I20260207 20:54:17.716743 16149 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:17.717384 16149 heartbeater.cc:507] Master 127.2.223.62:41299 requested a full tablet report, sending...
I20260207 20:54:17.719379 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:17.719899 15855 ts_manager.cc:194] Registered new tserver with Master: 2e1dd5c7b4e7462398fb6aee845139ec (127.2.223.1:42987)
I20260207 20:54:17.720363 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:17.720649 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:17.720850 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497657720833 us; error 0 us; skew 500 ppm
I20260207 20:54:17.721609 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:17.723824 2940 webserver.cc:492] Webserver started at http://127.2.223.2:37617/ using document root <none> and password file <none>
I20260207 20:54:17.724248 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:17.724409 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:17.724604 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:17.725548 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-1-root/instance:
uuid: "e708c954dafe4da8a2dc844c25e17e2c"
format_stamp: "Formatted at 2026-02-07 20:54:17 on dist-test-slave-kqw4"
I20260207 20:54:17.727494 16148 heartbeater.cc:499] Master 127.2.223.61:41183 was elected leader, sending a full tablet report...
I20260207 20:54:17.729689 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260207 20:54:17.733237 16162 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:17.734130 2940 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260207 20:54:17.734392 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-1-root
uuid: "e708c954dafe4da8a2dc844c25e17e2c"
format_stamp: "Formatted at 2026-02-07 20:54:17 on dist-test-slave-kqw4"
I20260207 20:54:17.734666 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:17.760654 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:17.761685 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:17.762948 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:17.765039 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:17.765229 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:17.765440 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:17.765588 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:17.808584 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.2:37033
I20260207 20:54:17.808702 16224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.2:37033 every 8 connection(s)
I20260207 20:54:17.818710 2940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260207 20:54:17.832587 16226 heartbeater.cc:344] Connected to a master server at 127.2.223.61:41183
I20260207 20:54:17.833005 16226 heartbeater.cc:461] Registering TS with master...
W20260207 20:54:17.833098 16231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:17.833997 16226 heartbeater.cc:507] Master 127.2.223.61:41183 requested a full tablet report, sending...
I20260207 20:54:17.836522 15920 ts_manager.cc:194] Registered new tserver with Master: e708c954dafe4da8a2dc844c25e17e2c (127.2.223.2:37033)
I20260207 20:54:17.841970 15920 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58630
W20260207 20:54:17.847597 16233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:17.848889 16225 heartbeater.cc:344] Connected to a master server at 127.2.223.60:35539
I20260207 20:54:17.849315 16225 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:17.850005 16225 heartbeater.cc:507] Master 127.2.223.60:35539 requested a full tablet report, sending...
W20260207 20:54:17.851790 16235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260207 20:54:17.852628 15985 ts_manager.cc:194] Registered new tserver with Master: e708c954dafe4da8a2dc844c25e17e2c (127.2.223.2:37033)
I20260207 20:54:17.852911 16227 heartbeater.cc:344] Connected to a master server at 127.2.223.62:41299
I20260207 20:54:17.853325 16227 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:17.853931 16227 heartbeater.cc:507] Master 127.2.223.62:41299 requested a full tablet report, sending...
I20260207 20:54:17.854074 2940 server_base.cc:1060] running on GCE node
I20260207 20:54:17.855026 16226 heartbeater.cc:499] Master 127.2.223.61:41183 was elected leader, sending a full tablet report...
I20260207 20:54:17.855159 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260207 20:54:17.855437 2940 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260207 20:54:17.855671 2940 hybrid_clock.cc:648] HybridClock initialized: now 1770497657855653 us; error 0 us; skew 500 ppm
I20260207 20:54:17.856467 2940 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260207 20:54:17.856823 15855 ts_manager.cc:194] Registered new tserver with Master: e708c954dafe4da8a2dc844c25e17e2c (127.2.223.2:37033)
I20260207 20:54:17.859795 2940 webserver.cc:492] Webserver started at http://127.2.223.3:37663/ using document root <none> and password file <none>
I20260207 20:54:17.860272 2940 fs_manager.cc:362] Metadata directory not provided
I20260207 20:54:17.860427 2940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260207 20:54:17.860628 2940 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260207 20:54:17.861716 2940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-2-root/instance:
uuid: "8218f56afcfb4a36b1748b7061ea1c5e"
format_stamp: "Formatted at 2026-02-07 20:54:17 on dist-test-slave-kqw4"
I20260207 20:54:17.866849 2940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260207 20:54:17.872103 16240 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:17.872906 2940 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.003s
I20260207 20:54:17.873236 2940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-2-root
uuid: "8218f56afcfb4a36b1748b7061ea1c5e"
format_stamp: "Formatted at 2026-02-07 20:54:17 on dist-test-slave-kqw4"
I20260207 20:54:17.873483 2940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskpFzQo4/test-tmp/ksck_remote-test.0.RemoteKsckTest.RangeKeysInTabletSummaries.1770497537224219-2940-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260207 20:54:17.895941 2940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260207 20:54:17.897396 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260207 20:54:17.898877 2940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260207 20:54:17.901145 2940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260207 20:54:17.901366 2940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:17.901644 2940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260207 20:54:17.901863 2940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260207 20:54:17.958155 2940 rpc_server.cc:307] RPC server started. Bound to: 127.2.223.3:41831
I20260207 20:54:17.958266 16302 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.223.3:41831 every 8 connection(s)
I20260207 20:54:17.983693 16303 heartbeater.cc:344] Connected to a master server at 127.2.223.60:35539
I20260207 20:54:17.984093 16303 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:17.984894 16303 heartbeater.cc:507] Master 127.2.223.60:35539 requested a full tablet report, sending...
I20260207 20:54:17.988530 16304 heartbeater.cc:344] Connected to a master server at 127.2.223.61:41183
I20260207 20:54:17.989053 16304 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:17.989892 16304 heartbeater.cc:507] Master 127.2.223.61:41183 requested a full tablet report, sending...
I20260207 20:54:17.990680 15984 ts_manager.cc:194] Registered new tserver with Master: 8218f56afcfb4a36b1748b7061ea1c5e (127.2.223.3:41831)
I20260207 20:54:17.992204 16305 heartbeater.cc:344] Connected to a master server at 127.2.223.62:41299
I20260207 20:54:17.992221 15920 ts_manager.cc:194] Registered new tserver with Master: 8218f56afcfb4a36b1748b7061ea1c5e (127.2.223.3:41831)
I20260207 20:54:17.992583 16305 heartbeater.cc:461] Registering TS with master...
I20260207 20:54:17.993433 16305 heartbeater.cc:507] Master 127.2.223.62:41299 requested a full tablet report, sending...
I20260207 20:54:17.993765 15920 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58638
I20260207 20:54:17.998519 15855 ts_manager.cc:194] Registered new tserver with Master: 8218f56afcfb4a36b1748b7061ea1c5e (127.2.223.3:41831)
I20260207 20:54:17.998790 2940 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01827005s
I20260207 20:54:18.006698 16304 heartbeater.cc:499] Master 127.2.223.61:41183 was elected leader, sending a full tablet report...
I20260207 20:54:18.037525 15919 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58644:
name: "ksck-test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\n\000\000\000\004\001\024\000\000\000""\004\001\n\000\000\000\004\001\024\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260207 20:54:18.041189 15919 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260207 20:54:18.149487 16268 tablet_service.cc:1505] Processing CreateTablet for tablet 3ecb68b90e8247ef81feb138c2b0d412 (DEFAULT_TABLE table=ksck-test-table [id=45f5dd0d28d2499c83d007290c13b320]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:18.150897 16268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ecb68b90e8247ef81feb138c2b0d412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:18.156096 16267 tablet_service.cc:1505] Processing CreateTablet for tablet ee7abb9e5a584b88815533a4453c4dce (DEFAULT_TABLE table=ksck-test-table [id=45f5dd0d28d2499c83d007290c13b320]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:18.157433 16267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee7abb9e5a584b88815533a4453c4dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:18.162748 16266 tablet_service.cc:1505] Processing CreateTablet for tablet b5df007734794d81a1f9dd4a4b80f918 (DEFAULT_TABLE table=ksck-test-table [id=45f5dd0d28d2499c83d007290c13b320]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:18.164103 16266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5df007734794d81a1f9dd4a4b80f918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:18.186856 16189 tablet_service.cc:1505] Processing CreateTablet for tablet ee7abb9e5a584b88815533a4453c4dce (DEFAULT_TABLE table=ksck-test-table [id=45f5dd0d28d2499c83d007290c13b320]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:18.188191 16189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee7abb9e5a584b88815533a4453c4dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:18.189394 16324 tablet_bootstrap.cc:492] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e: Bootstrap starting.
I20260207 20:54:18.191447 16188 tablet_service.cc:1505] Processing CreateTablet for tablet b5df007734794d81a1f9dd4a4b80f918 (DEFAULT_TABLE table=ksck-test-table [id=45f5dd0d28d2499c83d007290c13b320]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:18.192256 16111 tablet_service.cc:1505] Processing CreateTablet for tablet 3ecb68b90e8247ef81feb138c2b0d412 (DEFAULT_TABLE table=ksck-test-table [id=45f5dd0d28d2499c83d007290c13b320]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:18.193555 16111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ecb68b90e8247ef81feb138c2b0d412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:18.193813 16108 tablet_service.cc:1505] Processing CreateTablet for tablet b5df007734794d81a1f9dd4a4b80f918 (DEFAULT_TABLE table=ksck-test-table [id=45f5dd0d28d2499c83d007290c13b320]), partition=RANGE (key) PARTITION 20 <= VALUES
I20260207 20:54:18.195076 16108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5df007734794d81a1f9dd4a4b80f918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:18.195423 16110 tablet_service.cc:1505] Processing CreateTablet for tablet ee7abb9e5a584b88815533a4453c4dce (DEFAULT_TABLE table=ksck-test-table [id=45f5dd0d28d2499c83d007290c13b320]), partition=RANGE (key) PARTITION 10 <= VALUES < 20
I20260207 20:54:18.196704 16110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee7abb9e5a584b88815533a4453c4dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:18.199128 16190 tablet_service.cc:1505] Processing CreateTablet for tablet 3ecb68b90e8247ef81feb138c2b0d412 (DEFAULT_TABLE table=ksck-test-table [id=45f5dd0d28d2499c83d007290c13b320]), partition=RANGE (key) PARTITION VALUES < 10
I20260207 20:54:18.192696 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5df007734794d81a1f9dd4a4b80f918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:18.203279 16190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ecb68b90e8247ef81feb138c2b0d412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260207 20:54:18.219208 16324 tablet_bootstrap.cc:654] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:18.256639 16324 tablet_bootstrap.cc:492] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e: No bootstrap required, opened a new log
I20260207 20:54:18.259016 16324 ts_tablet_manager.cc:1403] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e: Time spent bootstrapping tablet: real 0.070s user 0.010s sys 0.015s
I20260207 20:54:18.261945 16324 raft_consensus.cc:359] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.268594 16324 raft_consensus.cc:385] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:18.268992 16324 raft_consensus.cc:740] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8218f56afcfb4a36b1748b7061ea1c5e, State: Initialized, Role: FOLLOWER
I20260207 20:54:18.270135 16324 consensus_queue.cc:260] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.281885 16327 tablet_bootstrap.cc:492] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec: Bootstrap starting.
I20260207 20:54:18.288730 16324 ts_tablet_manager.cc:1434] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e: Time spent starting tablet: real 0.029s user 0.005s sys 0.006s
I20260207 20:54:18.289836 16324 tablet_bootstrap.cc:492] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e: Bootstrap starting.
I20260207 20:54:18.293725 16327 tablet_bootstrap.cc:654] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:18.295387 16324 tablet_bootstrap.cc:654] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:18.297906 16326 tablet_bootstrap.cc:492] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c: Bootstrap starting.
I20260207 20:54:18.308018 16326 tablet_bootstrap.cc:654] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:18.324106 16327 tablet_bootstrap.cc:492] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec: No bootstrap required, opened a new log
I20260207 20:54:18.324702 16327 ts_tablet_manager.cc:1403] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec: Time spent bootstrapping tablet: real 0.043s user 0.001s sys 0.018s
I20260207 20:54:18.333986 16324 tablet_bootstrap.cc:492] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e: No bootstrap required, opened a new log
I20260207 20:54:18.334573 16324 ts_tablet_manager.cc:1403] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e: Time spent bootstrapping tablet: real 0.045s user 0.014s sys 0.027s
I20260207 20:54:18.335237 16326 tablet_bootstrap.cc:492] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c: No bootstrap required, opened a new log
I20260207 20:54:18.338207 16326 ts_tablet_manager.cc:1403] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c: Time spent bootstrapping tablet: real 0.043s user 0.012s sys 0.002s
I20260207 20:54:18.335907 16327 raft_consensus.cc:359] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } }
I20260207 20:54:18.339457 16327 raft_consensus.cc:385] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:18.340339 16324 raft_consensus.cc:359] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.339754 16327 raft_consensus.cc:740] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e1dd5c7b4e7462398fb6aee845139ec, State: Initialized, Role: FOLLOWER
I20260207 20:54:18.341045 16324 raft_consensus.cc:385] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:18.341382 16324 raft_consensus.cc:740] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8218f56afcfb4a36b1748b7061ea1c5e, State: Initialized, Role: FOLLOWER
I20260207 20:54:18.341571 16327 consensus_queue.cc:260] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } }
I20260207 20:54:18.342195 16324 consensus_queue.cc:260] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.350138 16324 ts_tablet_manager.cc:1434] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260207 20:54:18.342695 16326 raft_consensus.cc:359] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } }
I20260207 20:54:18.350740 16326 raft_consensus.cc:385] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:18.351074 16326 raft_consensus.cc:740] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e708c954dafe4da8a2dc844c25e17e2c, State: Initialized, Role: FOLLOWER
I20260207 20:54:18.351367 16324 tablet_bootstrap.cc:492] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e: Bootstrap starting.
I20260207 20:54:18.351742 16326 consensus_queue.cc:260] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } }
I20260207 20:54:18.357964 16324 tablet_bootstrap.cc:654] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:18.379841 16327 ts_tablet_manager.cc:1434] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec: Time spent starting tablet: real 0.046s user 0.021s sys 0.010s
I20260207 20:54:18.388643 16327 tablet_bootstrap.cc:492] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec: Bootstrap starting.
I20260207 20:54:18.390461 16324 tablet_bootstrap.cc:492] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e: No bootstrap required, opened a new log
I20260207 20:54:18.391062 16324 ts_tablet_manager.cc:1403] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e: Time spent bootstrapping tablet: real 0.040s user 0.022s sys 0.004s
I20260207 20:54:18.393714 16324 raft_consensus.cc:359] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } }
I20260207 20:54:18.394394 16324 raft_consensus.cc:385] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:18.394709 16324 raft_consensus.cc:740] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8218f56afcfb4a36b1748b7061ea1c5e, State: Initialized, Role: FOLLOWER
I20260207 20:54:18.395380 16324 consensus_queue.cc:260] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } }
I20260207 20:54:18.396445 16327 tablet_bootstrap.cc:654] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:18.397673 16324 ts_tablet_manager.cc:1434] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e: Time spent starting tablet: real 0.006s user 0.001s sys 0.003s
I20260207 20:54:18.412698 16326 ts_tablet_manager.cc:1434] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c: Time spent starting tablet: real 0.074s user 0.012s sys 0.008s
I20260207 20:54:18.413084 16327 tablet_bootstrap.cc:492] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec: No bootstrap required, opened a new log
I20260207 20:54:18.413607 16327 ts_tablet_manager.cc:1403] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec: Time spent bootstrapping tablet: real 0.025s user 0.013s sys 0.001s
I20260207 20:54:18.417445 16327 raft_consensus.cc:359] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.419521 16327 raft_consensus.cc:385] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:18.419817 16327 raft_consensus.cc:740] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e1dd5c7b4e7462398fb6aee845139ec, State: Initialized, Role: FOLLOWER
I20260207 20:54:18.420121 16326 tablet_bootstrap.cc:492] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c: Bootstrap starting.
I20260207 20:54:18.420568 16327 consensus_queue.cc:260] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.426088 16327 ts_tablet_manager.cc:1434] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec: Time spent starting tablet: real 0.011s user 0.003s sys 0.002s
I20260207 20:54:18.427157 16327 tablet_bootstrap.cc:492] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec: Bootstrap starting.
I20260207 20:54:18.432825 16327 tablet_bootstrap.cc:654] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:18.456056 16327 tablet_bootstrap.cc:492] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec: No bootstrap required, opened a new log
I20260207 20:54:18.456585 16327 ts_tablet_manager.cc:1403] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec: Time spent bootstrapping tablet: real 0.030s user 0.015s sys 0.011s
I20260207 20:54:18.459334 16327 raft_consensus.cc:359] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.460022 16327 raft_consensus.cc:385] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:18.460340 16327 raft_consensus.cc:740] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e1dd5c7b4e7462398fb6aee845139ec, State: Initialized, Role: FOLLOWER
I20260207 20:54:18.461131 16327 consensus_queue.cc:260] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.463790 16327 ts_tablet_manager.cc:1434] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260207 20:54:18.467164 16326 tablet_bootstrap.cc:654] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:18.481479 16326 tablet_bootstrap.cc:492] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c: No bootstrap required, opened a new log
I20260207 20:54:18.481964 16326 ts_tablet_manager.cc:1403] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c: Time spent bootstrapping tablet: real 0.062s user 0.009s sys 0.007s
I20260207 20:54:18.490777 16326 raft_consensus.cc:359] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.491549 16326 raft_consensus.cc:385] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:18.491860 16326 raft_consensus.cc:740] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e708c954dafe4da8a2dc844c25e17e2c, State: Initialized, Role: FOLLOWER
I20260207 20:54:18.492552 16326 consensus_queue.cc:260] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.494760 16326 ts_tablet_manager.cc:1434] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20260207 20:54:18.495750 16326 tablet_bootstrap.cc:492] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c: Bootstrap starting.
I20260207 20:54:18.501528 16326 tablet_bootstrap.cc:654] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c: Neither blocks nor log segments found. Creating new log.
I20260207 20:54:18.509989 16038 catalog_manager.cc:1269] Loaded cluster ID: 7cc324411d7649e79257575f06a118c1
I20260207 20:54:18.510347 16038 catalog_manager.cc:1562] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67: loading cluster ID for follower catalog manager: success
I20260207 20:54:18.516162 16038 catalog_manager.cc:1584] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67: acquiring CA information for follower catalog manager: success
I20260207 20:54:18.520848 16038 catalog_manager.cc:1612] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:54:18.523196 16326 tablet_bootstrap.cc:492] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c: No bootstrap required, opened a new log
I20260207 20:54:18.523787 16326 ts_tablet_manager.cc:1403] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c: Time spent bootstrapping tablet: real 0.028s user 0.015s sys 0.001s
I20260207 20:54:18.526245 16326 raft_consensus.cc:359] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.526937 16326 raft_consensus.cc:385] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260207 20:54:18.527243 16326 raft_consensus.cc:740] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e708c954dafe4da8a2dc844c25e17e2c, State: Initialized, Role: FOLLOWER
I20260207 20:54:18.527899 16326 consensus_queue.cc:260] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.530256 16050 catalog_manager.cc:1269] Loaded cluster ID: 7cc324411d7649e79257575f06a118c1
I20260207 20:54:18.530611 16050 catalog_manager.cc:1562] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62: loading cluster ID for follower catalog manager: success
I20260207 20:54:18.531977 16326 ts_tablet_manager.cc:1434] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
I20260207 20:54:18.536918 16050 catalog_manager.cc:1584] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62: acquiring CA information for follower catalog manager: success
I20260207 20:54:18.545377 16050 catalog_manager.cc:1612] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260207 20:54:18.549716 16328 raft_consensus.cc:493] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:18.550122 16328 raft_consensus.cc:515] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.551934 16328 leader_election.cc:290] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e1dd5c7b4e7462398fb6aee845139ec (127.2.223.1:42987), e708c954dafe4da8a2dc844c25e17e2c (127.2.223.2:37033)
I20260207 20:54:18.572404 16122 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5df007734794d81a1f9dd4a4b80f918" candidate_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" is_pre_election: true
I20260207 20:54:18.573165 16122 raft_consensus.cc:2468] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8218f56afcfb4a36b1748b7061ea1c5e in term 0.
I20260207 20:54:18.575908 16243 leader_election.cc:304] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e1dd5c7b4e7462398fb6aee845139ec, 8218f56afcfb4a36b1748b7061ea1c5e; no voters:
I20260207 20:54:18.576682 16328 raft_consensus.cc:2804] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:18.577061 16328 raft_consensus.cc:493] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:18.577379 16328 raft_consensus.cc:3060] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:18.584256 16200 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5df007734794d81a1f9dd4a4b80f918" candidate_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e708c954dafe4da8a2dc844c25e17e2c" is_pre_election: true
I20260207 20:54:18.584604 16328 raft_consensus.cc:515] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.584964 16200 raft_consensus.cc:2468] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8218f56afcfb4a36b1748b7061ea1c5e in term 0.
I20260207 20:54:18.587932 16328 leader_election.cc:290] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [CANDIDATE]: Term 1 election: Requested vote from peers 2e1dd5c7b4e7462398fb6aee845139ec (127.2.223.1:42987), e708c954dafe4da8a2dc844c25e17e2c (127.2.223.2:37033)
I20260207 20:54:18.588562 16122 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5df007734794d81a1f9dd4a4b80f918" candidate_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e1dd5c7b4e7462398fb6aee845139ec"
I20260207 20:54:18.589038 16122 raft_consensus.cc:3060] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:18.589231 16200 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5df007734794d81a1f9dd4a4b80f918" candidate_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e708c954dafe4da8a2dc844c25e17e2c"
I20260207 20:54:18.589771 16200 raft_consensus.cc:3060] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:18.595485 16122 raft_consensus.cc:2468] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8218f56afcfb4a36b1748b7061ea1c5e in term 1.
I20260207 20:54:18.596649 16243 leader_election.cc:304] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e1dd5c7b4e7462398fb6aee845139ec, 8218f56afcfb4a36b1748b7061ea1c5e; no voters:
I20260207 20:54:18.597654 16328 raft_consensus.cc:2804] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:18.605149 16328 raft_consensus.cc:697] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [term 1 LEADER]: Becoming Leader. State: Replica: 8218f56afcfb4a36b1748b7061ea1c5e, State: Running, Role: LEADER
I20260207 20:54:18.606668 16328 consensus_queue.cc:237] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.607041 16200 raft_consensus.cc:2468] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8218f56afcfb4a36b1748b7061ea1c5e in term 1.
I20260207 20:54:18.619987 15918 catalog_manager.cc:5654] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8218f56afcfb4a36b1748b7061ea1c5e (127.2.223.3). New cstate: current_term: 1 leader_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } health_report { overall_health: HEALTHY } } }
I20260207 20:54:18.655274 16332 raft_consensus.cc:493] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:18.655777 16332 raft_consensus.cc:515] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.658156 16332 leader_election.cc:290] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e708c954dafe4da8a2dc844c25e17e2c (127.2.223.2:37033), 8218f56afcfb4a36b1748b7061ea1c5e (127.2.223.3:41831)
I20260207 20:54:18.684000 16200 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee7abb9e5a584b88815533a4453c4dce" candidate_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e708c954dafe4da8a2dc844c25e17e2c" is_pre_election: true
I20260207 20:54:18.684736 16200 raft_consensus.cc:2468] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e1dd5c7b4e7462398fb6aee845139ec in term 0.
I20260207 20:54:18.686409 16073 leader_election.cc:304] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e1dd5c7b4e7462398fb6aee845139ec, e708c954dafe4da8a2dc844c25e17e2c; no voters:
I20260207 20:54:18.687223 16332 raft_consensus.cc:2804] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:18.687603 16332 raft_consensus.cc:493] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:18.687923 16332 raft_consensus.cc:3060] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:18.691416 16278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee7abb9e5a584b88815533a4453c4dce" candidate_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" is_pre_election: true
I20260207 20:54:18.692111 16278 raft_consensus.cc:2468] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e1dd5c7b4e7462398fb6aee845139ec in term 0.
I20260207 20:54:18.695030 16332 raft_consensus.cc:515] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.696282 16333 raft_consensus.cc:493] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260207 20:54:18.696885 16332 leader_election.cc:290] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [CANDIDATE]: Term 1 election: Requested vote from peers e708c954dafe4da8a2dc844c25e17e2c (127.2.223.2:37033), 8218f56afcfb4a36b1748b7061ea1c5e (127.2.223.3:41831)
I20260207 20:54:18.696758 16333 raft_consensus.cc:515] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } }
I20260207 20:54:18.699235 16333 leader_election.cc:290] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8218f56afcfb4a36b1748b7061ea1c5e (127.2.223.3:41831), 2e1dd5c7b4e7462398fb6aee845139ec (127.2.223.1:42987)
I20260207 20:54:18.701296 16200 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee7abb9e5a584b88815533a4453c4dce" candidate_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e708c954dafe4da8a2dc844c25e17e2c"
I20260207 20:54:18.701874 16200 raft_consensus.cc:3060] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:18.707242 16278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee7abb9e5a584b88815533a4453c4dce" candidate_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8218f56afcfb4a36b1748b7061ea1c5e"
I20260207 20:54:18.707868 16278 raft_consensus.cc:3060] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:18.711683 16200 raft_consensus.cc:2468] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e1dd5c7b4e7462398fb6aee845139ec in term 1.
I20260207 20:54:18.719522 16278 raft_consensus.cc:2468] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e1dd5c7b4e7462398fb6aee845139ec in term 1.
I20260207 20:54:18.720132 16073 leader_election.cc:304] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e1dd5c7b4e7462398fb6aee845139ec, e708c954dafe4da8a2dc844c25e17e2c; no voters:
I20260207 20:54:18.726735 16332 raft_consensus.cc:2804] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:18.732780 16332 raft_consensus.cc:697] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [term 1 LEADER]: Becoming Leader. State: Replica: 2e1dd5c7b4e7462398fb6aee845139ec, State: Running, Role: LEADER
I20260207 20:54:18.733654 16332 consensus_queue.cc:237] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } }
I20260207 20:54:18.743105 16122 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3ecb68b90e8247ef81feb138c2b0d412" candidate_uuid: "e708c954dafe4da8a2dc844c25e17e2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" is_pre_election: true
I20260207 20:54:18.743558 16278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3ecb68b90e8247ef81feb138c2b0d412" candidate_uuid: "e708c954dafe4da8a2dc844c25e17e2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" is_pre_election: true
I20260207 20:54:18.743822 16122 raft_consensus.cc:2468] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e708c954dafe4da8a2dc844c25e17e2c in term 0.
I20260207 20:54:18.744295 16278 raft_consensus.cc:2468] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e708c954dafe4da8a2dc844c25e17e2c in term 0.
I20260207 20:54:18.745038 16165 leader_election.cc:304] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e1dd5c7b4e7462398fb6aee845139ec, e708c954dafe4da8a2dc844c25e17e2c; no voters:
I20260207 20:54:18.746809 16333 raft_consensus.cc:2804] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260207 20:54:18.747191 16333 raft_consensus.cc:493] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260207 20:54:18.747515 16333 raft_consensus.cc:3060] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:18.757040 16333 raft_consensus.cc:515] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } }
I20260207 20:54:18.758162 15917 catalog_manager.cc:5654] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e1dd5c7b4e7462398fb6aee845139ec (127.2.223.1). New cstate: current_term: 1 leader_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } health_report { overall_health: UNKNOWN } } }
I20260207 20:54:18.760700 16122 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3ecb68b90e8247ef81feb138c2b0d412" candidate_uuid: "e708c954dafe4da8a2dc844c25e17e2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e1dd5c7b4e7462398fb6aee845139ec"
I20260207 20:54:18.761284 16122 raft_consensus.cc:3060] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:18.761426 16278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3ecb68b90e8247ef81feb138c2b0d412" candidate_uuid: "e708c954dafe4da8a2dc844c25e17e2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8218f56afcfb4a36b1748b7061ea1c5e"
I20260207 20:54:18.761948 16333 leader_election.cc:290] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [CANDIDATE]: Term 1 election: Requested vote from peers 8218f56afcfb4a36b1748b7061ea1c5e (127.2.223.3:41831), 2e1dd5c7b4e7462398fb6aee845139ec (127.2.223.1:42987)
I20260207 20:54:18.762192 16278 raft_consensus.cc:3060] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e [term 0 FOLLOWER]: Advancing to term 1
I20260207 20:54:18.768324 16122 raft_consensus.cc:2468] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e708c954dafe4da8a2dc844c25e17e2c in term 1.
I20260207 20:54:18.769474 16165 leader_election.cc:304] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e1dd5c7b4e7462398fb6aee845139ec, e708c954dafe4da8a2dc844c25e17e2c; no voters:
I20260207 20:54:18.770545 16278 raft_consensus.cc:2468] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e708c954dafe4da8a2dc844c25e17e2c in term 1.
I20260207 20:54:18.772328 16333 raft_consensus.cc:2804] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [term 1 FOLLOWER]: Leader election won for term 1
I20260207 20:54:18.785980 16333 raft_consensus.cc:697] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [term 1 LEADER]: Becoming Leader. State: Replica: e708c954dafe4da8a2dc844c25e17e2c, State: Running, Role: LEADER
I20260207 20:54:18.786966 16333 consensus_queue.cc:237] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } } peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } }
I20260207 20:54:18.797435 15917 catalog_manager.cc:5654] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c reported cstate change: term changed from 0 to 1, leader changed from <none> to e708c954dafe4da8a2dc844c25e17e2c (127.2.223.2). New cstate: current_term: 1 leader_uuid: "e708c954dafe4da8a2dc844c25e17e2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8218f56afcfb4a36b1748b7061ea1c5e" member_type: VOTER last_known_addr { host: "127.2.223.3" port: 41831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e708c954dafe4da8a2dc844c25e17e2c" member_type: VOTER last_known_addr { host: "127.2.223.2" port: 37033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e1dd5c7b4e7462398fb6aee845139ec" member_type: VOTER last_known_addr { host: "127.2.223.1" port: 42987 } health_report { overall_health: UNKNOWN } } }
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tools/ksck_remote-test.cc:836: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
I20260207 20:54:18.916764 2940 tablet_server.cc:178] TabletServer@127.2.223.1:0 shutting down...
I20260207 20:54:18.959575 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:18.960532 2940 tablet_replica.cc:333] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec: stopping tablet replica
I20260207 20:54:18.961138 2940 raft_consensus.cc:2243] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:18.961719 2940 pending_rounds.cc:70] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec: Trying to abort 1 pending ops.
I20260207 20:54:18.961915 2940 pending_rounds.cc:77] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7251958410192482304 op_type: NO_OP noop_request { }
I20260207 20:54:18.962177 2940 raft_consensus.cc:2889] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260207 20:54:18.962437 2940 raft_consensus.cc:2272] T ee7abb9e5a584b88815533a4453c4dce P 2e1dd5c7b4e7462398fb6aee845139ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:18.964745 2940 tablet_replica.cc:333] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec: stopping tablet replica
I20260207 20:54:18.965538 2940 raft_consensus.cc:2243] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:18.965960 2940 raft_consensus.cc:2272] T b5df007734794d81a1f9dd4a4b80f918 P 2e1dd5c7b4e7462398fb6aee845139ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:18.968151 2940 tablet_replica.cc:333] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec: stopping tablet replica
I20260207 20:54:18.968739 2940 raft_consensus.cc:2243] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:18.969082 2940 raft_consensus.cc:2272] T 3ecb68b90e8247ef81feb138c2b0d412 P 2e1dd5c7b4e7462398fb6aee845139ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:18.987210 2940 tablet_server.cc:195] TabletServer@127.2.223.1:0 shutdown complete.
I20260207 20:54:19.000353 2940 tablet_server.cc:178] TabletServer@127.2.223.2:0 shutting down...
W20260207 20:54:19.024107 16243 consensus_peers.cc:597] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e -> Peer 2e1dd5c7b4e7462398fb6aee845139ec (127.2.223.1:42987): Couldn't send request to peer 2e1dd5c7b4e7462398fb6aee845139ec. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.1:42987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:54:19.045094 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:19.045671 2940 tablet_replica.cc:333] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c: stopping tablet replica
I20260207 20:54:19.046245 2940 raft_consensus.cc:2243] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:19.046665 2940 raft_consensus.cc:2272] T ee7abb9e5a584b88815533a4453c4dce P e708c954dafe4da8a2dc844c25e17e2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:19.048818 2940 tablet_replica.cc:333] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c: stopping tablet replica
I20260207 20:54:19.049506 2940 raft_consensus.cc:2243] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:19.049919 2940 raft_consensus.cc:2272] T b5df007734794d81a1f9dd4a4b80f918 P e708c954dafe4da8a2dc844c25e17e2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:19.051568 2940 tablet_replica.cc:333] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c: stopping tablet replica
I20260207 20:54:19.051990 2940 raft_consensus.cc:2243] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:19.052524 2940 pending_rounds.cc:70] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c: Trying to abort 1 pending ops.
I20260207 20:54:19.052690 2940 pending_rounds.cc:77] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7251958410400096256 op_type: NO_OP noop_request { }
I20260207 20:54:19.052919 2940 raft_consensus.cc:2889] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260207 20:54:19.053165 2940 raft_consensus.cc:2272] T 3ecb68b90e8247ef81feb138c2b0d412 P e708c954dafe4da8a2dc844c25e17e2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:19.066618 2940 tablet_server.cc:195] TabletServer@127.2.223.2:0 shutdown complete.
W20260207 20:54:19.070741 16242 consensus_peers.cc:597] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e -> Peer e708c954dafe4da8a2dc844c25e17e2c (127.2.223.2:37033): Couldn't send request to peer e708c954dafe4da8a2dc844c25e17e2c. Status: Network error: Client connection negotiation failed: client connection to 127.2.223.2:37033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260207 20:54:19.079160 2940 tablet_server.cc:178] TabletServer@127.2.223.3:0 shutting down...
I20260207 20:54:19.099596 2940 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260207 20:54:19.100171 2940 tablet_replica.cc:333] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e: stopping tablet replica
I20260207 20:54:19.100695 2940 raft_consensus.cc:2243] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:19.101068 2940 raft_consensus.cc:2272] T 3ecb68b90e8247ef81feb138c2b0d412 P 8218f56afcfb4a36b1748b7061ea1c5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:19.102885 2940 tablet_replica.cc:333] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e: stopping tablet replica
I20260207 20:54:19.103366 2940 raft_consensus.cc:2243] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:19.104028 2940 pending_rounds.cc:70] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e: Trying to abort 1 pending ops.
I20260207 20:54:19.104208 2940 pending_rounds.cc:77] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7251958409660477440 op_type: NO_OP noop_request { }
I20260207 20:54:19.104450 2940 raft_consensus.cc:2889] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260207 20:54:19.104703 2940 raft_consensus.cc:2272] T b5df007734794d81a1f9dd4a4b80f918 P 8218f56afcfb4a36b1748b7061ea1c5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:19.106743 2940 tablet_replica.cc:333] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e: stopping tablet replica
I20260207 20:54:19.107199 2940 raft_consensus.cc:2243] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:19.107544 2940 raft_consensus.cc:2272] T ee7abb9e5a584b88815533a4453c4dce P 8218f56afcfb4a36b1748b7061ea1c5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:19.128705 2940 tablet_server.cc:195] TabletServer@127.2.223.3:0 shutdown complete.
I20260207 20:54:19.139442 2940 master.cc:561] Master@127.2.223.62:41299 shutting down...
I20260207 20:54:19.153319 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:19.153797 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:19.154072 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P fc057bb7584a49ee8338d84886240f67: stopping tablet replica
I20260207 20:54:19.173485 2940 master.cc:583] Master@127.2.223.62:41299 shutdown complete.
I20260207 20:54:19.184098 2940 master.cc:561] Master@127.2.223.61:41183 shutting down...
I20260207 20:54:19.197587 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [term 1 LEADER]: Raft consensus shutting down.
I20260207 20:54:19.198457 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:19.198839 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P ed167cc66b0449abbc7e8461254ce81e: stopping tablet replica
I20260207 20:54:19.217557 2940 master.cc:583] Master@127.2.223.61:41183 shutdown complete.
I20260207 20:54:19.228886 2940 master.cc:561] Master@127.2.223.60:35539 shutting down...
I20260207 20:54:19.243477 2940 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260207 20:54:19.243981 2940 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260207 20:54:19.244261 2940 tablet_replica.cc:333] T 00000000000000000000000000000000 P ec0995e277f24292923136167b8a3c62: stopping tablet replica
I20260207 20:54:19.253461 2940 master.cc:583] Master@127.2.223.60:35539 shutdown complete.
[ SKIPPED ] RemoteKsckTest.RangeKeysInTabletSummaries (2082 ms)
[----------] 22 tests from RemoteKsckTest (121990 ms total)
[----------] Global test environment tear-down
[==========] 22 tests from 1 test suite ran. (121990 ms total)
[ PASSED ] 19 tests.
[ SKIPPED ] 2 tests, listed below:
[ SKIPPED ] RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM
[ SKIPPED ] RemoteKsckTest.RangeKeysInTabletSummaries
[ FAILED ] 1 test, listed below:
[ FAILED ] RemoteKsckTest.TestTableConsistency
1 FAILED TEST
I20260207 20:54:19.289108 2940 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/catalog_manager.cc:4712: suppressed but not reported on 16 messages since previous log ~104 seconds ago
I20260207 20:54:19.289381 2940 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 948 messages since previous log ~105 seconds ago
I20260207 20:54:19.289762 2940 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet.cc:2378: suppressed but not reported on 81 messages since previous log ~24 seconds ago
I20260207 20:54:19.289949 2940 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~2 seconds ago