[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from TokenSignerITest
[ RUN ] TokenSignerITest.TskAtLeaderMaster
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260924 01:56:57.817807 355 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.88.254:33505,127.0.88.253:45425,127.0.88.252:37111
I20260924 01:56:57.818840 355 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 01:56:57.819386 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:56:57.826133 361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:57.826133 360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:57.826272 355 server_base.cc:1061] running on GCE node
W20260924 01:56:57.826480 363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:57.826994 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:57.827124 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:57.827179 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215017827174 us; error 0 us; skew 500 ppm
I20260924 01:56:57.829021 355 webserver.cc:533] Webserver started at http://127.0.88.254:41957/ using document root <none> and password file <none>
I20260924 01:56:57.829871 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:57.829950 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:56:57.830246 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:56:57.831852 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-0-root/instance:
uuid: "9e541c6a73574968b13928e91b4ead99"
format_stamp: "Formatted at 2026-09-24 01:56:57 on dist-test-slave-pgxx"
I20260924 01:56:57.835420 355 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260924 01:56:57.837662 368 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:57.838770 355 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260924 01:56:57.838923 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-0-root
uuid: "9e541c6a73574968b13928e91b4ead99"
format_stamp: "Formatted at 2026-09-24 01:56:57 on dist-test-slave-pgxx"
I20260924 01:56:57.839062 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:57.858461 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:57.859133 355 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 01:56:57.859331 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:57.867102 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.254:33505
I20260924 01:56:57.867122 420 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.254:33505 every 8 connection(s)
I20260924 01:56:57.868373 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:56:57.870098 423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:57.870193 426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:57.870204 424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:57.870476 355 server_base.cc:1061] running on GCE node
I20260924 01:56:57.870658 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:57.870699 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:57.870715 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215017870715 us; error 0 us; skew 500 ppm
I20260924 01:56:57.871266 421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 01:56:57.871649 355 webserver.cc:533] Webserver started at http://127.0.88.253:34789/ using document root <none> and password file <none>
I20260924 01:56:57.871803 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:57.871840 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:56:57.871927 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:56:57.872264 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-1-root/instance:
uuid: "00b87a119bc5442f8154de0465f5098b"
format_stamp: "Formatted at 2026-09-24 01:56:57 on dist-test-slave-pgxx"
I20260924 01:56:57.873728 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:57.874720 431 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:57.874969 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:57.875053 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-1-root
uuid: "00b87a119bc5442f8154de0465f5098b"
format_stamp: "Formatted at 2026-09-24 01:56:57 on dist-test-slave-pgxx"
I20260924 01:56:57.875125 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:57.875614 421 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:56:57.885538 421 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } has no permanent_uuid. Determining permanent_uuid...
W20260924 01:56:57.886394 371 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.88.253:45425: connect: Connection refused (error 111)
W20260924 01:56:57.887182 421 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.88.253:45425: Network error: Client connection negotiation failed: client connection to 127.0.88.253:45425: connect: Connection refused (error 111)
I20260924 01:56:57.900427 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:57.900888 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:57.906347 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.253:45425
I20260924 01:56:57.906461 486 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.253:45425 every 8 connection(s)
I20260924 01:56:57.907105 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260924 01:56:57.907302 487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260924 01:56:57.908754 489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:57.908962 490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:57.909018 492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:57.908779 487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:56:57.909574 355 server_base.cc:1061] running on GCE node
I20260924 01:56:57.909761 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:57.909814 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:57.909837 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215017909836 us; error 0 us; skew 500 ppm
I20260924 01:56:57.910772 355 webserver.cc:533] Webserver started at http://127.0.88.252:39493/ using document root <none> and password file <none>
I20260924 01:56:57.910928 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:57.910977 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:56:57.911046 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:56:57.911403 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-2-root/instance:
uuid: "a4fc4a0bf5214adc953df8f8d54d8072"
format_stamp: "Formatted at 2026-09-24 01:56:57 on dist-test-slave-pgxx"
I20260924 01:56:57.913077 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 01:56:57.914069 487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:56:57.914287 498 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:57.914836 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:57.914908 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-2-root
uuid: "a4fc4a0bf5214adc953df8f8d54d8072"
format_stamp: "Formatted at 2026-09-24 01:56:57 on dist-test-slave-pgxx"
I20260924 01:56:57.915030 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:57.918325 487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } has no permanent_uuid. Determining permanent_uuid...
W20260924 01:56:57.919579 487 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.88.252:37111: Network error: Client connection negotiation failed: client connection to 127.0.88.252:37111: connect: Connection refused (error 111)
I20260924 01:56:57.928829 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:57.929210 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:57.933957 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.252:37111
I20260924 01:56:57.934032 552 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.252:37111 every 8 connection(s)
I20260924 01:56:57.934427 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260924 01:56:57.935098 553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 01:56:57.936067 553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:56:57.936388 421 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } attempt: 1
I20260924 01:56:57.940793 421 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:56:57.940886 553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:56:57.945544 553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:56:57.948403 421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99: Bootstrap starting.
I20260924 01:56:57.950307 553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072: Bootstrap starting.
I20260924 01:56:57.950935 421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99: Neither blocks nor log segments found. Creating new log.
I20260924 01:56:57.951277 553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072: Neither blocks nor log segments found. Creating new log.
I20260924 01:56:57.951941 553 log.cc:826] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072: Log is configured to *not* fsync() on all Append() calls
I20260924 01:56:57.953338 421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99: No bootstrap required, opened a new log
I20260924 01:56:57.953339 553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072: No bootstrap required, opened a new log
I20260924 01:56:57.956063 421 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } }
I20260924 01:56:57.956053 553 raft_consensus.cc:359] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } }
I20260924 01:56:57.956264 421 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 01:56:57.956305 553 raft_consensus.cc:385] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 01:56:57.956358 421 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e541c6a73574968b13928e91b4ead99, State: Initialized, Role: FOLLOWER
I20260924 01:56:57.956360 553 raft_consensus.cc:740] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fc4a0bf5214adc953df8f8d54d8072, State: Initialized, Role: FOLLOWER
I20260924 01:56:57.956911 421 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } }
I20260924 01:56:57.956919 553 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } }
I20260924 01:56:57.957425 559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } } }
I20260924 01:56:57.957496 560 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } } }
I20260924 01:56:57.957647 559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:57.957760 560 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:57.958114 553 sys_catalog.cc:565] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 01:56:57.958115 421 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 01:56:57.960244 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
W20260924 01:56:57.962375 582 catalog_manager.cc:1607] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 01:56:57.962373 581 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 01:56:57.962484 582 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260924 01:56:57.962500 581 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 01:56:57.971757 487 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } attempt: 1
I20260924 01:56:57.977581 487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b: Bootstrap starting.
I20260924 01:56:57.978588 487 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b: Neither blocks nor log segments found. Creating new log.
I20260924 01:56:57.980237 487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b: No bootstrap required, opened a new log
I20260924 01:56:57.980701 487 raft_consensus.cc:359] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } }
I20260924 01:56:57.980831 487 raft_consensus.cc:385] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 01:56:57.980916 487 raft_consensus.cc:740] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00b87a119bc5442f8154de0465f5098b, State: Initialized, Role: FOLLOWER
I20260924 01:56:57.981135 487 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } }
I20260924 01:56:57.981567 585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } } }
I20260924 01:56:57.981690 585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:57.981803 487 sys_catalog.cc:565] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [sys.catalog]: configured and running, proceeding with master startup.
I20260924 01:56:57.983865 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260924 01:56:57.984494 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:56:57.984499 596 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 01:56:57.984645 596 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260924 01:56:57.987076 597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:57.987138 598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:57.987469 600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:57.987500 355 server_base.cc:1061] running on GCE node
I20260924 01:56:57.987735 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:57.987800 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:57.987848 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215017987848 us; error 0 us; skew 500 ppm
I20260924 01:56:57.988880 355 webserver.cc:533] Webserver started at http://127.0.88.193:38453/ using document root <none> and password file <none>
I20260924 01:56:57.989065 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:57.989117 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:56:57.989220 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:56:57.989714 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-0-root/instance:
uuid: "10a252c8f9be42edace8971757e74596"
format_stamp: "Formatted at 2026-09-24 01:56:57 on dist-test-slave-pgxx"
I20260924 01:56:57.991358 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260924 01:56:57.992479 605 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:57.992790 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 01:56:57.992872 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-0-root
uuid: "10a252c8f9be42edace8971757e74596"
format_stamp: "Formatted at 2026-09-24 01:56:57 on dist-test-slave-pgxx"
I20260924 01:56:57.992972 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:58.008001 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:58.008499 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:58.008937 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:56:58.009918 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:56:58.009997 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.010073 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:56:58.010130 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.016996 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.193:41867
I20260924 01:56:58.017033 668 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.193:41867 every 8 connection(s)
I20260924 01:56:58.018260 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:56:58.020828 678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:58.021023 676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:58.021445 355 server_base.cc:1061] running on GCE node
W20260924 01:56:58.021588 675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:58.021857 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:58.021910 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:58.021937 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215018021937 us; error 0 us; skew 500 ppm
I20260924 01:56:58.023216 355 webserver.cc:533] Webserver started at http://127.0.88.194:33573/ using document root <none> and password file <none>
I20260924 01:56:58.023393 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:58.023463 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:56:58.023550 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:56:58.023844 670 heartbeater.cc:344] Connected to a master server at 127.0.88.254:33505
I20260924 01:56:58.023972 670 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.024034 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-1-root/instance:
uuid: "28cebee3f6fb43da8133b1e9e52d3b65"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.024428 670 heartbeater.cc:507] Master 127.0.88.254:33505 requested a full tablet report, sending...
I20260924 01:56:58.026250 385 ts_manager.cc:194] Registered new tserver with Master: 10a252c8f9be42edace8971757e74596 (127.0.88.193:41867)
I20260924 01:56:58.026546 355 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260924 01:56:58.027096 669 heartbeater.cc:344] Connected to a master server at 127.0.88.252:37111
I20260924 01:56:58.027163 669 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.027362 669 heartbeater.cc:507] Master 127.0.88.252:37111 requested a full tablet report, sending...
I20260924 01:56:58.027904 684 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.027990 517 ts_manager.cc:194] Registered new tserver with Master: 10a252c8f9be42edace8971757e74596 (127.0.88.193:41867)
I20260924 01:56:58.028215 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:58.028293 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-1-root
uuid: "28cebee3f6fb43da8133b1e9e52d3b65"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.028354 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:58.029090 671 heartbeater.cc:344] Connected to a master server at 127.0.88.253:45425
I20260924 01:56:58.029181 671 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.029359 671 heartbeater.cc:507] Master 127.0.88.253:45425 requested a full tablet report, sending...
I20260924 01:56:58.029995 451 ts_manager.cc:194] Registered new tserver with Master: 10a252c8f9be42edace8971757e74596 (127.0.88.193:41867)
I20260924 01:56:58.037986 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:58.038429 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:58.038770 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:56:58.039341 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:56:58.039384 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.039453 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:56:58.039495 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.046365 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.194:33899
I20260924 01:56:58.046391 747 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.194:33899 every 8 connection(s)
I20260924 01:56:58.047572 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:56:58.050268 757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:58.052749 748 heartbeater.cc:344] Connected to a master server at 127.0.88.252:37111
I20260924 01:56:58.052867 748 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.053059 749 heartbeater.cc:344] Connected to a master server at 127.0.88.254:33505
I20260924 01:56:58.053194 749 heartbeater.cc:461] Registering TS with master...
W20260924 01:56:58.053277 754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:58.053393 749 heartbeater.cc:507] Master 127.0.88.254:33505 requested a full tablet report, sending...
I20260924 01:56:58.053092 748 heartbeater.cc:507] Master 127.0.88.252:37111 requested a full tablet report, sending...
I20260924 01:56:58.054258 385 ts_manager.cc:194] Registered new tserver with Master: 28cebee3f6fb43da8133b1e9e52d3b65 (127.0.88.194:33899)
W20260924 01:56:58.054760 755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:58.055244 517 ts_manager.cc:194] Registered new tserver with Master: 28cebee3f6fb43da8133b1e9e52d3b65 (127.0.88.194:33899)
I20260924 01:56:58.055437 355 server_base.cc:1061] running on GCE node
I20260924 01:56:58.055642 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:58.055684 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:58.055707 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215018055707 us; error 0 us; skew 500 ppm
I20260924 01:56:58.055742 750 heartbeater.cc:344] Connected to a master server at 127.0.88.253:45425
I20260924 01:56:58.055820 750 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.056288 750 heartbeater.cc:507] Master 127.0.88.253:45425 requested a full tablet report, sending...
I20260924 01:56:58.056634 355 webserver.cc:533] Webserver started at http://127.0.88.195:40187/ using document root <none> and password file <none>
I20260924 01:56:58.056795 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:58.056859 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:56:58.056926 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:56:58.056962 451 ts_manager.cc:194] Registered new tserver with Master: 28cebee3f6fb43da8133b1e9e52d3b65 (127.0.88.194:33899)
I20260924 01:56:58.057421 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-2-root/instance:
uuid: "48f25eeeb0be467c88dde8281d3a71d3"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.059425 355 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260924 01:56:58.060649 763 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.060928 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:58.061014 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-2-root
uuid: "48f25eeeb0be467c88dde8281d3a71d3"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.061081 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskAtLeaderMaster.1790215017804648-355-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:58.075600 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:58.076123 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:58.076471 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:56:58.077042 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:56:58.077096 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.077144 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:56:58.077168 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.083652 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.195:44441
I20260924 01:56:58.083858 826 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.195:44441 every 8 connection(s)
I20260924 01:56:58.090866 827 heartbeater.cc:344] Connected to a master server at 127.0.88.252:37111
I20260924 01:56:58.090986 827 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.091168 829 heartbeater.cc:344] Connected to a master server at 127.0.88.253:45425
I20260924 01:56:58.091209 827 heartbeater.cc:507] Master 127.0.88.252:37111 requested a full tablet report, sending...
I20260924 01:56:58.091269 829 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.091416 828 heartbeater.cc:344] Connected to a master server at 127.0.88.254:33505
I20260924 01:56:58.091485 828 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.091488 829 heartbeater.cc:507] Master 127.0.88.253:45425 requested a full tablet report, sending...
I20260924 01:56:58.091648 828 heartbeater.cc:507] Master 127.0.88.254:33505 requested a full tablet report, sending...
I20260924 01:56:58.092273 451 ts_manager.cc:194] Registered new tserver with Master: 48f25eeeb0be467c88dde8281d3a71d3 (127.0.88.195:44441)
I20260924 01:56:58.092273 517 ts_manager.cc:194] Registered new tserver with Master: 48f25eeeb0be467c88dde8281d3a71d3 (127.0.88.195:44441)
I20260924 01:56:58.092357 385 ts_manager.cc:194] Registered new tserver with Master: 48f25eeeb0be467c88dde8281d3a71d3 (127.0.88.195:44441)
I20260924 01:56:58.092748 355 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.008468565s
W20260924 01:56:58.110395 374 tablet.cc:2433] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 01:56:58.152781 585 raft_consensus.cc:493] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 01:56:58.153017 585 raft_consensus.cc:515] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } }
I20260924 01:56:58.154404 585 leader_election.cc:290] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e541c6a73574968b13928e91b4ead99 (127.0.88.254:33505), a4fc4a0bf5214adc953df8f8d54d8072 (127.0.88.252:37111)
I20260924 01:56:58.154923 395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "00b87a119bc5442f8154de0465f5098b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e541c6a73574968b13928e91b4ead99" is_pre_election: true
I20260924 01:56:58.154928 527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "00b87a119bc5442f8154de0465f5098b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" is_pre_election: true
I20260924 01:56:58.155169 395 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00b87a119bc5442f8154de0465f5098b in term 0.
I20260924 01:56:58.155169 527 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00b87a119bc5442f8154de0465f5098b in term 0.
I20260924 01:56:58.155656 435 leader_election.cc:304] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00b87a119bc5442f8154de0465f5098b, a4fc4a0bf5214adc953df8f8d54d8072; no voters:
I20260924 01:56:58.155931 585 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 01:56:58.156001 585 raft_consensus.cc:493] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 01:56:58.156059 585 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [term 0 FOLLOWER]: Advancing to term 1
I20260924 01:56:58.156937 585 raft_consensus.cc:515] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } }
I20260924 01:56:58.157334 585 leader_election.cc:290] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [CANDIDATE]: Term 1 election: Requested vote from peers 9e541c6a73574968b13928e91b4ead99 (127.0.88.254:33505), a4fc4a0bf5214adc953df8f8d54d8072 (127.0.88.252:37111)
I20260924 01:56:58.157692 395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "00b87a119bc5442f8154de0465f5098b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e541c6a73574968b13928e91b4ead99"
I20260924 01:56:58.157807 527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "00b87a119bc5442f8154de0465f5098b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fc4a0bf5214adc953df8f8d54d8072"
I20260924 01:56:58.157814 395 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [term 0 FOLLOWER]: Advancing to term 1
I20260924 01:56:58.157945 527 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [term 0 FOLLOWER]: Advancing to term 1
I20260924 01:56:58.158682 395 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00b87a119bc5442f8154de0465f5098b in term 1.
I20260924 01:56:58.158962 527 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00b87a119bc5442f8154de0465f5098b in term 1.
I20260924 01:56:58.159003 435 leader_election.cc:304] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00b87a119bc5442f8154de0465f5098b, 9e541c6a73574968b13928e91b4ead99; no voters:
I20260924 01:56:58.159255 585 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [term 1 FOLLOWER]: Leader election won for term 1
I20260924 01:56:58.159540 585 raft_consensus.cc:697] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [term 1 LEADER]: Becoming Leader. State: Replica: 00b87a119bc5442f8154de0465f5098b, State: Running, Role: LEADER
I20260924 01:56:58.160084 585 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } }
I20260924 01:56:58.162899 835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00b87a119bc5442f8154de0465f5098b. Latest consensus state: current_term: 1 leader_uuid: "00b87a119bc5442f8154de0465f5098b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } } }
I20260924 01:56:58.163014 835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [sys.catalog]: This master's current role is: LEADER
I20260924 01:56:58.163380 837 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260924 01:56:58.164225 837 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260924 01:56:58.168567 527 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [term 1 FOLLOWER]: Refusing update from remote peer 00b87a119bc5442f8154de0465f5098b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 01:56:58.168567 395 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [term 1 FOLLOWER]: Refusing update from remote peer 00b87a119bc5442f8154de0465f5098b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 01:56:58.169160 835 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 01:56:58.169302 585 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 01:56:58.171100 560 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00b87a119bc5442f8154de0465f5098b. Latest consensus state: current_term: 1 leader_uuid: "00b87a119bc5442f8154de0465f5098b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } } }
I20260924 01:56:58.171237 560 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:58.171123 559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00b87a119bc5442f8154de0465f5098b. Latest consensus state: current_term: 1 leader_uuid: "00b87a119bc5442f8154de0465f5098b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } } }
I20260924 01:56:58.171384 559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:58.172922 838 mvcc.cc:204] Tried to move back new op lower bound from 7332720714412310528 to 7332720714387922944. Current Snapshot: MvccSnapshot[applied={T|T < 7332720714412310528}]
I20260924 01:56:58.172919 843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "00b87a119bc5442f8154de0465f5098b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } } }
I20260924 01:56:58.173072 835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "00b87a119bc5442f8154de0465f5098b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } } }
I20260924 01:56:58.173159 835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [sys.catalog]: This master's current role is: LEADER
I20260924 01:56:58.173230 559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "00b87a119bc5442f8154de0465f5098b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } } }
I20260924 01:56:58.173326 559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:58.173506 560 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "00b87a119bc5442f8154de0465f5098b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e541c6a73574968b13928e91b4ead99" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 33505 } } peers { permanent_uuid: "00b87a119bc5442f8154de0465f5098b" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45425 } } peers { permanent_uuid: "a4fc4a0bf5214adc953df8f8d54d8072" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37111 } } }
I20260924 01:56:58.173111 843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [sys.catalog]: This master's current role is: LEADER
I20260924 01:56:58.173594 560 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:58.174769 837 catalog_manager.cc:1396] Generated new cluster ID: 8c68c2a034fb4c02b3d238bdf4e47911
I20260924 01:56:58.174826 837 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260924 01:56:58.197844 837 catalog_manager.cc:1419] Generated new certificate authority record
I20260924 01:56:58.198683 837 catalog_manager.cc:1553] Loading token signing keys...
I20260924 01:56:58.207388 837 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b: Generated new TSK 0
I20260924 01:56:58.207890 837 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260924 01:56:58.295019 355 tablet_server.cc:179] TabletServer@127.0.88.193:0 shutting down...
I20260924 01:56:58.299674 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:56:58.312772 355 tablet_server.cc:196] TabletServer@127.0.88.193:0 shutdown complete.
I20260924 01:56:58.317245 355 tablet_server.cc:179] TabletServer@127.0.88.194:0 shutting down...
I20260924 01:56:58.321872 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:56:58.334203 355 tablet_server.cc:196] TabletServer@127.0.88.194:0 shutdown complete.
I20260924 01:56:58.336199 355 tablet_server.cc:179] TabletServer@127.0.88.195:0 shutting down...
I20260924 01:56:58.339882 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:56:58.352440 355 tablet_server.cc:196] TabletServer@127.0.88.195:0 shutdown complete.
I20260924 01:56:58.354274 355 master.cc:562] Master@127.0.88.254:33505 shutting down...
I20260924 01:56:58.358990 355 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 01:56:58.359202 355 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 01:56:58.359269 355 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9e541c6a73574968b13928e91b4ead99: stopping tablet replica
I20260924 01:56:58.373579 355 master.cc:584] Master@127.0.88.254:33505 shutdown complete.
I20260924 01:56:58.376946 355 master.cc:562] Master@127.0.88.253:45425 shutting down...
I20260924 01:56:58.380502 355 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [term 1 LEADER]: Raft consensus shutting down.
I20260924 01:56:58.380862 355 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 01:56:58.381026 355 tablet_replica.cc:333] T 00000000000000000000000000000000 P 00b87a119bc5442f8154de0465f5098b: stopping tablet replica
I20260924 01:56:58.394680 355 master.cc:584] Master@127.0.88.253:45425 shutdown complete.
I20260924 01:56:58.397429 355 master.cc:562] Master@127.0.88.252:37111 shutting down...
I20260924 01:56:58.401808 355 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 01:56:58.402046 355 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 01:56:58.402107 355 tablet_replica.cc:333] T 00000000000000000000000000000000 P a4fc4a0bf5214adc953df8f8d54d8072: stopping tablet replica
I20260924 01:56:58.414949 355 master.cc:584] Master@127.0.88.252:37111 shutdown complete.
[ OK ] TokenSignerITest.TskAtLeaderMaster (604 ms)
[ RUN ] TokenSignerITest.TskClusterRestart
I20260924 01:56:58.421283 355 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.88.254:44605,127.0.88.253:35667,127.0.88.252:37883
I20260924 01:56:58.421787 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:56:58.423367 847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:58.423382 850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:58.423542 848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:58.423682 355 server_base.cc:1061] running on GCE node
I20260924 01:56:58.423851 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:58.423899 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:58.423924 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215018423924 us; error 0 us; skew 500 ppm
I20260924 01:56:58.424806 355 webserver.cc:533] Webserver started at http://127.0.88.254:36607/ using document root <none> and password file <none>
I20260924 01:56:58.424995 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:58.425069 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:56:58.425151 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:56:58.425630 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-0-root/instance:
uuid: "23ed7853320b406489e0cf6d196cb7bc"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.427239 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 01:56:58.428112 855 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.428325 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:58.428412 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-0-root
uuid: "23ed7853320b406489e0cf6d196cb7bc"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.428503 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:58.438397 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:58.438797 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:58.443213 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.254:44605
I20260924 01:56:58.444361 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260924 01:56:58.447144 907 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.254:44605 every 8 connection(s)
I20260924 01:56:58.447631 908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260924 01:56:58.448259 910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:58.448439 913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:58.448486 911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:58.448639 355 server_base.cc:1061] running on GCE node
I20260924 01:56:58.448782 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:58.448812 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:58.448827 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215018448827 us; error 0 us; skew 500 ppm
I20260924 01:56:58.448958 908 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:56:58.449734 355 webserver.cc:533] Webserver started at http://127.0.88.253:46753/ using document root <none> and password file <none>
I20260924 01:56:58.449916 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:58.449972 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:56:58.450050 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:56:58.450389 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-1-root/instance:
uuid: "afe848d9aa0f40e5bc817a6eb3731648"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.451977 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 01:56:58.453922 920 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.454193 355 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260924 01:56:58.454279 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-1-root
uuid: "afe848d9aa0f40e5bc817a6eb3731648"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.454347 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:58.455963 908 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } has no permanent_uuid. Determining permanent_uuid...
W20260924 01:56:58.457221 908 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.88.253:35667: Network error: Client connection negotiation failed: client connection to 127.0.88.253:35667: connect: Connection refused (error 111)
I20260924 01:56:58.471822 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:58.472267 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:58.476282 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.253:35667
I20260924 01:56:58.476344 973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.253:35667 every 8 connection(s)
I20260924 01:56:58.476990 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260924 01:56:58.477242 974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260924 01:56:58.478694 976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:58.478744 979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:58.478901 355 server_base.cc:1061] running on GCE node
I20260924 01:56:58.478935 974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } has no permanent_uuid. Determining permanent_uuid...
W20260924 01:56:58.478947 977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:58.479207 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:58.479249 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:58.479265 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215018479266 us; error 0 us; skew 500 ppm
I20260924 01:56:58.480131 355 webserver.cc:533] Webserver started at http://127.0.88.252:36529/ using document root <none> and password file <none>
I20260924 01:56:58.480304 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:58.480348 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:56:58.480423 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:56:58.480767 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-2-root/instance:
uuid: "689acd45027c418a8c5eb94704e18f39"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.482509 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 01:56:58.483261 974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:56:58.483654 985 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.483937 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:58.484027 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-2-root
uuid: "689acd45027c418a8c5eb94704e18f39"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.484146 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:58.487624 974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } has no permanent_uuid. Determining permanent_uuid...
W20260924 01:56:58.489001 974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.88.252:37883: Network error: Client connection negotiation failed: client connection to 127.0.88.252:37883: connect: Connection refused (error 111)
I20260924 01:56:58.498929 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:58.499341 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:58.503584 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.252:37883
I20260924 01:56:58.503648 1039 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.252:37883 every 8 connection(s)
I20260924 01:56:58.504086 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260924 01:56:58.504573 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 01:56:58.505661 1040 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:56:58.509935 1040 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:56:58.513356 1040 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:56:58.515369 908 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } attempt: 1
I20260924 01:56:58.518433 1040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39: Bootstrap starting.
I20260924 01:56:58.519351 908 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:56:58.519711 1040 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39: Neither blocks nor log segments found. Creating new log.
I20260924 01:56:58.520905 1040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39: No bootstrap required, opened a new log
I20260924 01:56:58.521407 1040 raft_consensus.cc:359] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:58.521543 1040 raft_consensus.cc:385] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 01:56:58.521579 1040 raft_consensus.cc:740] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 689acd45027c418a8c5eb94704e18f39, State: Initialized, Role: FOLLOWER
I20260924 01:56:58.521764 1040 consensus_queue.cc:260] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:58.522185 1045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } } }
I20260924 01:56:58.522294 1045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:58.522352 1040 sys_catalog.cc:565] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 01:56:58.524219 908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: Bootstrap starting.
W20260924 01:56:58.524775 1056 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 01:56:58.524832 1056 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 01:56:58.525204 908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: Neither blocks nor log segments found. Creating new log.
I20260924 01:56:58.526315 908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: No bootstrap required, opened a new log
I20260924 01:56:58.526861 908 raft_consensus.cc:359] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:58.526978 908 raft_consensus.cc:385] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 01:56:58.527024 908 raft_consensus.cc:740] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23ed7853320b406489e0cf6d196cb7bc, State: Initialized, Role: FOLLOWER
I20260924 01:56:58.527170 908 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:58.527514 1058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } } }
I20260924 01:56:58.527642 1058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:58.527735 908 sys_catalog.cc:565] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [sys.catalog]: configured and running, proceeding with master startup.
I20260924 01:56:58.529326 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
W20260924 01:56:58.529878 1069 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 01:56:58.529933 1069 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 01:56:58.554201 974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } attempt: 1
I20260924 01:56:58.559774 974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648: Bootstrap starting.
I20260924 01:56:58.560719 974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648: Neither blocks nor log segments found. Creating new log.
I20260924 01:56:58.561849 974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648: No bootstrap required, opened a new log
I20260924 01:56:58.562259 974 raft_consensus.cc:359] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:58.562358 974 raft_consensus.cc:385] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 01:56:58.562382 974 raft_consensus.cc:740] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afe848d9aa0f40e5bc817a6eb3731648, State: Initialized, Role: FOLLOWER
I20260924 01:56:58.562485 974 consensus_queue.cc:260] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:58.562772 1071 sys_catalog.cc:455] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } } }
I20260924 01:56:58.562899 1071 sys_catalog.cc:458] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:58.562940 974 sys_catalog.cc:565] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 01:56:58.564630 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260924 01:56:58.565136 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:56:58.565281 1082 catalog_manager.cc:1607] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 01:56:58.565337 1082 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 01:56:58.567277 355 server_base.cc:1061] running on GCE node
W20260924 01:56:58.567322 1083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:58.567394 1086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:58.567322 1084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:58.567684 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:58.567737 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:58.567754 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215018567754 us; error 0 us; skew 500 ppm
I20260924 01:56:58.568624 355 webserver.cc:533] Webserver started at http://127.0.88.193:40241/ using document root <none> and password file <none>
I20260924 01:56:58.568795 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:58.568861 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:56:58.568936 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:56:58.569311 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-0-root/instance:
uuid: "0e5eb856ea5349208153b5c473c02058"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.570771 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260924 01:56:58.571647 1091 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.571964 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 01:56:58.572027 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-0-root
uuid: "0e5eb856ea5349208153b5c473c02058"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.572084 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:58.586144 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:58.586553 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:58.586831 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:56:58.587275 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:56:58.587337 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.587399 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:56:58.587436 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.592152 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.193:39127
I20260924 01:56:58.592191 1154 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.193:39127 every 8 connection(s)
I20260924 01:56:58.593348 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:56:58.595588 1165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:58.595788 1163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:58.596925 355 server_base.cc:1061] running on GCE node
W20260924 01:56:58.597126 1162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:58.597366 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:58.597416 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:58.597440 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215018597440 us; error 0 us; skew 500 ppm
I20260924 01:56:58.598237 1155 heartbeater.cc:344] Connected to a master server at 127.0.88.252:37883
I20260924 01:56:58.598263 1156 heartbeater.cc:344] Connected to a master server at 127.0.88.254:44605
I20260924 01:56:58.598331 1155 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.598430 355 webserver.cc:533] Webserver started at http://127.0.88.194:36177/ using document root <none> and password file <none>
I20260924 01:56:58.598578 1155 heartbeater.cc:507] Master 127.0.88.252:37883 requested a full tablet report, sending...
I20260924 01:56:58.598625 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:58.598702 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:56:58.598331 1156 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.598794 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:56:58.598958 1156 heartbeater.cc:507] Master 127.0.88.254:44605 requested a full tablet report, sending...
I20260924 01:56:58.599336 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-1-root/instance:
uuid: "ab6682781f9248648f642f9e75b95db0"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.599637 1004 ts_manager.cc:194] Registered new tserver with Master: 0e5eb856ea5349208153b5c473c02058 (127.0.88.193:39127)
I20260924 01:56:58.599749 872 ts_manager.cc:194] Registered new tserver with Master: 0e5eb856ea5349208153b5c473c02058 (127.0.88.193:39127)
I20260924 01:56:58.599829 1157 heartbeater.cc:344] Connected to a master server at 127.0.88.253:35667
I20260924 01:56:58.599900 1157 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.600065 1157 heartbeater.cc:507] Master 127.0.88.253:35667 requested a full tablet report, sending...
I20260924 01:56:58.600672 938 ts_manager.cc:194] Registered new tserver with Master: 0e5eb856ea5349208153b5c473c02058 (127.0.88.193:39127)
I20260924 01:56:58.601146 355 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260924 01:56:58.602152 1170 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.602378 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:58.602443 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-1-root
uuid: "ab6682781f9248648f642f9e75b95db0"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.602495 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:58.611857 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:58.612277 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:58.612532 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:56:58.613021 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:56:58.613067 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.613102 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:56:58.613159 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.618095 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.194:44891
I20260924 01:56:58.618131 1233 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.194:44891 every 8 connection(s)
I20260924 01:56:58.619131 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260924 01:56:58.622157 355 server_base.cc:1061] running on GCE node
W20260924 01:56:58.622905 1244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:58.623206 1242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:58.623414 1241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:58.623739 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:58.623790 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:58.623814 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215018623814 us; error 0 us; skew 500 ppm
I20260924 01:56:58.623996 1234 heartbeater.cc:344] Connected to a master server at 127.0.88.252:37883
I20260924 01:56:58.624094 1234 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.624292 1234 heartbeater.cc:507] Master 127.0.88.252:37883 requested a full tablet report, sending...
I20260924 01:56:58.624662 1235 heartbeater.cc:344] Connected to a master server at 127.0.88.254:44605
I20260924 01:56:58.624739 1235 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.624780 355 webserver.cc:533] Webserver started at http://127.0.88.195:40049/ using document root <none> and password file <none>
I20260924 01:56:58.624821 1236 heartbeater.cc:344] Connected to a master server at 127.0.88.253:35667
I20260924 01:56:58.624882 1236 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.624892 1235 heartbeater.cc:507] Master 127.0.88.254:44605 requested a full tablet report, sending...
I20260924 01:56:58.624956 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:58.624982 1004 ts_manager.cc:194] Registered new tserver with Master: ab6682781f9248648f642f9e75b95db0 (127.0.88.194:44891)
I20260924 01:56:58.625039 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:56:58.625069 1236 heartbeater.cc:507] Master 127.0.88.253:35667 requested a full tablet report, sending...
I20260924 01:56:58.625120 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:56:58.625598 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-2-root/instance:
uuid: "c9ee5fa76cef48e08fa0b65db248556c"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.625717 938 ts_manager.cc:194] Registered new tserver with Master: ab6682781f9248648f642f9e75b95db0 (127.0.88.194:44891)
I20260924 01:56:58.625721 872 ts_manager.cc:194] Registered new tserver with Master: ab6682781f9248648f642f9e75b95db0 (127.0.88.194:44891)
I20260924 01:56:58.627252 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 01:56:58.628196 1249 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.628470 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:58.628540 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-2-root
uuid: "c9ee5fa76cef48e08fa0b65db248556c"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.628611 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:58.647342 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:58.647794 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:58.648134 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:56:58.648633 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:56:58.648696 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.648758 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:56:58.648795 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.653589 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.195:34999
I20260924 01:56:58.653630 1312 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.195:34999 every 8 connection(s)
I20260924 01:56:58.658711 1314 heartbeater.cc:344] Connected to a master server at 127.0.88.254:44605
I20260924 01:56:58.658823 1314 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.658998 1315 heartbeater.cc:344] Connected to a master server at 127.0.88.253:35667
I20260924 01:56:58.659082 1315 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.659083 1314 heartbeater.cc:507] Master 127.0.88.254:44605 requested a full tablet report, sending...
I20260924 01:56:58.659278 1315 heartbeater.cc:507] Master 127.0.88.253:35667 requested a full tablet report, sending...
I20260924 01:56:58.659834 1313 heartbeater.cc:344] Connected to a master server at 127.0.88.252:37883
I20260924 01:56:58.659860 872 ts_manager.cc:194] Registered new tserver with Master: c9ee5fa76cef48e08fa0b65db248556c (127.0.88.195:34999)
I20260924 01:56:58.659907 938 ts_manager.cc:194] Registered new tserver with Master: c9ee5fa76cef48e08fa0b65db248556c (127.0.88.195:34999)
I20260924 01:56:58.659920 1313 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:58.660161 1313 heartbeater.cc:507] Master 127.0.88.252:37883 requested a full tablet report, sending...
I20260924 01:56:58.660655 1004 ts_manager.cc:194] Registered new tserver with Master: c9ee5fa76cef48e08fa0b65db248556c (127.0.88.195:34999)
I20260924 01:56:58.660882 355 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.006765028s
I20260924 01:56:58.772900 1058 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 01:56:58.773069 1058 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:58.773698 1058 leader_election.cc:290] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afe848d9aa0f40e5bc817a6eb3731648 (127.0.88.253:35667), 689acd45027c418a8c5eb94704e18f39 (127.0.88.252:37883)
I20260924 01:56:58.774159 948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23ed7853320b406489e0cf6d196cb7bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afe848d9aa0f40e5bc817a6eb3731648" is_pre_election: true
I20260924 01:56:58.774196 1014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23ed7853320b406489e0cf6d196cb7bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "689acd45027c418a8c5eb94704e18f39" is_pre_election: true
I20260924 01:56:58.774278 948 raft_consensus.cc:2468] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23ed7853320b406489e0cf6d196cb7bc in term 0.
I20260924 01:56:58.774379 1014 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23ed7853320b406489e0cf6d196cb7bc in term 0.
I20260924 01:56:58.774730 856 leader_election.cc:304] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23ed7853320b406489e0cf6d196cb7bc, 689acd45027c418a8c5eb94704e18f39; no voters:
I20260924 01:56:58.774976 1058 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 01:56:58.775041 1058 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 01:56:58.775070 1058 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 0 FOLLOWER]: Advancing to term 1
I20260924 01:56:58.775871 1058 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:58.776214 1058 leader_election.cc:290] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [CANDIDATE]: Term 1 election: Requested vote from peers afe848d9aa0f40e5bc817a6eb3731648 (127.0.88.253:35667), 689acd45027c418a8c5eb94704e18f39 (127.0.88.252:37883)
I20260924 01:56:58.776492 948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23ed7853320b406489e0cf6d196cb7bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afe848d9aa0f40e5bc817a6eb3731648"
I20260924 01:56:58.776621 1014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23ed7853320b406489e0cf6d196cb7bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "689acd45027c418a8c5eb94704e18f39"
I20260924 01:56:58.776621 948 raft_consensus.cc:3060] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 0 FOLLOWER]: Advancing to term 1
I20260924 01:56:58.776755 1014 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 0 FOLLOWER]: Advancing to term 1
I20260924 01:56:58.777592 948 raft_consensus.cc:2468] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23ed7853320b406489e0cf6d196cb7bc in term 1.
I20260924 01:56:58.777645 1014 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23ed7853320b406489e0cf6d196cb7bc in term 1.
I20260924 01:56:58.777890 859 leader_election.cc:304] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23ed7853320b406489e0cf6d196cb7bc, afe848d9aa0f40e5bc817a6eb3731648; no voters:
I20260924 01:56:58.778090 1058 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 1 FOLLOWER]: Leader election won for term 1
I20260924 01:56:58.778316 1058 raft_consensus.cc:697] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 1 LEADER]: Becoming Leader. State: Replica: 23ed7853320b406489e0cf6d196cb7bc, State: Running, Role: LEADER
I20260924 01:56:58.778467 1058 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:58.779239 1321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23ed7853320b406489e0cf6d196cb7bc. Latest consensus state: current_term: 1 leader_uuid: "23ed7853320b406489e0cf6d196cb7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } } }
I20260924 01:56:58.779362 1321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [sys.catalog]: This master's current role is: LEADER
I20260924 01:56:58.779688 1323 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260924 01:56:58.780417 1323 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260924 01:56:58.782214 948 raft_consensus.cc:1275] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 1 FOLLOWER]: Refusing update from remote peer 23ed7853320b406489e0cf6d196cb7bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 01:56:58.782238 1014 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 1 FOLLOWER]: Refusing update from remote peer 23ed7853320b406489e0cf6d196cb7bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 01:56:58.782616 1321 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 01:56:58.782796 1058 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 01:56:58.784021 1071 sys_catalog.cc:455] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23ed7853320b406489e0cf6d196cb7bc. Latest consensus state: current_term: 1 leader_uuid: "23ed7853320b406489e0cf6d196cb7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } } }
I20260924 01:56:58.784080 1045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23ed7853320b406489e0cf6d196cb7bc. Latest consensus state: current_term: 1 leader_uuid: "23ed7853320b406489e0cf6d196cb7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } } }
I20260924 01:56:58.784128 1071 sys_catalog.cc:458] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:58.784147 1045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:58.785532 1058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "23ed7853320b406489e0cf6d196cb7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } } }
I20260924 01:56:58.785626 1058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [sys.catalog]: This master's current role is: LEADER
I20260924 01:56:58.785763 1058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "23ed7853320b406489e0cf6d196cb7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } } }
I20260924 01:56:58.785835 1058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [sys.catalog]: This master's current role is: LEADER
I20260924 01:56:58.785794 1045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "23ed7853320b406489e0cf6d196cb7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } } }
I20260924 01:56:58.785888 1045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:58.785995 1071 sys_catalog.cc:455] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "23ed7853320b406489e0cf6d196cb7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } } }
I20260924 01:56:58.786082 1071 sys_catalog.cc:458] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:58.787003 1323 catalog_manager.cc:1396] Generated new cluster ID: c2cc71388c184b2f9a3a280d24e12a10
I20260924 01:56:58.787062 1323 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260924 01:56:58.793062 1323 catalog_manager.cc:1419] Generated new certificate authority record
I20260924 01:56:58.793797 1323 catalog_manager.cc:1553] Loading token signing keys...
I20260924 01:56:58.800210 1323 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: Generated new TSK 0
I20260924 01:56:58.800395 1323 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260924 01:56:58.862569 355 tablet_server.cc:179] TabletServer@127.0.88.193:0 shutting down...
I20260924 01:56:58.866194 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:56:58.878539 355 tablet_server.cc:196] TabletServer@127.0.88.193:0 shutdown complete.
I20260924 01:56:58.880424 355 tablet_server.cc:179] TabletServer@127.0.88.194:0 shutting down...
I20260924 01:56:58.884460 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:56:58.897094 355 tablet_server.cc:196] TabletServer@127.0.88.194:0 shutdown complete.
I20260924 01:56:58.899127 355 tablet_server.cc:179] TabletServer@127.0.88.195:0 shutting down...
I20260924 01:56:58.902902 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:56:58.915227 355 tablet_server.cc:196] TabletServer@127.0.88.195:0 shutdown complete.
I20260924 01:56:58.916993 355 master.cc:562] Master@127.0.88.254:44605 shutting down...
I20260924 01:56:58.920233 355 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 1 LEADER]: Raft consensus shutting down.
I20260924 01:56:58.920487 355 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 01:56:58.920634 355 tablet_replica.cc:333] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: stopping tablet replica
I20260924 01:56:58.933969 355 master.cc:584] Master@127.0.88.254:44605 shutdown complete.
I20260924 01:56:58.936314 355 master.cc:562] Master@127.0.88.253:35667 shutting down...
I20260924 01:56:58.939643 355 raft_consensus.cc:2243] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 01:56:58.939818 355 raft_consensus.cc:2272] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 01:56:58.939890 355 tablet_replica.cc:333] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648: stopping tablet replica
I20260924 01:56:58.952961 355 master.cc:584] Master@127.0.88.253:35667 shutdown complete.
I20260924 01:56:58.955591 355 master.cc:562] Master@127.0.88.252:37883 shutting down...
I20260924 01:56:58.959110 355 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 01:56:58.959249 355 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 01:56:58.959298 355 tablet_replica.cc:333] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39: stopping tablet replica
I20260924 01:56:58.972124 355 master.cc:584] Master@127.0.88.252:37883 shutdown complete.
I20260924 01:56:58.974761 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:56:58.976431 1333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:58.976464 1334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:58.976464 1336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:58.976517 355 server_base.cc:1061] running on GCE node
I20260924 01:56:58.976832 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:58.976891 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:58.976917 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215018976915 us; error 0 us; skew 500 ppm
I20260924 01:56:58.977764 355 webserver.cc:533] Webserver started at http://127.0.88.254:36059/ using document root <none> and password file <none>
I20260924 01:56:58.977936 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:58.977991 355 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260924 01:56:58.979174 355 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:58.980122 1341 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:58.980373 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:58.980459 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-0-root
uuid: "23ed7853320b406489e0cf6d196cb7bc"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:58.980556 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:58.994799 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:58.995209 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:58.999766 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.254:44605
I20260924 01:56:59.001224 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260924 01:56:59.003545 1393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.254:44605 every 8 connection(s)
W20260924 01:56:59.004874 1396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:59.004910 355 server_base.cc:1061] running on GCE node
I20260924 01:56:59.005848 1394 sys_catalog.cc:263] Verifying existing consensus state
W20260924 01:56:59.006578 1397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:59.006719 1399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:59.006978 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:59.007033 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:59.007055 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215019007055 us; error 0 us; skew 500 ppm
I20260924 01:56:59.007275 1394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: Bootstrap starting.
I20260924 01:56:59.008019 355 webserver.cc:533] Webserver started at http://127.0.88.253:44321/ using document root <none> and password file <none>
I20260924 01:56:59.008180 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:59.008229 355 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260924 01:56:59.009644 355 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:59.010687 1405 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:59.010963 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:59.011054 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-1-root
uuid: "afe848d9aa0f40e5bc817a6eb3731648"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:59.011153 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:59.013877 1394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 01:56:59.014328 1394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: Bootstrap complete.
I20260924 01:56:59.014829 1394 raft_consensus.cc:359] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:59.014938 1394 raft_consensus.cc:740] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23ed7853320b406489e0cf6d196cb7bc, State: Initialized, Role: FOLLOWER
I20260924 01:56:59.015113 1394 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:59.015416 1410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } } }
I20260924 01:56:59.015519 1410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:59.015619 1394 sys_catalog.cc:565] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [sys.catalog]: configured and running, proceeding with master startup.
I20260924 01:56:59.018005 1421 catalog_manager.cc:1308] Loaded cluster ID: c2cc71388c184b2f9a3a280d24e12a10
I20260924 01:56:59.018051 1421 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: loading cluster ID for follower catalog manager: success
I20260924 01:56:59.018350 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:59.018689 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:59.019371 1421 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: acquiring CA information for follower catalog manager: success
I20260924 01:56:59.020056 1421 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 01:56:59.023056 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.253:35667
I20260924 01:56:59.023085 1469 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.253:35667 every 8 connection(s)
I20260924 01:56:59.023743 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260924 01:56:59.024828 1470 sys_catalog.cc:263] Verifying existing consensus state
W20260924 01:56:59.025636 1473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:59.025633 1472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:59.025981 1470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648: Bootstrap starting.
W20260924 01:56:59.028710 1475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:59.028780 355 server_base.cc:1061] running on GCE node
I20260924 01:56:59.029084 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:59.029125 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:59.029141 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215019029141 us; error 0 us; skew 500 ppm
I20260924 01:56:59.030130 355 webserver.cc:533] Webserver started at http://127.0.88.252:39943/ using document root <none> and password file <none>
I20260924 01:56:59.030299 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:59.030346 355 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260924 01:56:59.030537 1470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 01:56:59.030843 1470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648: Bootstrap complete.
I20260924 01:56:59.031312 1470 raft_consensus.cc:359] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:59.031433 1470 raft_consensus.cc:740] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: afe848d9aa0f40e5bc817a6eb3731648, State: Initialized, Role: FOLLOWER
I20260924 01:56:59.031481 355 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:59.031635 1470 consensus_queue.cc:260] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:59.031903 1481 sys_catalog.cc:455] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } } }
I20260924 01:56:59.032063 1481 sys_catalog.cc:458] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:59.032138 1470 sys_catalog.cc:565] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 01:56:59.032414 1482 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:59.032660 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:59.032753 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-2-root
uuid: "689acd45027c418a8c5eb94704e18f39"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:59.032828 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:59.034374 1497 catalog_manager.cc:1308] Loaded cluster ID: c2cc71388c184b2f9a3a280d24e12a10
I20260924 01:56:59.034435 1497 catalog_manager.cc:1601] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648: loading cluster ID for follower catalog manager: success
I20260924 01:56:59.035887 1497 catalog_manager.cc:1623] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648: acquiring CA information for follower catalog manager: success
I20260924 01:56:59.036432 1497 catalog_manager.cc:1651] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 01:56:59.042457 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:59.042840 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:59.047506 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.252:37883
I20260924 01:56:59.047580 1545 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.252:37883 every 8 connection(s)
I20260924 01:56:59.048007 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260924 01:56:59.048049 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260924 01:56:59.048063 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260924 01:56:59.049185 1546 sys_catalog.cc:263] Verifying existing consensus state
I20260924 01:56:59.050022 1546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39: Bootstrap starting.
I20260924 01:56:59.054322 1546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 01:56:59.054621 1546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39: Bootstrap complete.
I20260924 01:56:59.055163 1546 raft_consensus.cc:359] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:59.055286 1546 raft_consensus.cc:740] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 689acd45027c418a8c5eb94704e18f39, State: Initialized, Role: FOLLOWER
I20260924 01:56:59.055459 1546 consensus_queue.cc:260] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:56:59.055778 1549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } } }
I20260924 01:56:59.055866 1549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:56:59.055896 1546 sys_catalog.cc:565] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 01:56:59.058002 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260924 01:56:59.058382 1560 catalog_manager.cc:1308] Loaded cluster ID: c2cc71388c184b2f9a3a280d24e12a10
I20260924 01:56:59.058436 1560 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39: loading cluster ID for follower catalog manager: success
I20260924 01:56:59.060048 1560 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39: acquiring CA information for follower catalog manager: success
W20260924 01:56:59.060089 1561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:59.060169 1562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:59.060245 355 server_base.cc:1061] running on GCE node
W20260924 01:56:59.060123 1564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:59.060568 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:59.060612 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:59.060629 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215019060629 us; error 0 us; skew 500 ppm
I20260924 01:56:59.060703 1560 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 01:56:59.061671 355 webserver.cc:533] Webserver started at http://127.0.88.193:39655/ using document root <none> and password file <none>
I20260924 01:56:59.061836 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:59.061874 355 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260924 01:56:59.062907 355 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:59.063786 1569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:59.064035 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:59.064126 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-0-root
uuid: "0e5eb856ea5349208153b5c473c02058"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:59.064217 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:59.070215 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:59.070583 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:59.070879 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:56:59.071317 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:56:59.071378 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:59.071439 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:56:59.071486 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:59.076206 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.193:44383
I20260924 01:56:59.076242 1632 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.193:44383 every 8 connection(s)
I20260924 01:56:59.077178 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:56:59.080215 1644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:59.080412 1643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:59.080534 355 server_base.cc:1061] running on GCE node
W20260924 01:56:59.081110 1646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:59.081410 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:59.081485 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:59.081514 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215019081513 us; error 0 us; skew 500 ppm
I20260924 01:56:59.082628 355 webserver.cc:533] Webserver started at http://127.0.88.194:41517/ using document root <none> and password file <none>
I20260924 01:56:59.082801 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:59.082870 355 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260924 01:56:59.083041 1633 heartbeater.cc:344] Connected to a master server at 127.0.88.252:37883
I20260924 01:56:59.083125 1633 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:59.083336 1633 heartbeater.cc:507] Master 127.0.88.252:37883 requested a full tablet report, sending...
I20260924 01:56:59.083532 1634 heartbeater.cc:344] Connected to a master server at 127.0.88.254:44605
I20260924 01:56:59.083550 1635 heartbeater.cc:344] Connected to a master server at 127.0.88.253:35667
I20260924 01:56:59.083638 1634 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:59.083638 1635 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:59.083858 1635 heartbeater.cc:507] Master 127.0.88.253:35667 requested a full tablet report, sending...
I20260924 01:56:59.084031 1509 ts_manager.cc:194] Registered new tserver with Master: 0e5eb856ea5349208153b5c473c02058 (127.0.88.193:44383)
I20260924 01:56:59.083858 1634 heartbeater.cc:507] Master 127.0.88.254:44605 requested a full tablet report, sending...
I20260924 01:56:59.084398 355 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260924 01:56:59.084501 1434 ts_manager.cc:194] Registered new tserver with Master: 0e5eb856ea5349208153b5c473c02058 (127.0.88.193:44383)
I20260924 01:56:59.084786 1358 ts_manager.cc:194] Registered new tserver with Master: 0e5eb856ea5349208153b5c473c02058 (127.0.88.193:44383)
I20260924 01:56:59.085318 1651 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:59.085623 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 01:56:59.085716 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-1-root
uuid: "ab6682781f9248648f642f9e75b95db0"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:59.085786 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:59.096715 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:59.097167 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:59.097568 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:56:59.098045 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:56:59.098119 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:59.098179 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:56:59.098232 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:59.102627 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.194:35963
I20260924 01:56:59.102705 1714 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.194:35963 every 8 connection(s)
I20260924 01:56:59.103569 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:56:59.106208 1722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:56:59.106458 1725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:59.107033 355 server_base.cc:1061] running on GCE node
W20260924 01:56:59.107275 1723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:56:59.107522 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:56:59.107576 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:56:59.107607 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215019107607 us; error 0 us; skew 500 ppm
I20260924 01:56:59.108560 355 webserver.cc:533] Webserver started at http://127.0.88.195:41601/ using document root <none> and password file <none>
I20260924 01:56:59.108600 1715 heartbeater.cc:344] Connected to a master server at 127.0.88.252:37883
I20260924 01:56:59.108695 1715 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:59.108729 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:56:59.108774 355 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260924 01:56:59.108896 1715 heartbeater.cc:507] Master 127.0.88.252:37883 requested a full tablet report, sending...
I20260924 01:56:59.109046 1717 heartbeater.cc:344] Connected to a master server at 127.0.88.253:35667
I20260924 01:56:59.109123 1717 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:59.109313 1717 heartbeater.cc:507] Master 127.0.88.253:35667 requested a full tablet report, sending...
I20260924 01:56:59.109464 1716 heartbeater.cc:344] Connected to a master server at 127.0.88.254:44605
I20260924 01:56:59.109556 1716 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:59.109660 1509 ts_manager.cc:194] Registered new tserver with Master: ab6682781f9248648f642f9e75b95db0 (127.0.88.194:35963)
I20260924 01:56:59.109728 1716 heartbeater.cc:507] Master 127.0.88.254:44605 requested a full tablet report, sending...
I20260924 01:56:59.109963 1434 ts_manager.cc:194] Registered new tserver with Master: ab6682781f9248648f642f9e75b95db0 (127.0.88.194:35963)
I20260924 01:56:59.110113 355 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:59.110373 1358 ts_manager.cc:194] Registered new tserver with Master: ab6682781f9248648f642f9e75b95db0 (127.0.88.194:35963)
I20260924 01:56:59.110929 1730 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:59.111183 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:56:59.111276 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-2-root
uuid: "c9ee5fa76cef48e08fa0b65db248556c"
format_stamp: "Formatted at 2026-09-24 01:56:58 on dist-test-slave-pgxx"
I20260924 01:56:59.111362 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskClusterRestart.1790215017804648-355-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:56:59.128026 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:56:59.128494 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:56:59.128815 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:56:59.129326 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:56:59.129392 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:59.129492 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:56:59.129549 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:56:59.134510 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.195:45391
I20260924 01:56:59.134591 1793 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.195:45391 every 8 connection(s)
I20260924 01:56:59.139985 1794 heartbeater.cc:344] Connected to a master server at 127.0.88.252:37883
I20260924 01:56:59.140120 1794 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:59.140153 1795 heartbeater.cc:344] Connected to a master server at 127.0.88.254:44605
I20260924 01:56:59.140213 1795 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:59.140362 1795 heartbeater.cc:507] Master 127.0.88.254:44605 requested a full tablet report, sending...
I20260924 01:56:59.140367 1794 heartbeater.cc:507] Master 127.0.88.252:37883 requested a full tablet report, sending...
I20260924 01:56:59.141079 1509 ts_manager.cc:194] Registered new tserver with Master: c9ee5fa76cef48e08fa0b65db248556c (127.0.88.195:45391)
I20260924 01:56:59.141079 1358 ts_manager.cc:194] Registered new tserver with Master: c9ee5fa76cef48e08fa0b65db248556c (127.0.88.195:45391)
I20260924 01:56:59.141109 1796 heartbeater.cc:344] Connected to a master server at 127.0.88.253:35667
I20260924 01:56:59.141350 1796 heartbeater.cc:461] Registering TS with master...
I20260924 01:56:59.141605 1796 heartbeater.cc:507] Master 127.0.88.253:35667 requested a full tablet report, sending...
I20260924 01:56:59.142211 1434 ts_manager.cc:194] Registered new tserver with Master: c9ee5fa76cef48e08fa0b65db248556c (127.0.88.195:45391)
I20260924 01:56:59.143098 355 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.008017322s
I20260924 01:57:00.254590 1802 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 01:57:00.254765 1802 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:57:00.255309 1802 leader_election.cc:290] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afe848d9aa0f40e5bc817a6eb3731648 (127.0.88.253:35667), 689acd45027c418a8c5eb94704e18f39 (127.0.88.252:37883)
I20260924 01:57:00.260196 1444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23ed7853320b406489e0cf6d196cb7bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afe848d9aa0f40e5bc817a6eb3731648" is_pre_election: true
I20260924 01:57:00.260197 1520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23ed7853320b406489e0cf6d196cb7bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "689acd45027c418a8c5eb94704e18f39" is_pre_election: true
I20260924 01:57:00.260392 1444 raft_consensus.cc:2468] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23ed7853320b406489e0cf6d196cb7bc in term 1.
I20260924 01:57:00.260401 1520 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23ed7853320b406489e0cf6d196cb7bc in term 1.
I20260924 01:57:00.260746 1345 leader_election.cc:304] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23ed7853320b406489e0cf6d196cb7bc, afe848d9aa0f40e5bc817a6eb3731648; no voters:
I20260924 01:57:00.261016 1802 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260924 01:57:00.261080 1802 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 01:57:00.261111 1802 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 1 FOLLOWER]: Advancing to term 2
I20260924 01:57:00.262013 1802 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:57:00.262385 1802 leader_election.cc:290] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [CANDIDATE]: Term 2 election: Requested vote from peers afe848d9aa0f40e5bc817a6eb3731648 (127.0.88.253:35667), 689acd45027c418a8c5eb94704e18f39 (127.0.88.252:37883)
I20260924 01:57:00.262709 1520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23ed7853320b406489e0cf6d196cb7bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "689acd45027c418a8c5eb94704e18f39"
I20260924 01:57:00.262797 1520 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 1 FOLLOWER]: Advancing to term 2
I20260924 01:57:00.263676 1520 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23ed7853320b406489e0cf6d196cb7bc in term 2.
I20260924 01:57:00.263916 1444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23ed7853320b406489e0cf6d196cb7bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "afe848d9aa0f40e5bc817a6eb3731648"
I20260924 01:57:00.264019 1444 raft_consensus.cc:3060] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 1 FOLLOWER]: Advancing to term 2
I20260924 01:57:00.263993 1342 leader_election.cc:304] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23ed7853320b406489e0cf6d196cb7bc, 689acd45027c418a8c5eb94704e18f39; no voters:
I20260924 01:57:00.264199 1802 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 2 FOLLOWER]: Leader election won for term 2
I20260924 01:57:00.264418 1802 raft_consensus.cc:697] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 2 LEADER]: Becoming Leader. State: Replica: 23ed7853320b406489e0cf6d196cb7bc, State: Running, Role: LEADER
I20260924 01:57:00.264596 1802 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } }
I20260924 01:57:00.265008 1444 raft_consensus.cc:2468] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23ed7853320b406489e0cf6d196cb7bc in term 2.
I20260924 01:57:00.265555 1807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23ed7853320b406489e0cf6d196cb7bc. Latest consensus state: current_term: 2 leader_uuid: "23ed7853320b406489e0cf6d196cb7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ed7853320b406489e0cf6d196cb7bc" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 44605 } } peers { permanent_uuid: "afe848d9aa0f40e5bc817a6eb3731648" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 35667 } } peers { permanent_uuid: "689acd45027c418a8c5eb94704e18f39" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 37883 } } }
I20260924 01:57:00.265645 1807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [sys.catalog]: This master's current role is: LEADER
I20260924 01:57:00.265894 1809 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260924 01:57:00.266683 1809 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260924 01:57:00.267102 1809 catalog_manager.cc:1308] Loaded cluster ID: c2cc71388c184b2f9a3a280d24e12a10
I20260924 01:57:00.267174 1809 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260924 01:57:00.267668 1809 catalog_manager.cc:1553] Loading token signing keys...
I20260924 01:57:00.268064 1809 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: Loaded TSK: 0
I20260924 01:57:00.268376 1809 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260924 01:57:00.348551 355 tablet_server.cc:179] TabletServer@127.0.88.193:0 shutting down...
I20260924 01:57:00.352283 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:57:00.364768 355 tablet_server.cc:196] TabletServer@127.0.88.193:0 shutdown complete.
I20260924 01:57:00.366710 355 tablet_server.cc:179] TabletServer@127.0.88.194:0 shutting down...
I20260924 01:57:00.370590 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:57:00.382860 355 tablet_server.cc:196] TabletServer@127.0.88.194:0 shutdown complete.
I20260924 01:57:00.384779 355 tablet_server.cc:179] TabletServer@127.0.88.195:0 shutting down...
I20260924 01:57:00.388427 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:57:00.401127 355 tablet_server.cc:196] TabletServer@127.0.88.195:0 shutdown complete.
I20260924 01:57:00.403219 355 master.cc:562] Master@127.0.88.254:44605 shutting down...
I20260924 01:57:00.406720 355 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 2 LEADER]: Raft consensus shutting down.
I20260924 01:57:00.406952 355 pending_rounds.cc:70] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: Trying to abort 1 pending ops.
I20260924 01:57:00.407078 355 pending_rounds.cc:77] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc: Aborting op as it isn't in flight: id { term: 2 index: 5 } timestamp: 7332720723005689856 op_type: NO_OP noop_request { }
I20260924 01:57:00.407182 355 raft_consensus.cc:2889] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260924 01:57:00.407258 355 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 23ed7853320b406489e0cf6d196cb7bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260924 01:57:00.407359 355 tablet_replica.cc:333] stopping tablet replica
I20260924 01:57:00.420051 355 master.cc:584] Master@127.0.88.254:44605 shutdown complete.
I20260924 01:57:00.422581 355 master.cc:562] Master@127.0.88.253:35667 shutting down...
I20260924 01:57:00.425596 355 raft_consensus.cc:2243] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260924 01:57:00.425765 355 raft_consensus.cc:2272] T 00000000000000000000000000000000 P afe848d9aa0f40e5bc817a6eb3731648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260924 01:57:00.425856 355 tablet_replica.cc:333] stopping tablet replica
I20260924 01:57:00.438251 355 master.cc:584] Master@127.0.88.253:35667 shutdown complete.
I20260924 01:57:00.441305 355 master.cc:562] Master@127.0.88.252:37883 shutting down...
I20260924 01:57:00.444444 355 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260924 01:57:00.444617 355 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 689acd45027c418a8c5eb94704e18f39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260924 01:57:00.444738 355 tablet_replica.cc:333] stopping tablet replica
I20260924 01:57:00.457414 355 master.cc:584] Master@127.0.88.252:37883 shutdown complete.
[ OK ] TokenSignerITest.TskClusterRestart (2043 ms)
[ RUN ] TokenSignerITest.TskMasterLeadershipChange
I20260924 01:57:00.464764 355 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.88.254:39019,127.0.88.253:45447,127.0.88.252:38105
I20260924 01:57:00.465201 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:57:00.467057 1811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:00.467058 1810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:00.467054 1813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:00.467370 355 server_base.cc:1061] running on GCE node
I20260924 01:57:00.467516 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:57:00.467549 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:57:00.467564 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215020467565 us; error 0 us; skew 500 ppm
I20260924 01:57:00.468371 355 webserver.cc:533] Webserver started at http://127.0.88.254:39747/ using document root <none> and password file <none>
I20260924 01:57:00.468528 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:57:00.468571 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:57:00.468623 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:57:00.468999 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-0-root/instance:
uuid: "07e6694ed4734493b43d97d6d2fc99c1"
format_stamp: "Formatted at 2026-09-24 01:57:00 on dist-test-slave-pgxx"
I20260924 01:57:00.470449 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260924 01:57:00.471346 1818 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:00.471654 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 01:57:00.471716 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-0-root
uuid: "07e6694ed4734493b43d97d6d2fc99c1"
format_stamp: "Formatted at 2026-09-24 01:57:00 on dist-test-slave-pgxx"
I20260924 01:57:00.471810 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:57:00.486171 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:57:00.486719 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:57:00.491029 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.254:39019
I20260924 01:57:00.492585 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260924 01:57:00.494783 1870 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.254:39019 every 8 connection(s)
I20260924 01:57:00.495378 1871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 01:57:00.496023 355 server_base.cc:1061] running on GCE node
W20260924 01:57:00.496021 1874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:00.496731 1871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } has no permanent_uuid. Determining permanent_uuid...
W20260924 01:57:00.497568 1873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:00.497852 1876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:00.498075 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:57:00.498129 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:57:00.498152 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215020498152 us; error 0 us; skew 500 ppm
I20260924 01:57:00.499053 355 webserver.cc:533] Webserver started at http://127.0.88.253:46207/ using document root <none> and password file <none>
I20260924 01:57:00.499210 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:57:00.499251 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:57:00.499307 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:57:00.499827 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-1-root/instance:
uuid: "661e9e63ec7d43568ce53158bd65b79a"
format_stamp: "Formatted at 2026-09-24 01:57:00 on dist-test-slave-pgxx"
I20260924 01:57:00.501830 355 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260924 01:57:00.502050 1871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:57:00.502946 1883 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:00.503242 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 01:57:00.503348 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-1-root
uuid: "661e9e63ec7d43568ce53158bd65b79a"
format_stamp: "Formatted at 2026-09-24 01:57:00 on dist-test-slave-pgxx"
I20260924 01:57:00.503420 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260924 01:57:00.503465 1871 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.88.253:45447: Network error: Client connection negotiation failed: client connection to 127.0.88.253:45447: connect: Connection refused (error 111)
I20260924 01:57:00.526968 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:57:00.527422 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:57:00.531337 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.253:45447
I20260924 01:57:00.531401 1936 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.253:45447 every 8 connection(s)
I20260924 01:57:00.532174 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260924 01:57:00.532262 1937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260924 01:57:00.533792 1939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:00.533789 1937 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } has no permanent_uuid. Determining permanent_uuid...
W20260924 01:57:00.533957 1940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:00.534034 1942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:00.534132 355 server_base.cc:1061] running on GCE node
I20260924 01:57:00.534461 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:57:00.534526 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:57:00.534547 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215020534547 us; error 0 us; skew 500 ppm
I20260924 01:57:00.535434 355 webserver.cc:533] Webserver started at http://127.0.88.252:38291/ using document root <none> and password file <none>
I20260924 01:57:00.535595 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:57:00.535662 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:57:00.535739 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:57:00.536098 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-2-root/instance:
uuid: "5c5224e53b6f41d1bb080f6209b614e5"
format_stamp: "Formatted at 2026-09-24 01:57:00 on dist-test-slave-pgxx"
I20260924 01:57:00.537822 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260924 01:57:00.538312 1937 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:57:00.539007 1948 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:00.539299 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 01:57:00.539378 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-2-root
uuid: "5c5224e53b6f41d1bb080f6209b614e5"
format_stamp: "Formatted at 2026-09-24 01:57:00 on dist-test-slave-pgxx"
I20260924 01:57:00.539443 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:57:00.542546 1937 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } has no permanent_uuid. Determining permanent_uuid...
W20260924 01:57:00.543833 1937 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.88.252:38105: Network error: Client connection negotiation failed: client connection to 127.0.88.252:38105: connect: Connection refused (error 111)
I20260924 01:57:00.549264 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:57:00.549685 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:57:00.553509 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.252:38105
I20260924 01:57:00.553534 2002 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.252:38105 every 8 connection(s)
I20260924 01:57:00.553972 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260924 01:57:00.554388 2003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 01:57:00.555444 2003 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:57:00.555639 1871 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } attempt: 1
I20260924 01:57:00.559566 1871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:57:00.559505 2003 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:57:00.563506 2003 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:57:00.564798 1871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1: Bootstrap starting.
I20260924 01:57:00.566074 1871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1: Neither blocks nor log segments found. Creating new log.
I20260924 01:57:00.567404 1871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1: No bootstrap required, opened a new log
I20260924 01:57:00.567838 1871 raft_consensus.cc:359] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:00.567950 1871 raft_consensus.cc:385] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 01:57:00.567998 1871 raft_consensus.cc:740] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07e6694ed4734493b43d97d6d2fc99c1, State: Initialized, Role: FOLLOWER
I20260924 01:57:00.568140 1871 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:00.568331 2003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5: Bootstrap starting.
I20260924 01:57:00.568480 2008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } } }
I20260924 01:57:00.568602 2008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:57:00.568699 1871 sys_catalog.cc:565] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 01:57:00.569391 2003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5: Neither blocks nor log segments found. Creating new log.
I20260924 01:57:00.570468 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260924 01:57:00.570731 2003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5: No bootstrap required, opened a new log
I20260924 01:57:00.570995 1937 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } attempt: 1
W20260924 01:57:00.571033 2020 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 01:57:00.571102 2020 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 01:57:00.571199 2003 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:00.571317 2003 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 01:57:00.571365 2003 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c5224e53b6f41d1bb080f6209b614e5, State: Initialized, Role: FOLLOWER
I20260924 01:57:00.571496 2003 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:00.571846 2021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } } }
I20260924 01:57:00.571964 2021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:57:00.572072 2003 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [sys.catalog]: configured and running, proceeding with master startup.
W20260924 01:57:00.574740 2032 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 01:57:00.574812 2032 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 01:57:00.576155 1937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a: Bootstrap starting.
I20260924 01:57:00.577077 1937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a: Neither blocks nor log segments found. Creating new log.
I20260924 01:57:00.578198 1937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a: No bootstrap required, opened a new log
I20260924 01:57:00.578667 1937 raft_consensus.cc:359] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:00.578758 1937 raft_consensus.cc:385] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 01:57:00.578823 1937 raft_consensus.cc:740] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 661e9e63ec7d43568ce53158bd65b79a, State: Initialized, Role: FOLLOWER
I20260924 01:57:00.578974 1937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:00.579283 2034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } } }
I20260924 01:57:00.579380 2034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:57:00.579478 1937 sys_catalog.cc:565] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [sys.catalog]: configured and running, proceeding with master startup.
I20260924 01:57:00.581156 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
W20260924 01:57:00.581682 2045 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 01:57:00.581768 2045 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 01:57:00.581719 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:57:00.583768 2046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:00.583868 2047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:00.583921 355 server_base.cc:1061] running on GCE node
W20260924 01:57:00.583930 2049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:00.584196 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:57:00.584263 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:57:00.584309 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215020584308 us; error 0 us; skew 500 ppm
I20260924 01:57:00.585211 355 webserver.cc:533] Webserver started at http://127.0.88.193:34331/ using document root <none> and password file <none>
I20260924 01:57:00.585390 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:57:00.585489 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:57:00.585573 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:57:00.585992 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-0-root/instance:
uuid: "06007f73abb849679fe4aa00805ef21d"
format_stamp: "Formatted at 2026-09-24 01:57:00 on dist-test-slave-pgxx"
I20260924 01:57:00.587666 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 01:57:00.588752 2054 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:00.589006 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:57:00.589138 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-0-root
uuid: "06007f73abb849679fe4aa00805ef21d"
format_stamp: "Formatted at 2026-09-24 01:57:00 on dist-test-slave-pgxx"
I20260924 01:57:00.589236 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:57:00.605926 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:57:00.606384 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:57:00.606703 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:57:00.607213 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:57:00.607278 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:00.607340 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:57:00.607375 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:00.611891 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.193:38119
I20260924 01:57:00.611974 2117 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.193:38119 every 8 connection(s)
I20260924 01:57:00.612958 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:57:00.615945 2125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:00.616017 2128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:00.616173 2126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:00.616822 355 server_base.cc:1061] running on GCE node
I20260924 01:57:00.617035 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:57:00.617077 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:57:00.617094 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215020617095 us; error 0 us; skew 500 ppm
I20260924 01:57:00.617910 355 webserver.cc:533] Webserver started at http://127.0.88.194:38113/ using document root <none> and password file <none>
I20260924 01:57:00.618088 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:57:00.618165 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:57:00.618245 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:57:00.618638 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-1-root/instance:
uuid: "d32bda0f35434154959c52b85dbda963"
format_stamp: "Formatted at 2026-09-24 01:57:00 on dist-test-slave-pgxx"
I20260924 01:57:00.620226 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 01:57:00.621631 2133 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:00.621662 2120 heartbeater.cc:344] Connected to a master server at 127.0.88.253:45447
I20260924 01:57:00.621758 2120 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:00.621860 2119 heartbeater.cc:344] Connected to a master server at 127.0.88.254:39019
I20260924 01:57:00.621878 2118 heartbeater.cc:344] Connected to a master server at 127.0.88.252:38105
I20260924 01:57:00.621932 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:57:00.621986 2120 heartbeater.cc:507] Master 127.0.88.253:45447 requested a full tablet report, sending...
I20260924 01:57:00.621960 2118 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:00.621960 2119 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:00.622217 2118 heartbeater.cc:507] Master 127.0.88.252:38105 requested a full tablet report, sending...
I20260924 01:57:00.622336 2119 heartbeater.cc:507] Master 127.0.88.254:39019 requested a full tablet report, sending...
I20260924 01:57:00.621994 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-1-root
uuid: "d32bda0f35434154959c52b85dbda963"
format_stamp: "Formatted at 2026-09-24 01:57:00 on dist-test-slave-pgxx"
I20260924 01:57:00.622439 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:57:00.622747 1901 ts_manager.cc:194] Registered new tserver with Master: 06007f73abb849679fe4aa00805ef21d (127.0.88.193:38119)
I20260924 01:57:00.622979 1835 ts_manager.cc:194] Registered new tserver with Master: 06007f73abb849679fe4aa00805ef21d (127.0.88.193:38119)
I20260924 01:57:00.622979 1967 ts_manager.cc:194] Registered new tserver with Master: 06007f73abb849679fe4aa00805ef21d (127.0.88.193:38119)
I20260924 01:57:00.673147 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:57:00.673561 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:57:00.673961 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:57:00.674503 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:57:00.674546 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:00.674611 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:57:00.674645 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:00.679231 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.194:40209
I20260924 01:57:00.679329 2196 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.194:40209 every 8 connection(s)
I20260924 01:57:00.680333 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:57:00.683173 2204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:00.683216 2207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:00.683833 2205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:00.684001 355 server_base.cc:1061] running on GCE node
I20260924 01:57:00.684226 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:57:00.684273 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:57:00.684307 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215020684306 us; error 0 us; skew 500 ppm
I20260924 01:57:00.685236 355 webserver.cc:533] Webserver started at http://127.0.88.195:40197/ using document root <none> and password file <none>
I20260924 01:57:00.685406 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:57:00.685491 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:57:00.685570 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:57:00.685662 2198 heartbeater.cc:344] Connected to a master server at 127.0.88.254:39019
I20260924 01:57:00.685662 2197 heartbeater.cc:344] Connected to a master server at 127.0.88.252:38105
I20260924 01:57:00.685786 2197 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:00.685786 2198 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:00.685803 2199 heartbeater.cc:344] Connected to a master server at 127.0.88.253:45447
I20260924 01:57:00.686051 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-2-root/instance:
uuid: "8ee840ce6cff46de8260cd5b3b67d223"
format_stamp: "Formatted at 2026-09-24 01:57:00 on dist-test-slave-pgxx"
I20260924 01:57:00.686178 2199 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:00.686251 2198 heartbeater.cc:507] Master 127.0.88.254:39019 requested a full tablet report, sending...
I20260924 01:57:00.686249 2197 heartbeater.cc:507] Master 127.0.88.252:38105 requested a full tablet report, sending...
I20260924 01:57:00.686386 2199 heartbeater.cc:507] Master 127.0.88.253:45447 requested a full tablet report, sending...
I20260924 01:57:00.687057 1967 ts_manager.cc:194] Registered new tserver with Master: d32bda0f35434154959c52b85dbda963 (127.0.88.194:40209)
I20260924 01:57:00.687084 1901 ts_manager.cc:194] Registered new tserver with Master: d32bda0f35434154959c52b85dbda963 (127.0.88.194:40209)
I20260924 01:57:00.687585 1835 ts_manager.cc:194] Registered new tserver with Master: d32bda0f35434154959c52b85dbda963 (127.0.88.194:40209)
I20260924 01:57:00.688045 355 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260924 01:57:00.688997 2212 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:00.689251 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 01:57:00.689339 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-2-root
uuid: "8ee840ce6cff46de8260cd5b3b67d223"
format_stamp: "Formatted at 2026-09-24 01:57:00 on dist-test-slave-pgxx"
I20260924 01:57:00.689404 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.TskMasterLeadershipChange.1790215017804648-355-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:57:00.698518 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:57:00.698945 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:57:00.699259 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:57:00.699754 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:57:00.699818 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:00.699882 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:57:00.699936 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:00.704335 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.195:40281
I20260924 01:57:00.704443 2275 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.195:40281 every 8 connection(s)
I20260924 01:57:00.709836 2278 heartbeater.cc:344] Connected to a master server at 127.0.88.253:45447
I20260924 01:57:00.709946 2278 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:00.710222 2278 heartbeater.cc:507] Master 127.0.88.253:45447 requested a full tablet report, sending...
I20260924 01:57:00.710251 2277 heartbeater.cc:344] Connected to a master server at 127.0.88.254:39019
I20260924 01:57:00.710287 2276 heartbeater.cc:344] Connected to a master server at 127.0.88.252:38105
I20260924 01:57:00.710310 2277 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:00.710402 2276 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:00.710556 2276 heartbeater.cc:507] Master 127.0.88.252:38105 requested a full tablet report, sending...
I20260924 01:57:00.710556 2277 heartbeater.cc:507] Master 127.0.88.254:39019 requested a full tablet report, sending...
I20260924 01:57:00.710903 1901 ts_manager.cc:194] Registered new tserver with Master: 8ee840ce6cff46de8260cd5b3b67d223 (127.0.88.195:40281)
I20260924 01:57:00.711230 1967 ts_manager.cc:194] Registered new tserver with Master: 8ee840ce6cff46de8260cd5b3b67d223 (127.0.88.195:40281)
I20260924 01:57:00.711553 1835 ts_manager.cc:194] Registered new tserver with Master: 8ee840ce6cff46de8260cd5b3b67d223 (127.0.88.195:40281)
I20260924 01:57:00.712245 355 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.007335018s
I20260924 01:57:00.714356 2034 raft_consensus.cc:493] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 01:57:00.714468 2034 raft_consensus.cc:515] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:00.714804 2034 leader_election.cc:290] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07e6694ed4734493b43d97d6d2fc99c1 (127.0.88.254:39019), 5c5224e53b6f41d1bb080f6209b614e5 (127.0.88.252:38105)
I20260924 01:57:00.715245 1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "661e9e63ec7d43568ce53158bd65b79a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07e6694ed4734493b43d97d6d2fc99c1" is_pre_election: true
I20260924 01:57:00.715346 1977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "661e9e63ec7d43568ce53158bd65b79a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c5224e53b6f41d1bb080f6209b614e5" is_pre_election: true
I20260924 01:57:00.715386 1845 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 661e9e63ec7d43568ce53158bd65b79a in term 0.
I20260924 01:57:00.715504 1977 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 661e9e63ec7d43568ce53158bd65b79a in term 0.
I20260924 01:57:00.715814 1887 leader_election.cc:304] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c5224e53b6f41d1bb080f6209b614e5, 661e9e63ec7d43568ce53158bd65b79a; no voters:
I20260924 01:57:00.716014 2034 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 01:57:00.716121 2034 raft_consensus.cc:493] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 01:57:00.716179 2034 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [term 0 FOLLOWER]: Advancing to term 1
I20260924 01:57:00.717003 2034 raft_consensus.cc:515] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:00.717335 2034 leader_election.cc:290] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [CANDIDATE]: Term 1 election: Requested vote from peers 07e6694ed4734493b43d97d6d2fc99c1 (127.0.88.254:39019), 5c5224e53b6f41d1bb080f6209b614e5 (127.0.88.252:38105)
I20260924 01:57:00.717700 1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "661e9e63ec7d43568ce53158bd65b79a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07e6694ed4734493b43d97d6d2fc99c1"
I20260924 01:57:00.717784 1977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "661e9e63ec7d43568ce53158bd65b79a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c5224e53b6f41d1bb080f6209b614e5"
I20260924 01:57:00.717811 1845 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 0 FOLLOWER]: Advancing to term 1
I20260924 01:57:00.717918 1977 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 01:57:00.718653 1845 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 661e9e63ec7d43568ce53158bd65b79a in term 1.
I20260924 01:57:00.718772 1977 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 661e9e63ec7d43568ce53158bd65b79a in term 1.
I20260924 01:57:00.718914 1887 leader_election.cc:304] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07e6694ed4734493b43d97d6d2fc99c1, 661e9e63ec7d43568ce53158bd65b79a; no voters:
I20260924 01:57:00.719079 2034 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [term 1 FOLLOWER]: Leader election won for term 1
I20260924 01:57:00.719276 2034 raft_consensus.cc:697] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [term 1 LEADER]: Becoming Leader. State: Replica: 661e9e63ec7d43568ce53158bd65b79a, State: Running, Role: LEADER
I20260924 01:57:00.719441 2034 consensus_queue.cc:237] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:00.720182 2284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 661e9e63ec7d43568ce53158bd65b79a. Latest consensus state: current_term: 1 leader_uuid: "661e9e63ec7d43568ce53158bd65b79a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } } }
I20260924 01:57:00.720278 2284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [sys.catalog]: This master's current role is: LEADER
I20260924 01:57:00.720552 2286 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260924 01:57:00.721372 2286 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260924 01:57:00.723218 1977 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 1 FOLLOWER]: Refusing update from remote peer 661e9e63ec7d43568ce53158bd65b79a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 01:57:00.723261 1845 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 1 FOLLOWER]: Refusing update from remote peer 661e9e63ec7d43568ce53158bd65b79a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 01:57:00.723657 2284 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 01:57:00.723812 2034 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [LEADER]: Connected to new peer: Peer: permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 01:57:00.725159 2008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 661e9e63ec7d43568ce53158bd65b79a. Latest consensus state: current_term: 1 leader_uuid: "661e9e63ec7d43568ce53158bd65b79a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } } }
I20260924 01:57:00.725294 2008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:57:00.725283 2021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 661e9e63ec7d43568ce53158bd65b79a. Latest consensus state: current_term: 1 leader_uuid: "661e9e63ec7d43568ce53158bd65b79a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } } }
I20260924 01:57:00.725373 2021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:57:00.727567 2286 catalog_manager.cc:1396] Generated new cluster ID: ba9fbcd7f931429d9a3fa1cc48787b30
I20260924 01:57:00.727514 2021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "661e9e63ec7d43568ce53158bd65b79a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } } }
I20260924 01:57:00.727629 2286 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260924 01:57:00.727656 2021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:57:00.727754 2284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "661e9e63ec7d43568ce53158bd65b79a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } } }
I20260924 01:57:00.727759 2008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "661e9e63ec7d43568ce53158bd65b79a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } } }
I20260924 01:57:00.727839 2284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [sys.catalog]: This master's current role is: LEADER
I20260924 01:57:00.727860 2008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:57:00.726948 2292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "661e9e63ec7d43568ce53158bd65b79a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } } }
I20260924 01:57:00.729598 2292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [sys.catalog]: This master's current role is: LEADER
I20260924 01:57:00.741730 2286 catalog_manager.cc:1419] Generated new certificate authority record
I20260924 01:57:00.742483 2286 catalog_manager.cc:1553] Loading token signing keys...
I20260924 01:57:00.753945 2286 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a: Generated new TSK 0
I20260924 01:57:00.754211 2286 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260924 01:57:00.813777 355 master.cc:562] Master@127.0.88.253:45447 shutting down...
I20260924 01:57:00.817273 355 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [term 1 LEADER]: Raft consensus shutting down.
I20260924 01:57:00.817605 355 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 01:57:00.817740 355 tablet_replica.cc:333] T 00000000000000000000000000000000 P 661e9e63ec7d43568ce53158bd65b79a: stopping tablet replica
I20260924 01:57:00.831423 355 master.cc:584] Master@127.0.88.253:45447 shutdown complete.
I20260924 01:57:01.571918 2020 catalog_manager.cc:1308] Loaded cluster ID: ba9fbcd7f931429d9a3fa1cc48787b30
I20260924 01:57:01.572008 2020 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1: loading cluster ID for follower catalog manager: success
I20260924 01:57:01.573257 2020 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1: acquiring CA information for follower catalog manager: success
I20260924 01:57:01.573827 2020 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 01:57:01.575368 2032 catalog_manager.cc:1308] Loaded cluster ID: ba9fbcd7f931429d9a3fa1cc48787b30
I20260924 01:57:01.575416 2032 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5: loading cluster ID for follower catalog manager: success
I20260924 01:57:01.576395 2032 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5: acquiring CA information for follower catalog manager: success
I20260924 01:57:01.576843 2032 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260924 01:57:01.624737 2120 heartbeater.cc:646] Failed to heartbeat to 127.0.88.253:45447 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.88.253:45447: connect: Connection refused (error 111)
I20260924 01:57:02.254122 2300 raft_consensus.cc:493] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 661e9e63ec7d43568ce53158bd65b79a)
I20260924 01:57:02.254266 2301 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 661e9e63ec7d43568ce53158bd65b79a)
I20260924 01:57:02.254328 2300 raft_consensus.cc:515] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:02.254436 2301 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:02.254920 2301 leader_election.cc:290] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07e6694ed4734493b43d97d6d2fc99c1 (127.0.88.254:39019), 661e9e63ec7d43568ce53158bd65b79a (127.0.88.253:45447)
I20260924 01:57:02.254925 2300 leader_election.cc:290] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 661e9e63ec7d43568ce53158bd65b79a (127.0.88.253:45447), 5c5224e53b6f41d1bb080f6209b614e5 (127.0.88.252:38105)
I20260924 01:57:02.255491 1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c5224e53b6f41d1bb080f6209b614e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "07e6694ed4734493b43d97d6d2fc99c1" is_pre_election: true
I20260924 01:57:02.255508 1977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "07e6694ed4734493b43d97d6d2fc99c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c5224e53b6f41d1bb080f6209b614e5" is_pre_election: true
I20260924 01:57:02.255676 1845 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c5224e53b6f41d1bb080f6209b614e5 in term 1.
I20260924 01:57:02.255688 1977 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07e6694ed4734493b43d97d6d2fc99c1 in term 1.
I20260924 01:57:02.256079 1821 leader_election.cc:304] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07e6694ed4734493b43d97d6d2fc99c1, 5c5224e53b6f41d1bb080f6209b614e5; no voters:
I20260924 01:57:02.256211 1952 leader_election.cc:304] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07e6694ed4734493b43d97d6d2fc99c1, 5c5224e53b6f41d1bb080f6209b614e5; no voters:
I20260924 01:57:02.256294 2300 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260924 01:57:02.256350 2300 raft_consensus.cc:493] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 661e9e63ec7d43568ce53158bd65b79a)
I20260924 01:57:02.256407 2300 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 1 FOLLOWER]: Advancing to term 2
I20260924 01:57:02.256435 2301 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260924 01:57:02.256486 2301 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 661e9e63ec7d43568ce53158bd65b79a)
I20260924 01:57:02.256538 2301 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 1 FOLLOWER]: Advancing to term 2
W20260924 01:57:02.256713 1950 leader_election.cc:336] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 661e9e63ec7d43568ce53158bd65b79a (127.0.88.253:45447): Network error: Client connection negotiation failed: client connection to 127.0.88.253:45447: connect: Connection refused (error 111)
W20260924 01:57:02.256713 1819 leader_election.cc:336] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 661e9e63ec7d43568ce53158bd65b79a (127.0.88.253:45447): Network error: Client connection negotiation failed: client connection to 127.0.88.253:45447: connect: Connection refused (error 111)
I20260924 01:57:02.257583 2301 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:02.257583 2300 raft_consensus.cc:515] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:02.257992 2301 leader_election.cc:290] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [CANDIDATE]: Term 2 election: Requested vote from peers 07e6694ed4734493b43d97d6d2fc99c1 (127.0.88.254:39019), 661e9e63ec7d43568ce53158bd65b79a (127.0.88.253:45447)
I20260924 01:57:02.257992 2300 leader_election.cc:290] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [CANDIDATE]: Term 2 election: Requested vote from peers 661e9e63ec7d43568ce53158bd65b79a (127.0.88.253:45447), 5c5224e53b6f41d1bb080f6209b614e5 (127.0.88.252:38105)
I20260924 01:57:02.258395 1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c5224e53b6f41d1bb080f6209b614e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "07e6694ed4734493b43d97d6d2fc99c1"
I20260924 01:57:02.258414 1977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "07e6694ed4734493b43d97d6d2fc99c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c5224e53b6f41d1bb080f6209b614e5"
I20260924 01:57:02.258627 1977 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 07e6694ed4734493b43d97d6d2fc99c1 in current term 2: Already voted for candidate 5c5224e53b6f41d1bb080f6209b614e5 in this term.
I20260924 01:57:02.258630 1845 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c5224e53b6f41d1bb080f6209b614e5 in current term 2: Already voted for candidate 07e6694ed4734493b43d97d6d2fc99c1 in this term.
W20260924 01:57:02.259063 1950 leader_election.cc:336] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 661e9e63ec7d43568ce53158bd65b79a (127.0.88.253:45447): Network error: Client connection negotiation failed: client connection to 127.0.88.253:45447: connect: Connection refused (error 111)
I20260924 01:57:02.259248 1952 leader_election.cc:304] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c5224e53b6f41d1bb080f6209b614e5; no voters: 07e6694ed4734493b43d97d6d2fc99c1, 661e9e63ec7d43568ce53158bd65b79a
W20260924 01:57:02.259251 1819 leader_election.cc:336] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 661e9e63ec7d43568ce53158bd65b79a (127.0.88.253:45447): Network error: Client connection negotiation failed: client connection to 127.0.88.253:45447: connect: Connection refused (error 111)
I20260924 01:57:02.259400 1819 leader_election.cc:304] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07e6694ed4734493b43d97d6d2fc99c1; no voters: 5c5224e53b6f41d1bb080f6209b614e5, 661e9e63ec7d43568ce53158bd65b79a
I20260924 01:57:02.259438 2301 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260924 01:57:02.259588 2300 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260924 01:57:03.972416 2312 raft_consensus.cc:493] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 01:57:03.972564 2312 raft_consensus.cc:515] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:03.973202 2312 leader_election.cc:290] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 661e9e63ec7d43568ce53158bd65b79a (127.0.88.253:45447), 5c5224e53b6f41d1bb080f6209b614e5 (127.0.88.252:38105)
I20260924 01:57:03.973717 1977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "07e6694ed4734493b43d97d6d2fc99c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c5224e53b6f41d1bb080f6209b614e5" is_pre_election: true
W20260924 01:57:03.973889 1819 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.88.253:45447: connect: Connection refused (error 111) [suppressed 9 similar messages]
I20260924 01:57:03.973898 1977 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07e6694ed4734493b43d97d6d2fc99c1 in term 2.
I20260924 01:57:03.974306 1821 leader_election.cc:304] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07e6694ed4734493b43d97d6d2fc99c1, 5c5224e53b6f41d1bb080f6209b614e5; no voters:
I20260924 01:57:03.974545 2312 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260924 01:57:03.974611 2312 raft_consensus.cc:493] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 01:57:03.974644 2312 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 2 FOLLOWER]: Advancing to term 3
W20260924 01:57:03.974913 1819 leader_election.cc:336] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 661e9e63ec7d43568ce53158bd65b79a (127.0.88.253:45447): Network error: Client connection negotiation failed: client connection to 127.0.88.253:45447: connect: Connection refused (error 111)
I20260924 01:57:03.975719 2312 raft_consensus.cc:515] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:03.976147 2312 leader_election.cc:290] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [CANDIDATE]: Term 3 election: Requested vote from peers 661e9e63ec7d43568ce53158bd65b79a (127.0.88.253:45447), 5c5224e53b6f41d1bb080f6209b614e5 (127.0.88.252:38105)
I20260924 01:57:03.976526 1977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "07e6694ed4734493b43d97d6d2fc99c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c5224e53b6f41d1bb080f6209b614e5"
I20260924 01:57:03.976655 1977 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 2 FOLLOWER]: Advancing to term 3
W20260924 01:57:03.977208 1819 leader_election.cc:336] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 661e9e63ec7d43568ce53158bd65b79a (127.0.88.253:45447): Network error: Client connection negotiation failed: client connection to 127.0.88.253:45447: connect: Connection refused (error 111)
I20260924 01:57:03.977762 1977 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07e6694ed4734493b43d97d6d2fc99c1 in term 3.
I20260924 01:57:03.978063 1821 leader_election.cc:304] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07e6694ed4734493b43d97d6d2fc99c1, 5c5224e53b6f41d1bb080f6209b614e5; no voters: 661e9e63ec7d43568ce53158bd65b79a
I20260924 01:57:03.978250 2312 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260924 01:57:03.978503 2312 raft_consensus.cc:697] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 3 LEADER]: Becoming Leader. State: Replica: 07e6694ed4734493b43d97d6d2fc99c1, State: Running, Role: LEADER
I20260924 01:57:03.978684 2312 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } }
I20260924 01:57:03.979477 2315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07e6694ed4734493b43d97d6d2fc99c1. Latest consensus state: current_term: 3 leader_uuid: "07e6694ed4734493b43d97d6d2fc99c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07e6694ed4734493b43d97d6d2fc99c1" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 39019 } } peers { permanent_uuid: "661e9e63ec7d43568ce53158bd65b79a" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 45447 } } peers { permanent_uuid: "5c5224e53b6f41d1bb080f6209b614e5" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 38105 } } }
I20260924 01:57:03.979596 2315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [sys.catalog]: This master's current role is: LEADER
I20260924 01:57:03.979856 2317 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260924 01:57:03.980629 2317 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260924 01:57:03.981015 2317 catalog_manager.cc:1308] Loaded cluster ID: ba9fbcd7f931429d9a3fa1cc48787b30
I20260924 01:57:03.981062 2317 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260924 01:57:03.981670 2317 catalog_manager.cc:1553] Loading token signing keys...
I20260924 01:57:03.982056 2317 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1: Loaded TSK: 0
I20260924 01:57:03.982275 2317 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260924 01:57:04.045547 355 tablet_server.cc:179] TabletServer@127.0.88.193:0 shutting down...
I20260924 01:57:04.049315 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:57:04.061674 355 tablet_server.cc:196] TabletServer@127.0.88.193:0 shutdown complete.
I20260924 01:57:04.063426 355 tablet_server.cc:179] TabletServer@127.0.88.194:0 shutting down...
I20260924 01:57:04.067131 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:57:04.079396 355 tablet_server.cc:196] TabletServer@127.0.88.194:0 shutdown complete.
I20260924 01:57:04.081364 355 tablet_server.cc:179] TabletServer@127.0.88.195:0 shutting down...
I20260924 01:57:04.085032 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:57:04.097295 355 tablet_server.cc:196] TabletServer@127.0.88.195:0 shutdown complete.
I20260924 01:57:04.099298 355 master.cc:562] Master@127.0.88.254:39019 shutting down...
I20260924 01:57:04.102870 355 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 3 LEADER]: Raft consensus shutting down.
I20260924 01:57:04.103108 355 pending_rounds.cc:70] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1: Trying to abort 1 pending ops.
I20260924 01:57:04.103143 355 pending_rounds.cc:77] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1: Aborting op as it isn't in flight: id { term: 3 index: 5 } timestamp: 7332720738218598400 op_type: NO_OP noop_request { }
I20260924 01:57:04.103242 355 raft_consensus.cc:2889] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260924 01:57:04.103317 355 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260924 01:57:04.103415 355 tablet_replica.cc:333] T 00000000000000000000000000000000 P 07e6694ed4734493b43d97d6d2fc99c1: stopping tablet replica
I20260924 01:57:04.116480 355 master.cc:584] Master@127.0.88.254:39019 shutdown complete.
I20260924 01:57:04.118976 355 master.cc:562] Master@127.0.88.252:38105 shutting down...
I20260924 01:57:04.122393 355 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260924 01:57:04.122563 355 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260924 01:57:04.122611 355 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5c5224e53b6f41d1bb080f6209b614e5: stopping tablet replica
I20260924 01:57:04.135269 355 master.cc:584] Master@127.0.88.252:38105 shutdown complete.
[ OK ] TokenSignerITest.TskMasterLeadershipChange (3676 ms)
[ RUN ] TokenSignerITest.AuthnTokenLifecycle
I20260924 01:57:04.141448 355 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.88.254:43023,127.0.88.253:32855,127.0.88.252:36687
I20260924 01:57:04.141863 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:57:04.143749 2319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:04.143749 2318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:04.143846 2321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:04.143873 355 server_base.cc:1061] running on GCE node
I20260924 01:57:04.144379 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:57:04.144421 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:57:04.144443 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215024144443 us; error 0 us; skew 500 ppm
I20260924 01:57:04.145380 355 webserver.cc:533] Webserver started at http://127.0.88.254:32933/ using document root <none> and password file <none>
I20260924 01:57:04.145733 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:57:04.145787 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:57:04.145895 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:57:04.146312 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-0-root/instance:
uuid: "11204633659046068d2a30258c6d6901"
format_stamp: "Formatted at 2026-09-24 01:57:04 on dist-test-slave-pgxx"
I20260924 01:57:04.148005 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 01:57:04.148967 2326 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:04.149210 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:57:04.149307 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-0-root
uuid: "11204633659046068d2a30258c6d6901"
format_stamp: "Formatted at 2026-09-24 01:57:04 on dist-test-slave-pgxx"
I20260924 01:57:04.149474 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:57:04.170606 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:57:04.171064 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:57:04.175969 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.254:43023
I20260924 01:57:04.177552 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260924 01:57:04.180096 2378 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.254:43023 every 8 connection(s)
I20260924 01:57:04.180742 2379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
W20260924 01:57:04.181507 2384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:04.181514 2382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:04.181751 2381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:04.181623 355 server_base.cc:1061] running on GCE node
I20260924 01:57:04.182062 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:57:04.182129 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:57:04.182163 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215024182162 us; error 0 us; skew 500 ppm
I20260924 01:57:04.182336 2379 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:57:04.183571 355 webserver.cc:533] Webserver started at http://127.0.88.253:42013/ using document root <none> and password file <none>
I20260924 01:57:04.183723 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:57:04.183774 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:57:04.183861 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:57:04.184222 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-1-root/instance:
uuid: "3d1d7ffa3e504986b5d6890e572defe9"
format_stamp: "Formatted at 2026-09-24 01:57:04 on dist-test-slave-pgxx"
I20260924 01:57:04.186036 355 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260924 01:57:04.187145 2379 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:57:04.187497 2391 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:04.187785 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:57:04.187860 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-1-root
uuid: "3d1d7ffa3e504986b5d6890e572defe9"
format_stamp: "Formatted at 2026-09-24 01:57:04 on dist-test-slave-pgxx"
I20260924 01:57:04.187924 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260924 01:57:04.188476 2379 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.88.253:32855: Network error: Client connection negotiation failed: client connection to 127.0.88.253:32855: connect: Connection refused (error 111)
I20260924 01:57:04.207180 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:57:04.207638 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:57:04.212004 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.253:32855
I20260924 01:57:04.212080 2444 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.253:32855 every 8 connection(s)
I20260924 01:57:04.212805 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260924 01:57:04.212965 2445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 01:57:04.214504 2445 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } has no permanent_uuid. Determining permanent_uuid...
W20260924 01:57:04.214594 2448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:04.214679 2450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:04.214895 2447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:04.214952 355 server_base.cc:1061] running on GCE node
I20260924 01:57:04.215210 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:57:04.215260 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:57:04.215282 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215024215282 us; error 0 us; skew 500 ppm
I20260924 01:57:04.216154 355 webserver.cc:533] Webserver started at http://127.0.88.252:36071/ using document root <none> and password file <none>
I20260924 01:57:04.216333 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:57:04.216403 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:57:04.216476 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:57:04.216873 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-2-root/instance:
uuid: "d8a1f0a04aeb47c497988ae1653e7b17"
format_stamp: "Formatted at 2026-09-24 01:57:04 on dist-test-slave-pgxx"
I20260924 01:57:04.218575 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260924 01:57:04.219125 2445 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:57:04.220077 2456 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:04.220357 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:57:04.220474 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-2-root
uuid: "d8a1f0a04aeb47c497988ae1653e7b17"
format_stamp: "Formatted at 2026-09-24 01:57:04 on dist-test-slave-pgxx"
I20260924 01:57:04.220553 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:57:04.223830 2445 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } has no permanent_uuid. Determining permanent_uuid...
W20260924 01:57:04.225195 2445 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.88.252:36687: Network error: Client connection negotiation failed: client connection to 127.0.88.252:36687: connect: Connection refused (error 111)
I20260924 01:57:04.231941 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:57:04.232347 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:57:04.233639 2379 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } attempt: 1
I20260924 01:57:04.237396 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.252:36687
I20260924 01:57:04.237542 2510 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.252:36687 every 8 connection(s)
I20260924 01:57:04.237978 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260924 01:57:04.238430 2379 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:57:04.238459 2511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 01:57:04.239723 2511 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:57:04.243345 2445 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } attempt: 1
I20260924 01:57:04.244303 2511 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:57:04.244652 2379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901: Bootstrap starting.
I20260924 01:57:04.245998 2379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901: Neither blocks nor log segments found. Creating new log.
I20260924 01:57:04.247231 2379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901: No bootstrap required, opened a new log
I20260924 01:57:04.247833 2379 raft_consensus.cc:359] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } }
I20260924 01:57:04.247964 2379 raft_consensus.cc:385] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 01:57:04.248011 2379 raft_consensus.cc:740] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11204633659046068d2a30258c6d6901, State: Initialized, Role: FOLLOWER
I20260924 01:57:04.248142 2379 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } }
I20260924 01:57:04.248389 2511 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } has no permanent_uuid. Determining permanent_uuid...
I20260924 01:57:04.248718 2379 sys_catalog.cc:565] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 01:57:04.249284 2516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } } }
I20260924 01:57:04.249387 2516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:57:04.250145 2445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9: Bootstrap starting.
I20260924 01:57:04.250726 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260924 01:57:04.251181 2445 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9: Neither blocks nor log segments found. Creating new log.
W20260924 01:57:04.251256 2527 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 01:57:04.251348 2527 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 01:57:04.252278 2445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9: No bootstrap required, opened a new log
I20260924 01:57:04.252651 2445 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } }
I20260924 01:57:04.252749 2445 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 01:57:04.252810 2445 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1d7ffa3e504986b5d6890e572defe9, State: Initialized, Role: FOLLOWER
I20260924 01:57:04.252954 2445 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } }
I20260924 01:57:04.253268 2529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } } }
I20260924 01:57:04.253391 2529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:57:04.253422 2445 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 01:57:04.255578 355 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
W20260924 01:57:04.256166 2540 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 01:57:04.256238 2540 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 01:57:04.256394 2511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17: Bootstrap starting.
I20260924 01:57:04.257193 2511 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17: Neither blocks nor log segments found. Creating new log.
I20260924 01:57:04.258354 2511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17: No bootstrap required, opened a new log
I20260924 01:57:04.258729 2511 raft_consensus.cc:359] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } }
I20260924 01:57:04.258812 2511 raft_consensus.cc:385] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 01:57:04.258836 2511 raft_consensus.cc:740] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8a1f0a04aeb47c497988ae1653e7b17, State: Initialized, Role: FOLLOWER
I20260924 01:57:04.258931 2511 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } }
I20260924 01:57:04.259284 2542 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } } }
I20260924 01:57:04.259378 2542 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:57:04.259394 2511 sys_catalog.cc:565] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 01:57:04.261544 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:57:04.261699 2553 catalog_manager.cc:1607] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 01:57:04.261755 2553 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260924 01:57:04.263518 2554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:04.263861 2555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:04.264043 2557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:04.264262 355 server_base.cc:1061] running on GCE node
I20260924 01:57:04.264443 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:57:04.264509 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:57:04.264544 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215024264543 us; error 0 us; skew 500 ppm
I20260924 01:57:04.265549 355 webserver.cc:533] Webserver started at http://127.0.88.193:46881/ using document root <none> and password file <none>
I20260924 01:57:04.265717 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:57:04.265786 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:57:04.265864 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:57:04.266264 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-0-root/instance:
uuid: "0f42f6de892c4d268b8393980913d57e"
format_stamp: "Formatted at 2026-09-24 01:57:04 on dist-test-slave-pgxx"
I20260924 01:57:04.267756 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260924 01:57:04.268698 2562 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:04.268960 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:57:04.269048 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-0-root
uuid: "0f42f6de892c4d268b8393980913d57e"
format_stamp: "Formatted at 2026-09-24 01:57:04 on dist-test-slave-pgxx"
I20260924 01:57:04.269138 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:57:04.278997 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:57:04.279438 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:57:04.279757 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:57:04.280247 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:57:04.280311 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:04.280373 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:57:04.280431 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:04.285182 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.193:45217
I20260924 01:57:04.285215 2625 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.193:45217 every 8 connection(s)
I20260924 01:57:04.286278 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:57:04.288991 2634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:04.289095 2636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:04.289167 2633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:04.291514 2626 heartbeater.cc:344] Connected to a master server at 127.0.88.252:36687
I20260924 01:57:04.291630 2626 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:04.291523 355 server_base.cc:1061] running on GCE node
I20260924 01:57:04.291894 2626 heartbeater.cc:507] Master 127.0.88.252:36687 requested a full tablet report, sending...
I20260924 01:57:04.291956 2627 heartbeater.cc:344] Connected to a master server at 127.0.88.254:43023
I20260924 01:57:04.291931 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260924 01:57:04.291931 2628 heartbeater.cc:344] Connected to a master server at 127.0.88.253:32855
W20260924 01:57:04.292075 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:57:04.292105 2628 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:04.292106 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215024292105 us; error 0 us; skew 500 ppm
I20260924 01:57:04.292309 2628 heartbeater.cc:507] Master 127.0.88.253:32855 requested a full tablet report, sending...
I20260924 01:57:04.292032 2627 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:04.292658 2627 heartbeater.cc:507] Master 127.0.88.254:43023 requested a full tablet report, sending...
I20260924 01:57:04.292695 2475 ts_manager.cc:194] Registered new tserver with Master: 0f42f6de892c4d268b8393980913d57e (127.0.88.193:45217)
I20260924 01:57:04.292982 2409 ts_manager.cc:194] Registered new tserver with Master: 0f42f6de892c4d268b8393980913d57e (127.0.88.193:45217)
I20260924 01:57:04.293231 355 webserver.cc:533] Webserver started at http://127.0.88.194:38953/ using document root <none> and password file <none>
I20260924 01:57:04.293273 2343 ts_manager.cc:194] Registered new tserver with Master: 0f42f6de892c4d268b8393980913d57e (127.0.88.193:45217)
I20260924 01:57:04.293391 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:57:04.293447 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:57:04.293615 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:57:04.293992 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-1-root/instance:
uuid: "4932d1724bd7414988a57dc79c188470"
format_stamp: "Formatted at 2026-09-24 01:57:04 on dist-test-slave-pgxx"
I20260924 01:57:04.295562 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 01:57:04.296504 2641 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:04.296793 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:57:04.296855 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-1-root
uuid: "4932d1724bd7414988a57dc79c188470"
format_stamp: "Formatted at 2026-09-24 01:57:04 on dist-test-slave-pgxx"
I20260924 01:57:04.296907 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:57:04.302529 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:57:04.302875 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:57:04.303112 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:57:04.303543 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:57:04.303582 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:04.303639 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:57:04.303680 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:04.308084 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.194:42135
I20260924 01:57:04.308257 2704 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.194:42135 every 8 connection(s)
I20260924 01:57:04.309137 355 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 01:57:04.311380 2713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:04.311574 2715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 01:57:04.312649 2712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 01:57:04.314042 2706 heartbeater.cc:344] Connected to a master server at 127.0.88.254:43023
I20260924 01:57:04.314143 2706 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:04.314273 355 server_base.cc:1061] running on GCE node
I20260924 01:57:04.314368 2706 heartbeater.cc:507] Master 127.0.88.254:43023 requested a full tablet report, sending...
I20260924 01:57:04.314459 355 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260924 01:57:04.314512 355 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260924 01:57:04.314545 355 hybrid_clock.cc:648] HybridClock initialized: now 1790215024314545 us; error 0 us; skew 500 ppm
I20260924 01:57:04.314996 2705 heartbeater.cc:344] Connected to a master server at 127.0.88.252:36687
I20260924 01:57:04.315092 2705 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:04.315196 2343 ts_manager.cc:194] Registered new tserver with Master: 4932d1724bd7414988a57dc79c188470 (127.0.88.194:42135)
I20260924 01:57:04.315264 2705 heartbeater.cc:507] Master 127.0.88.252:36687 requested a full tablet report, sending...
I20260924 01:57:04.315528 2707 heartbeater.cc:344] Connected to a master server at 127.0.88.253:32855
I20260924 01:57:04.315606 2707 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:04.315770 2707 heartbeater.cc:507] Master 127.0.88.253:32855 requested a full tablet report, sending...
I20260924 01:57:04.315848 2475 ts_manager.cc:194] Registered new tserver with Master: 4932d1724bd7414988a57dc79c188470 (127.0.88.194:42135)
I20260924 01:57:04.315858 355 webserver.cc:533] Webserver started at http://127.0.88.195:37027/ using document root <none> and password file <none>
I20260924 01:57:04.316102 355 fs_manager.cc:362] Metadata directory not provided
I20260924 01:57:04.316177 355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 01:57:04.316255 355 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 01:57:04.316367 2409 ts_manager.cc:194] Registered new tserver with Master: 4932d1724bd7414988a57dc79c188470 (127.0.88.194:42135)
I20260924 01:57:04.316668 355 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-2-root/instance:
uuid: "0b7163b7c5584da99c652f04bd89f3b1"
format_stamp: "Formatted at 2026-09-24 01:57:04 on dist-test-slave-pgxx"
I20260924 01:57:04.318251 355 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 01:57:04.319300 2720 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:04.319566 355 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 01:57:04.319675 355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-2-root
uuid: "0b7163b7c5584da99c652f04bd89f3b1"
format_stamp: "Formatted at 2026-09-24 01:57:04 on dist-test-slave-pgxx"
I20260924 01:57:04.319759 355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIKcHHE/test-tmp/token_signer-itest.0.TokenSignerITest.AuthnTokenLifecycle.1790215017804648-355-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 01:57:04.336156 355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 01:57:04.336766 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 01:57:04.337177 355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 01:57:04.337836 355 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 01:57:04.337898 355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:04.337960 355 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 01:57:04.337992 355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 01:57:04.342672 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.88.195:36031
I20260924 01:57:04.342715 2783 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.88.195:36031 every 8 connection(s)
I20260924 01:57:04.348162 2786 heartbeater.cc:344] Connected to a master server at 127.0.88.253:32855
I20260924 01:57:04.348287 2786 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:04.348522 2786 heartbeater.cc:507] Master 127.0.88.253:32855 requested a full tablet report, sending...
I20260924 01:57:04.348639 2784 heartbeater.cc:344] Connected to a master server at 127.0.88.252:36687
I20260924 01:57:04.348695 2784 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:04.348867 2784 heartbeater.cc:507] Master 127.0.88.252:36687 requested a full tablet report, sending...
I20260924 01:57:04.349220 2409 ts_manager.cc:194] Registered new tserver with Master: 0b7163b7c5584da99c652f04bd89f3b1 (127.0.88.195:36031)
I20260924 01:57:04.349225 2785 heartbeater.cc:344] Connected to a master server at 127.0.88.254:43023
I20260924 01:57:04.349339 2785 heartbeater.cc:461] Registering TS with master...
I20260924 01:57:04.349485 2475 ts_manager.cc:194] Registered new tserver with Master: 0b7163b7c5584da99c652f04bd89f3b1 (127.0.88.195:36031)
I20260924 01:57:04.349540 2785 heartbeater.cc:507] Master 127.0.88.254:43023 requested a full tablet report, sending...
I20260924 01:57:04.350136 2343 ts_manager.cc:194] Registered new tserver with Master: 0b7163b7c5584da99c652f04bd89f3b1 (127.0.88.195:36031)
I20260924 01:57:04.350653 355 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00739547s
I20260924 01:57:04.432485 2529 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 01:57:04.432662 2529 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } }
I20260924 01:57:04.433207 2529 leader_election.cc:290] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11204633659046068d2a30258c6d6901 (127.0.88.254:43023), d8a1f0a04aeb47c497988ae1653e7b17 (127.0.88.252:36687)
I20260924 01:57:04.433741 2353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d1d7ffa3e504986b5d6890e572defe9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11204633659046068d2a30258c6d6901" is_pre_election: true
I20260924 01:57:04.433766 2485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d1d7ffa3e504986b5d6890e572defe9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" is_pre_election: true
I20260924 01:57:04.433910 2353 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1d7ffa3e504986b5d6890e572defe9 in term 0.
I20260924 01:57:04.433938 2485 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1d7ffa3e504986b5d6890e572defe9 in term 0.
I20260924 01:57:04.434294 2396 leader_election.cc:304] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1d7ffa3e504986b5d6890e572defe9, d8a1f0a04aeb47c497988ae1653e7b17; no voters:
I20260924 01:57:04.434484 2529 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 01:57:04.434554 2529 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 01:57:04.434610 2529 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [term 0 FOLLOWER]: Advancing to term 1
I20260924 01:57:04.435429 2529 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } }
I20260924 01:57:04.435773 2529 leader_election.cc:290] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [CANDIDATE]: Term 1 election: Requested vote from peers 11204633659046068d2a30258c6d6901 (127.0.88.254:43023), d8a1f0a04aeb47c497988ae1653e7b17 (127.0.88.252:36687)
I20260924 01:57:04.436030 2353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d1d7ffa3e504986b5d6890e572defe9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11204633659046068d2a30258c6d6901"
I20260924 01:57:04.436141 2353 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [term 0 FOLLOWER]: Advancing to term 1
I20260924 01:57:04.436599 2485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d1d7ffa3e504986b5d6890e572defe9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8a1f0a04aeb47c497988ae1653e7b17"
I20260924 01:57:04.436688 2485 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260924 01:57:04.437197 2353 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1d7ffa3e504986b5d6890e572defe9 in term 1.
I20260924 01:57:04.437621 2485 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1d7ffa3e504986b5d6890e572defe9 in term 1.
I20260924 01:57:04.437688 2393 leader_election.cc:304] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11204633659046068d2a30258c6d6901, 3d1d7ffa3e504986b5d6890e572defe9; no voters:
I20260924 01:57:04.437865 2529 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 01:57:04.438148 2529 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [term 1 LEADER]: Becoming Leader. State: Replica: 3d1d7ffa3e504986b5d6890e572defe9, State: Running, Role: LEADER
I20260924 01:57:04.438314 2529 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } }
I20260924 01:57:04.439038 2792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d1d7ffa3e504986b5d6890e572defe9. Latest consensus state: current_term: 1 leader_uuid: "3d1d7ffa3e504986b5d6890e572defe9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } } }
I20260924 01:57:04.439157 2792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [sys.catalog]: This master's current role is: LEADER
I20260924 01:57:04.439445 2794 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260924 01:57:04.440282 2794 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260924 01:57:04.442116 2485 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [term 1 FOLLOWER]: Refusing update from remote peer 3d1d7ffa3e504986b5d6890e572defe9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 01:57:04.442097 2353 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [term 1 FOLLOWER]: Refusing update from remote peer 3d1d7ffa3e504986b5d6890e572defe9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 01:57:04.442538 2792 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 01:57:04.442672 2529 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 01:57:04.443864 2516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d1d7ffa3e504986b5d6890e572defe9. Latest consensus state: current_term: 1 leader_uuid: "3d1d7ffa3e504986b5d6890e572defe9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } } }
I20260924 01:57:04.443982 2516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:57:04.443987 2542 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d1d7ffa3e504986b5d6890e572defe9. Latest consensus state: current_term: 1 leader_uuid: "3d1d7ffa3e504986b5d6890e572defe9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } } }
I20260924 01:57:04.444094 2542 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:57:04.445261 2529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3d1d7ffa3e504986b5d6890e572defe9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } } }
I20260924 01:57:04.445362 2529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [sys.catalog]: This master's current role is: LEADER
I20260924 01:57:04.445485 2529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3d1d7ffa3e504986b5d6890e572defe9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } } }
I20260924 01:57:04.445555 2529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9 [sys.catalog]: This master's current role is: LEADER
I20260924 01:57:04.445564 2516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3d1d7ffa3e504986b5d6890e572defe9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } } }
I20260924 01:57:04.445703 2516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:57:04.445786 2542 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3d1d7ffa3e504986b5d6890e572defe9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11204633659046068d2a30258c6d6901" member_type: VOTER last_known_addr { host: "127.0.88.254" port: 43023 } } peers { permanent_uuid: "3d1d7ffa3e504986b5d6890e572defe9" member_type: VOTER last_known_addr { host: "127.0.88.253" port: 32855 } } peers { permanent_uuid: "d8a1f0a04aeb47c497988ae1653e7b17" member_type: VOTER last_known_addr { host: "127.0.88.252" port: 36687 } } }
I20260924 01:57:04.445883 2542 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 01:57:04.446061 2794 catalog_manager.cc:1396] Generated new cluster ID: 6858bb5d13dd4d579eea4967c43d9532
I20260924 01:57:04.446111 2794 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260924 01:57:04.460772 2794 catalog_manager.cc:1419] Generated new certificate authority record
I20260924 01:57:04.461563 2794 catalog_manager.cc:1553] Loading token signing keys...
I20260924 01:57:04.467283 2794 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9: Generated new TSK 0
I20260924 01:57:04.467489 2794 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260924 01:57:05.252259 2527 catalog_manager.cc:1308] Loaded cluster ID: 6858bb5d13dd4d579eea4967c43d9532
I20260924 01:57:05.252349 2527 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901: loading cluster ID for follower catalog manager: success
I20260924 01:57:05.253660 2527 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901: acquiring CA information for follower catalog manager: success
I20260924 01:57:05.254283 2527 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 01:57:05.262566 2553 catalog_manager.cc:1308] Loaded cluster ID: 6858bb5d13dd4d579eea4967c43d9532
I20260924 01:57:05.262646 2553 catalog_manager.cc:1601] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17: loading cluster ID for follower catalog manager: success
I20260924 01:57:05.263796 2553 catalog_manager.cc:1623] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17: acquiring CA information for follower catalog manager: success
I20260924 01:57:05.264380 2553 catalog_manager.cc:1651] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 01:57:05.295599 2409 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51998
I20260924 01:57:05.318060 2409 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52012
I20260924 01:57:05.351644 2409 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52020
I20260924 01:57:06.296708 2628 heartbeater.cc:499] Master 127.0.88.253:32855 was elected leader, sending a full tablet report...
I20260924 01:57:06.318902 2707 heartbeater.cc:499] Master 127.0.88.253:32855 was elected leader, sending a full tablet report...
I20260924 01:57:06.352519 2786 heartbeater.cc:499] Master 127.0.88.253:32855 was elected leader, sending a full tablet report...
I20260924 01:57:15.257966 2527 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 01:57:15.267987 2553 catalog_manager.cc:1651] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 01:57:24.270123 2540 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9: Generated new TSK 1
I20260924 01:57:25.261631 2527 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 1
I20260924 01:57:25.271768 2553 catalog_manager.cc:1651] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 1
I20260924 01:57:35.265661 2527 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 1
I20260924 01:57:35.275410 2553 catalog_manager.cc:1651] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 1
I20260924 01:57:45.270013 2527 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 1
I20260924 01:57:45.279479 2553 catalog_manager.cc:1651] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 1
I20260924 01:57:45.284636 2540 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 3d1d7ffa3e504986b5d6890e572defe9: Generated new TSK 2
I20260924 01:57:55.274025 2527 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 2
I20260924 01:57:55.283615 2553 catalog_manager.cc:1651] T 00000000000000000000000000000000 P d8a1f0a04aeb47c497988ae1653e7b17: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 2
I20260924 01:58:04.123210 355 tablet_server.cc:179] TabletServer@127.0.88.193:0 shutting down...
I20260924 01:58:04.127075 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:58:04.139971 355 tablet_server.cc:196] TabletServer@127.0.88.193:0 shutdown complete.
I20260924 01:58:04.142138 355 tablet_server.cc:179] TabletServer@127.0.88.194:0 shutting down...
I20260924 01:58:04.147290 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:58:04.161206 355 tablet_server.cc:196] TabletServer@127.0.88.194:0 shutdown complete.
I20260924 01:58:04.163245 355 tablet_server.cc:179] TabletServer@127.0.88.195:0 shutting down...
I20260924 01:58:04.168130 355 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260924 01:58:04.181519 355 tablet_server.cc:196] TabletServer@127.0.88.195:0 shutdown complete.
I20260924 01:58:04.183496 355 master.cc:562] Master@127.0.88.254:43023 shutting down...
I20260924 01:58:04.189721 355 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 01:58:04.189922 355 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 01:58:04.190018 355 tablet_replica.cc:333] T 00000000000000000000000000000000 P 11204633659046068d2a30258c6d6901: stopping tablet replica
F20260924 01:58:04.192380 2374 diagnostic_socket.cc:264] Check failed: fd_ >= 0 (-1 vs. 0)
*** Check failure stack trace: ***
*** Aborted at 1790215084 (unix time) try "date -d @1790215084" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800000163) received by PID 355 (TID 0x7ffb2f3ab700) from PID 355; stack trace: ***
@ 0x7ffb56ba3980 (unknown) at ??:0
@ 0x7ffb54a94e87 gsignal at ??:0
@ 0x7ffb54a967f1 abort at ??:0
@ 0x7ffb55961d5d google::LogMessage::Fail() at ??:0
@ 0x7ffb55965b23 google::LogMessage::SendToLog() at ??:0
@ 0x7ffb5596175c google::LogMessage::Flush() at ??:0
@ 0x7ffb55962ee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ffb567bebc3 kudu::DiagnosticSocket::ReceiveResponse() at ??:0
@ 0x7ffb567bdcf7 kudu::DiagnosticSocket::Query() at ??:0
@ 0x7ffb53517711 kudu::rpc::AcceptorPool::GetPendingConnectionsNum() at ??:0
@ 0x7ffb5355180d kudu::rpc::Messenger::GetPendingConnectionsNum() at ??:0
@ 0x7ffb53552075 _ZZN4kudu3rpc9Messenger15AddAcceptorPoolERKNS_8SockaddrEPSt10shared_ptrINS0_12AcceptorPoolEEENKUlvE_clEv at ??:0
@ 0x7ffb535551dc _ZNSt17_Function_handlerIFivEZN4kudu3rpc9Messenger15AddAcceptorPoolERKNS1_8SockaddrEPSt10shared_ptrINS2_12AcceptorPoolEEEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7ffb576cb82c std::function<>::operator()() at ??:0
@ 0x7ffb576cb5af kudu::FunctionGauge<>::value() at ??:0
@ 0x7ffb576cb30b kudu::FunctionGauge<>::WriteValue() at ??:0
@ 0x7ffb566d5ca7 kudu::Gauge::WriteAsJson() at ??:0
@ 0x7ffb566e0375 kudu::WriteMetricsToJson<>() at ??:0
@ 0x7ffb566d1bf8 kudu::MetricEntity::WriteAsJson() at ??:0
@ 0x7ffb566d361d kudu::MetricRegistry::WriteAsJson() at ??:0
@ 0x7ffb537c2773 kudu::server::DiagnosticsLog::LogMetrics() at ??:0
@ 0x7ffb537c183d kudu::server::DiagnosticsLog::RunThread() at ??:0
@ 0x7ffb537c0dcf _ZZN4kudu6server14DiagnosticsLog5StartEvENKUlvE_clEv at ??:0
@ 0x7ffb537c2cb4 _ZNSt17_Function_handlerIFvvEZN4kudu6server14DiagnosticsLog5StartEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x55ffd8d163bc std::function<>::operator()() at ??:0
@ 0x7ffb56752c6a kudu::Thread::SuperviseThread() at ??:0
@ 0x7ffb56b986db start_thread at ??:0
@ 0x7ffb54b7761f clone at ??:0