Note: This is test shard 6 of 8.
[==========] Running 9 tests from 5 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from AdminCliTest
[ RUN ] AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20251029 09:09:56.746317 5047 test_util.cc:276] Using random seed: 2131403824
I20251029 09:09:56.751657 5047 ts_itest-base.cc:115] Starting cluster with:
I20251029 09:09:56.751714 5047 ts_itest-base.cc:116] --------------
I20251029 09:09:56.751726 5047 ts_itest-base.cc:117] 4 tablet servers
I20251029 09:09:56.751739 5047 ts_itest-base.cc:118] 3 replicas per TS
I20251029 09:09:56.751750 5047 ts_itest-base.cc:119] --------------
2025-10-29T09:09:56Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-10-29T09:09:56Z Disabled control of system clock
I20251029 09:09:56.760532 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:37015
--webserver_interface=127.4.237.254
--webserver_port=0
--builtin_ntp_servers=127.4.237.212:36871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.237.254:37015 with env {}
W20251029 09:09:56.840886 5059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:09:56.841084 5059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:09:56.841104 5059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:09:56.842543 5059 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251029 09:09:56.842592 5059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:09:56.842607 5059 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251029 09:09:56.842619 5059 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251029 09:09:56.844121 5059 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:36871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.237.254:37015
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:37015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.4.237.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.5059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:09:56.844352 5059 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:09:56.844628 5059 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:09:56.847371 5067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:09:56.847371 5064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:09:56.847366 5065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:09:56.847770 5059 server_base.cc:1047] running on GCE node
I20251029 09:09:56.848014 5059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:09:56.848286 5059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:09:56.849423 5059 hybrid_clock.cc:648] HybridClock initialized: now 1761728996849404 us; error 36 us; skew 500 ppm
I20251029 09:09:56.850922 5059 webserver.cc:492] Webserver started at http://127.4.237.254:37611/ using document root <none> and password file <none>
I20251029 09:09:56.851141 5059 fs_manager.cc:362] Metadata directory not provided
I20251029 09:09:56.851186 5059 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:09:56.851308 5059 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:09:56.852206 5059 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "46473c25ec53419cb336a062e90273d0"
format_stamp: "Formatted at 2025-10-29 09:09:56 on dist-test-slave-z9gc"
I20251029 09:09:56.852537 5059 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "46473c25ec53419cb336a062e90273d0"
format_stamp: "Formatted at 2025-10-29 09:09:56 on dist-test-slave-z9gc"
I20251029 09:09:56.853796 5059 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20251029 09:09:56.854626 5073 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:09:56.854804 5059 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:09:56.854880 5059 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
uuid: "46473c25ec53419cb336a062e90273d0"
format_stamp: "Formatted at 2025-10-29 09:09:56 on dist-test-slave-z9gc"
I20251029 09:09:56.854948 5059 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:09:56.883025 5059 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:09:56.883345 5059 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:09:56.883467 5059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:09:56.887432 5059 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.254:37015
I20251029 09:09:56.887463 5126 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.254:37015 every 8 connection(s)
I20251029 09:09:56.887916 5059 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251029 09:09:56.888592 5127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:09:56.891175 5127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0: Bootstrap starting.
I20251029 09:09:56.891839 5127 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0: Neither blocks nor log segments found. Creating new log.
I20251029 09:09:56.892122 5127 log.cc:826] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0: Log is configured to *not* fsync() on all Append() calls
I20251029 09:09:56.892851 5127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0: No bootstrap required, opened a new log
I20251029 09:09:56.894153 5127 raft_consensus.cc:359] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46473c25ec53419cb336a062e90273d0" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37015 } }
I20251029 09:09:56.894304 5127 raft_consensus.cc:385] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:09:56.894325 5127 raft_consensus.cc:740] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46473c25ec53419cb336a062e90273d0, State: Initialized, Role: FOLLOWER
I20251029 09:09:56.894510 5127 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46473c25ec53419cb336a062e90273d0" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37015 } }
I20251029 09:09:56.894598 5127 raft_consensus.cc:399] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:09:56.894626 5127 raft_consensus.cc:493] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:09:56.894680 5127 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:09:56.895278 5127 raft_consensus.cc:515] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46473c25ec53419cb336a062e90273d0" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37015 } }
I20251029 09:09:56.895380 5127 leader_election.cc:304] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46473c25ec53419cb336a062e90273d0; no voters:
I20251029 09:09:56.895483 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 5059
I20251029 09:09:56.895570 5127 leader_election.cc:290] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251029 09:09:56.895606 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251029 09:09:56.895641 5130 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:09:56.895845 5130 raft_consensus.cc:697] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 1 LEADER]: Becoming Leader. State: Replica: 46473c25ec53419cb336a062e90273d0, State: Running, Role: LEADER
I20251029 09:09:56.895920 5127 sys_catalog.cc:565] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [sys.catalog]: configured and running, proceeding with master startup.
I20251029 09:09:56.895991 5130 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46473c25ec53419cb336a062e90273d0" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37015 } }
I20251029 09:09:56.896421 5130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46473c25ec53419cb336a062e90273d0. Latest consensus state: current_term: 1 leader_uuid: "46473c25ec53419cb336a062e90273d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46473c25ec53419cb336a062e90273d0" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37015 } } }
I20251029 09:09:56.896432 5131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46473c25ec53419cb336a062e90273d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46473c25ec53419cb336a062e90273d0" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37015 } } }
I20251029 09:09:56.896602 5131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [sys.catalog]: This master's current role is: LEADER
I20251029 09:09:56.896857 5130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [sys.catalog]: This master's current role is: LEADER
I20251029 09:09:56.897296 5139 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251029 09:09:56.897819 5139 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251029 09:09:56.899227 5139 catalog_manager.cc:1357] Generated new cluster ID: 267ca649ed894369b5551dde92b6c3b3
I20251029 09:09:56.899286 5139 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251029 09:09:56.909381 5139 catalog_manager.cc:1380] Generated new certificate authority record
I20251029 09:09:56.909947 5139 catalog_manager.cc:1514] Loading token signing keys...
I20251029 09:09:56.915977 5139 catalog_manager.cc:6022] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0: Generated new TSK 0
I20251029 09:09:56.916272 5139 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251029 09:09:56.924391 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.193:0
--local_ip_for_outbound_sockets=127.4.237.193
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:37015
--builtin_ntp_servers=127.4.237.212:36871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251029 09:09:57.005591 5151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:09:57.005802 5151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:09:57.005839 5151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:09:57.007434 5151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:09:57.007516 5151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.193
I20251029 09:09:57.009173 5151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:36871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:37015
--never_fsync=true
--heap_profile_path=/tmp/kudu.5151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.193
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:09:57.009444 5151 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:09:57.009711 5151 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:09:57.012503 5156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:09:57.012512 5157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:09:57.012599 5159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:09:57.012924 5151 server_base.cc:1047] running on GCE node
I20251029 09:09:57.013104 5151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:09:57.013300 5151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:09:57.014459 5151 hybrid_clock.cc:648] HybridClock initialized: now 1761728997014444 us; error 38 us; skew 500 ppm
I20251029 09:09:57.015760 5151 webserver.cc:492] Webserver started at http://127.4.237.193:39189/ using document root <none> and password file <none>
I20251029 09:09:57.015982 5151 fs_manager.cc:362] Metadata directory not provided
I20251029 09:09:57.016036 5151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:09:57.016165 5151 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:09:57.017055 5151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "efc49484a113414497eb16e7c23b3ffb"
format_stamp: "Formatted at 2025-10-29 09:09:57 on dist-test-slave-z9gc"
I20251029 09:09:57.017362 5151 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "efc49484a113414497eb16e7c23b3ffb"
format_stamp: "Formatted at 2025-10-29 09:09:57 on dist-test-slave-z9gc"
I20251029 09:09:57.018673 5151 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20251029 09:09:57.019452 5165 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:09:57.019647 5151 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:09:57.019721 5151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "efc49484a113414497eb16e7c23b3ffb"
format_stamp: "Formatted at 2025-10-29 09:09:57 on dist-test-slave-z9gc"
I20251029 09:09:57.019783 5151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:09:57.038371 5151 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:09:57.038784 5151 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:09:57.038911 5151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:09:57.039124 5151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:09:57.039451 5151 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:09:57.039487 5151 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:09:57.039531 5151 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:09:57.039561 5151 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:09:57.045419 5151 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.193:35427
I20251029 09:09:57.045486 5279 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.193:35427 every 8 connection(s)
I20251029 09:09:57.045938 5151 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251029 09:09:57.049485 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 5151
I20251029 09:09:57.049573 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251029 09:09:57.050866 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.194:0
--local_ip_for_outbound_sockets=127.4.237.194
--webserver_interface=127.4.237.194
--webserver_port=0
--tserver_master_addrs=127.4.237.254:37015
--builtin_ntp_servers=127.4.237.212:36871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251029 09:09:57.051126 5280 heartbeater.cc:344] Connected to a master server at 127.4.237.254:37015
I20251029 09:09:57.051227 5280 heartbeater.cc:461] Registering TS with master...
I20251029 09:09:57.051395 5280 heartbeater.cc:507] Master 127.4.237.254:37015 requested a full tablet report, sending...
I20251029 09:09:57.051838 5091 ts_manager.cc:194] Registered new tserver with Master: efc49484a113414497eb16e7c23b3ffb (127.4.237.193:35427)
I20251029 09:09:57.052753 5091 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.193:58465
W20251029 09:09:57.131086 5283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:09:57.131269 5283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:09:57.131290 5283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:09:57.132774 5283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:09:57.132858 5283 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.194
I20251029 09:09:57.134447 5283 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:36871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.4.237.194
--webserver_port=0
--tserver_master_addrs=127.4.237.254:37015
--never_fsync=true
--heap_profile_path=/tmp/kudu.5283
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.194
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:09:57.134850 5283 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:09:57.135242 5283 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:09:57.138290 5288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:09:57.138294 5289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:09:57.138504 5283 server_base.cc:1047] running on GCE node
W20251029 09:09:57.138355 5291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:09:57.138870 5283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:09:57.139115 5283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:09:57.140244 5283 hybrid_clock.cc:648] HybridClock initialized: now 1761728997140224 us; error 36 us; skew 500 ppm
I20251029 09:09:57.141701 5283 webserver.cc:492] Webserver started at http://127.4.237.194:45373/ using document root <none> and password file <none>
I20251029 09:09:57.141944 5283 fs_manager.cc:362] Metadata directory not provided
I20251029 09:09:57.141999 5283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:09:57.142138 5283 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:09:57.143265 5283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "c8904c821435433b8aaf14f3dd5cd606"
format_stamp: "Formatted at 2025-10-29 09:09:57 on dist-test-slave-z9gc"
I20251029 09:09:57.143656 5283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "c8904c821435433b8aaf14f3dd5cd606"
format_stamp: "Formatted at 2025-10-29 09:09:57 on dist-test-slave-z9gc"
I20251029 09:09:57.145107 5283 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251029 09:09:57.145929 5297 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:09:57.146128 5283 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251029 09:09:57.146195 5283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "c8904c821435433b8aaf14f3dd5cd606"
format_stamp: "Formatted at 2025-10-29 09:09:57 on dist-test-slave-z9gc"
I20251029 09:09:57.146278 5283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:09:57.165019 5283 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:09:57.165333 5283 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:09:57.165509 5283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:09:57.165767 5283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:09:57.166123 5283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:09:57.166164 5283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:09:57.166199 5283 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:09:57.166256 5283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:09:57.172168 5283 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.194:33325
I20251029 09:09:57.172232 5410 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.194:33325 every 8 connection(s)
I20251029 09:09:57.172552 5283 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251029 09:09:57.176203 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 5283
I20251029 09:09:57.176288 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251029 09:09:57.177065 5411 heartbeater.cc:344] Connected to a master server at 127.4.237.254:37015
I20251029 09:09:57.177167 5411 heartbeater.cc:461] Registering TS with master...
I20251029 09:09:57.177304 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.195:0
--local_ip_for_outbound_sockets=127.4.237.195
--webserver_interface=127.4.237.195
--webserver_port=0
--tserver_master_addrs=127.4.237.254:37015
--builtin_ntp_servers=127.4.237.212:36871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251029 09:09:57.177363 5411 heartbeater.cc:507] Master 127.4.237.254:37015 requested a full tablet report, sending...
I20251029 09:09:57.177736 5091 ts_manager.cc:194] Registered new tserver with Master: c8904c821435433b8aaf14f3dd5cd606 (127.4.237.194:33325)
I20251029 09:09:57.178104 5091 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.194:48961
W20251029 09:09:57.258103 5414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:09:57.258373 5414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:09:57.258424 5414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:09:57.260018 5414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:09:57.260102 5414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.195
I20251029 09:09:57.261900 5414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:36871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.4.237.195
--webserver_port=0
--tserver_master_addrs=127.4.237.254:37015
--never_fsync=true
--heap_profile_path=/tmp/kudu.5414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.195
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:09:57.262161 5414 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:09:57.262454 5414 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:09:57.265020 5420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:09:57.265077 5422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:09:57.265062 5419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:09:57.265276 5414 server_base.cc:1047] running on GCE node
I20251029 09:09:57.265440 5414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:09:57.265652 5414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:09:57.266812 5414 hybrid_clock.cc:648] HybridClock initialized: now 1761728997266797 us; error 30 us; skew 500 ppm
I20251029 09:09:57.268052 5414 webserver.cc:492] Webserver started at http://127.4.237.195:34861/ using document root <none> and password file <none>
I20251029 09:09:57.268256 5414 fs_manager.cc:362] Metadata directory not provided
I20251029 09:09:57.268302 5414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:09:57.268427 5414 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:09:57.269330 5414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "1a73658c1c494fe4bb19c6586731756a"
format_stamp: "Formatted at 2025-10-29 09:09:57 on dist-test-slave-z9gc"
I20251029 09:09:57.269676 5414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "1a73658c1c494fe4bb19c6586731756a"
format_stamp: "Formatted at 2025-10-29 09:09:57 on dist-test-slave-z9gc"
I20251029 09:09:57.271003 5414 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20251029 09:09:57.271799 5428 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:09:57.271977 5414 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251029 09:09:57.272056 5414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "1a73658c1c494fe4bb19c6586731756a"
format_stamp: "Formatted at 2025-10-29 09:09:57 on dist-test-slave-z9gc"
I20251029 09:09:57.272120 5414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:09:57.287429 5414 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:09:57.287715 5414 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:09:57.287842 5414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:09:57.288070 5414 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:09:57.288399 5414 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:09:57.288434 5414 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:09:57.288472 5414 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:09:57.288496 5414 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:09:57.294299 5414 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.195:46639
I20251029 09:09:57.294350 5541 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.195:46639 every 8 connection(s)
I20251029 09:09:57.294703 5414 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251029 09:09:57.299152 5542 heartbeater.cc:344] Connected to a master server at 127.4.237.254:37015
I20251029 09:09:57.299242 5542 heartbeater.cc:461] Registering TS with master...
I20251029 09:09:57.299427 5542 heartbeater.cc:507] Master 127.4.237.254:37015 requested a full tablet report, sending...
I20251029 09:09:57.299798 5091 ts_manager.cc:194] Registered new tserver with Master: 1a73658c1c494fe4bb19c6586731756a (127.4.237.195:46639)
I20251029 09:09:57.300154 5091 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.195:49959
I20251029 09:09:57.302042 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 5414
I20251029 09:09:57.302114 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251029 09:09:57.303179 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.196:0
--local_ip_for_outbound_sockets=127.4.237.196
--webserver_interface=127.4.237.196
--webserver_port=0
--tserver_master_addrs=127.4.237.254:37015
--builtin_ntp_servers=127.4.237.212:36871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251029 09:09:57.381901 5545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:09:57.382130 5545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:09:57.382160 5545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:09:57.383599 5545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:09:57.383666 5545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.196
I20251029 09:09:57.385280 5545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:36871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.4.237.196
--webserver_port=0
--tserver_master_addrs=127.4.237.254:37015
--never_fsync=true
--heap_profile_path=/tmp/kudu.5545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.196
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:09:57.385545 5545 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:09:57.385797 5545 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:09:57.388423 5550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:09:57.388446 5553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:09:57.388679 5545 server_base.cc:1047] running on GCE node
W20251029 09:09:57.388444 5551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:09:57.388950 5545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:09:57.389168 5545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:09:57.390296 5545 hybrid_clock.cc:648] HybridClock initialized: now 1761728997390285 us; error 25 us; skew 500 ppm
I20251029 09:09:57.391476 5545 webserver.cc:492] Webserver started at http://127.4.237.196:41833/ using document root <none> and password file <none>
I20251029 09:09:57.391681 5545 fs_manager.cc:362] Metadata directory not provided
I20251029 09:09:57.391731 5545 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:09:57.391858 5545 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:09:57.392776 5545 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "d892e53e79f742d9acdff11cdcba8cf9"
format_stamp: "Formatted at 2025-10-29 09:09:57 on dist-test-slave-z9gc"
I20251029 09:09:57.393095 5545 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "d892e53e79f742d9acdff11cdcba8cf9"
format_stamp: "Formatted at 2025-10-29 09:09:57 on dist-test-slave-z9gc"
I20251029 09:09:57.394249 5545 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20251029 09:09:57.395087 5559 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:09:57.395257 5545 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251029 09:09:57.395331 5545 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "d892e53e79f742d9acdff11cdcba8cf9"
format_stamp: "Formatted at 2025-10-29 09:09:57 on dist-test-slave-z9gc"
I20251029 09:09:57.395394 5545 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:09:57.405334 5545 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:09:57.405591 5545 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:09:57.405702 5545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:09:57.405920 5545 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:09:57.406214 5545 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:09:57.406250 5545 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:09:57.406283 5545 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:09:57.406315 5545 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:09:57.412025 5545 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.196:41731
I20251029 09:09:57.412093 5672 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.196:41731 every 8 connection(s)
I20251029 09:09:57.412391 5545 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20251029 09:09:57.417029 5673 heartbeater.cc:344] Connected to a master server at 127.4.237.254:37015
I20251029 09:09:57.417117 5673 heartbeater.cc:461] Registering TS with master...
I20251029 09:09:57.417280 5673 heartbeater.cc:507] Master 127.4.237.254:37015 requested a full tablet report, sending...
I20251029 09:09:57.417382 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 5545
I20251029 09:09:57.417467 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20251029 09:09:57.417646 5091 ts_manager.cc:194] Registered new tserver with Master: d892e53e79f742d9acdff11cdcba8cf9 (127.4.237.196:41731)
I20251029 09:09:57.418097 5091 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.196:43451
I20251029 09:09:57.418641 5047 external_mini_cluster.cc:949] 4 TS(s) registered with all masters
I20251029 09:09:57.425392 5091 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47514:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20251029 09:09:57.433787 5214 tablet_service.cc:1505] Processing CreateTablet for tablet 4145d472d6854b09af953d59a6cdccbe (DEFAULT_TABLE table=TestTable [id=218bd96136a54091af6abdfbdd98bee6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:09:57.433766 5476 tablet_service.cc:1505] Processing CreateTablet for tablet 4145d472d6854b09af953d59a6cdccbe (DEFAULT_TABLE table=TestTable [id=218bd96136a54091af6abdfbdd98bee6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:09:57.434141 5476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4145d472d6854b09af953d59a6cdccbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:09:57.434141 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4145d472d6854b09af953d59a6cdccbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:09:57.434779 5607 tablet_service.cc:1505] Processing CreateTablet for tablet 4145d472d6854b09af953d59a6cdccbe (DEFAULT_TABLE table=TestTable [id=218bd96136a54091af6abdfbdd98bee6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:09:57.435084 5607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4145d472d6854b09af953d59a6cdccbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:09:57.436988 5690 tablet_bootstrap.cc:492] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb: Bootstrap starting.
I20251029 09:09:57.437239 5691 tablet_bootstrap.cc:492] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a: Bootstrap starting.
I20251029 09:09:57.437274 5692 tablet_bootstrap.cc:492] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9: Bootstrap starting.
I20251029 09:09:57.437912 5691 tablet_bootstrap.cc:654] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a: Neither blocks nor log segments found. Creating new log.
I20251029 09:09:57.437912 5692 tablet_bootstrap.cc:654] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9: Neither blocks nor log segments found. Creating new log.
I20251029 09:09:57.438211 5691 log.cc:826] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a: Log is configured to *not* fsync() on all Append() calls
I20251029 09:09:57.438212 5692 log.cc:826] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9: Log is configured to *not* fsync() on all Append() calls
I20251029 09:09:57.438954 5692 tablet_bootstrap.cc:492] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9: No bootstrap required, opened a new log
I20251029 09:09:57.439046 5692 ts_tablet_manager.cc:1403] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251029 09:09:57.439064 5690 tablet_bootstrap.cc:654] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb: Neither blocks nor log segments found. Creating new log.
I20251029 09:09:57.439160 5691 tablet_bootstrap.cc:492] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a: No bootstrap required, opened a new log
I20251029 09:09:57.439239 5691 ts_tablet_manager.cc:1403] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251029 09:09:57.439337 5690 log.cc:826] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb: Log is configured to *not* fsync() on all Append() calls
I20251029 09:09:57.439890 5690 tablet_bootstrap.cc:492] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb: No bootstrap required, opened a new log
I20251029 09:09:57.439951 5690 ts_tablet_manager.cc:1403] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251029 09:09:57.440728 5692 raft_consensus.cc:359] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc49484a113414497eb16e7c23b3ffb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35427 } } peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } }
I20251029 09:09:57.440728 5691 raft_consensus.cc:359] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc49484a113414497eb16e7c23b3ffb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35427 } } peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } }
I20251029 09:09:57.440887 5691 raft_consensus.cc:385] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:09:57.440941 5691 raft_consensus.cc:740] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a73658c1c494fe4bb19c6586731756a, State: Initialized, Role: FOLLOWER
I20251029 09:09:57.441032 5692 raft_consensus.cc:385] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:09:57.441100 5692 raft_consensus.cc:740] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d892e53e79f742d9acdff11cdcba8cf9, State: Initialized, Role: FOLLOWER
I20251029 09:09:57.441059 5691 consensus_queue.cc:260] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc49484a113414497eb16e7c23b3ffb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35427 } } peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } }
I20251029 09:09:57.441222 5692 consensus_queue.cc:260] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc49484a113414497eb16e7c23b3ffb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35427 } } peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } }
I20251029 09:09:57.441325 5691 ts_tablet_manager.cc:1434] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251029 09:09:57.441356 5542 heartbeater.cc:499] Master 127.4.237.254:37015 was elected leader, sending a full tablet report...
I20251029 09:09:57.441406 5690 raft_consensus.cc:359] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc49484a113414497eb16e7c23b3ffb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35427 } } peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } }
I20251029 09:09:57.441519 5690 raft_consensus.cc:385] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:09:57.441556 5690 raft_consensus.cc:740] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc49484a113414497eb16e7c23b3ffb, State: Initialized, Role: FOLLOWER
I20251029 09:09:57.441555 5692 ts_tablet_manager.cc:1434] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251029 09:09:57.441581 5673 heartbeater.cc:499] Master 127.4.237.254:37015 was elected leader, sending a full tablet report...
I20251029 09:09:57.441639 5690 consensus_queue.cc:260] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc49484a113414497eb16e7c23b3ffb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35427 } } peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } }
I20251029 09:09:57.441883 5690 ts_tablet_manager.cc:1434] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251029 09:09:57.441926 5280 heartbeater.cc:499] Master 127.4.237.254:37015 was elected leader, sending a full tablet report...
W20251029 09:09:57.545253 5543 tablet.cc:2378] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251029 09:09:57.546626 5281 tablet.cc:2378] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251029 09:09:57.662897 5674 tablet.cc:2378] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251029 09:09:57.890913 5698 raft_consensus.cc:493] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251029 09:09:57.891048 5698 raft_consensus.cc:515] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc49484a113414497eb16e7c23b3ffb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35427 } } peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } }
I20251029 09:09:57.891342 5698 leader_election.cc:290] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a73658c1c494fe4bb19c6586731756a (127.4.237.195:46639), d892e53e79f742d9acdff11cdcba8cf9 (127.4.237.196:41731)
I20251029 09:09:57.894450 5496 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4145d472d6854b09af953d59a6cdccbe" candidate_uuid: "efc49484a113414497eb16e7c23b3ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a73658c1c494fe4bb19c6586731756a" is_pre_election: true
I20251029 09:09:57.894672 5496 raft_consensus.cc:2468] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc49484a113414497eb16e7c23b3ffb in term 0.
I20251029 09:09:57.894753 5627 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4145d472d6854b09af953d59a6cdccbe" candidate_uuid: "efc49484a113414497eb16e7c23b3ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d892e53e79f742d9acdff11cdcba8cf9" is_pre_election: true
I20251029 09:09:57.894932 5627 raft_consensus.cc:2468] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc49484a113414497eb16e7c23b3ffb in term 0.
I20251029 09:09:57.894915 5168 leader_election.cc:304] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a73658c1c494fe4bb19c6586731756a, efc49484a113414497eb16e7c23b3ffb; no voters:
I20251029 09:09:57.895073 5698 raft_consensus.cc:2804] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251029 09:09:57.895160 5698 raft_consensus.cc:493] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251029 09:09:57.895180 5698 raft_consensus.cc:3060] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:09:57.895924 5698 raft_consensus.cc:515] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc49484a113414497eb16e7c23b3ffb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35427 } } peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } }
I20251029 09:09:57.896082 5698 leader_election.cc:290] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [CANDIDATE]: Term 1 election: Requested vote from peers 1a73658c1c494fe4bb19c6586731756a (127.4.237.195:46639), d892e53e79f742d9acdff11cdcba8cf9 (127.4.237.196:41731)
I20251029 09:09:57.896255 5496 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4145d472d6854b09af953d59a6cdccbe" candidate_uuid: "efc49484a113414497eb16e7c23b3ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a73658c1c494fe4bb19c6586731756a"
I20251029 09:09:57.896266 5627 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4145d472d6854b09af953d59a6cdccbe" candidate_uuid: "efc49484a113414497eb16e7c23b3ffb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d892e53e79f742d9acdff11cdcba8cf9"
I20251029 09:09:57.896327 5496 raft_consensus.cc:3060] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:09:57.896340 5627 raft_consensus.cc:3060] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:09:57.897058 5496 raft_consensus.cc:2468] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc49484a113414497eb16e7c23b3ffb in term 1.
I20251029 09:09:57.897109 5627 raft_consensus.cc:2468] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc49484a113414497eb16e7c23b3ffb in term 1.
I20251029 09:09:57.897255 5168 leader_election.cc:304] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a73658c1c494fe4bb19c6586731756a, efc49484a113414497eb16e7c23b3ffb; no voters:
I20251029 09:09:57.897471 5698 raft_consensus.cc:2804] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:09:57.897717 5698 raft_consensus.cc:697] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [term 1 LEADER]: Becoming Leader. State: Replica: efc49484a113414497eb16e7c23b3ffb, State: Running, Role: LEADER
I20251029 09:09:57.897837 5698 consensus_queue.cc:237] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc49484a113414497eb16e7c23b3ffb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35427 } } peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } }
I20251029 09:09:57.898710 5091 catalog_manager.cc:5649] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb reported cstate change: term changed from 0 to 1, leader changed from <none> to efc49484a113414497eb16e7c23b3ffb (127.4.237.193). New cstate: current_term: 1 leader_uuid: "efc49484a113414497eb16e7c23b3ffb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc49484a113414497eb16e7c23b3ffb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } health_report { overall_health: UNKNOWN } } }
I20251029 09:09:57.981977 5047 external_mini_cluster.cc:949] 4 TS(s) registered with all masters
I20251029 09:09:57.982630 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver efc49484a113414497eb16e7c23b3ffb to finish bootstrapping
I20251029 09:09:57.986500 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 1a73658c1c494fe4bb19c6586731756a to finish bootstrapping
I20251029 09:09:57.989759 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver d892e53e79f742d9acdff11cdcba8cf9 to finish bootstrapping
I20251029 09:09:57.992955 5047 kudu-admin-test.cc:709] Waiting for Master to see the current replicas...
I20251029 09:09:57.993678 5047 kudu-admin-test.cc:716] Tablet locations:
tablet_locations {
tablet_id: "4145d472d6854b09af953d59a6cdccbe"
DEPRECATED_stale: false
partition {
partition_key_start: ""
partition_key_end: ""
}
interned_replicas {
ts_info_idx: 0
role: LEADER
}
interned_replicas {
ts_info_idx: 1
role: FOLLOWER
}
interned_replicas {
ts_info_idx: 2
role: FOLLOWER
}
}
ts_infos {
permanent_uuid: "efc49484a113414497eb16e7c23b3ffb"
rpc_addresses {
host: "127.4.237.193"
port: 35427
}
}
ts_infos {
permanent_uuid: "1a73658c1c494fe4bb19c6586731756a"
rpc_addresses {
host: "127.4.237.195"
port: 46639
}
}
ts_infos {
permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9"
rpc_addresses {
host: "127.4.237.196"
port: 41731
}
}
I20251029 09:09:58.178920 5411 heartbeater.cc:499] Master 127.4.237.254:37015 was elected leader, sending a full tablet report...
I20251029 09:09:58.274724 5698 consensus_queue.cc:1048] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251029 09:09:58.276876 5701 consensus_queue.cc:1048] T 4145d472d6854b09af953d59a6cdccbe P efc49484a113414497eb16e7c23b3ffb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251029 09:09:58.286055 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 5151
I20251029 09:09:58.291743 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 5059
I20251029 09:09:58.297501 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:37015
--webserver_interface=127.4.237.254
--webserver_port=37611
--builtin_ntp_servers=127.4.237.212:36871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.237.254:37015 with env {}
W20251029 09:09:58.380497 5713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:09:58.380714 5713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:09:58.380735 5713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:09:58.382356 5713 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251029 09:09:58.382448 5713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:09:58.382465 5713 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251029 09:09:58.382478 5713 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251029 09:09:58.384151 5713 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:36871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.237.254:37015
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:37015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.4.237.254
--webserver_port=37611
--never_fsync=true
--heap_profile_path=/tmp/kudu.5713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:09:58.384455 5713 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:09:58.384745 5713 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:09:58.387425 5721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:09:58.387452 5719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:09:58.387641 5713 server_base.cc:1047] running on GCE node
W20251029 09:09:58.387427 5718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:09:58.387955 5713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:09:58.388214 5713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:09:58.389381 5713 hybrid_clock.cc:648] HybridClock initialized: now 1761728998389368 us; error 42 us; skew 500 ppm
I20251029 09:09:58.390811 5713 webserver.cc:492] Webserver started at http://127.4.237.254:37611/ using document root <none> and password file <none>
I20251029 09:09:58.391022 5713 fs_manager.cc:362] Metadata directory not provided
I20251029 09:09:58.391088 5713 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:09:58.392397 5713 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:09:58.393304 5727 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:09:58.393548 5713 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:09:58.393627 5713 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
uuid: "46473c25ec53419cb336a062e90273d0"
format_stamp: "Formatted at 2025-10-29 09:09:56 on dist-test-slave-z9gc"
I20251029 09:09:58.393923 5713 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:09:58.412966 5713 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:09:58.413280 5713 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:09:58.413410 5713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:09:58.417228 5713 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.254:37015
I20251029 09:09:58.417280 5779 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.254:37015 every 8 connection(s)
I20251029 09:09:58.417626 5713 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251029 09:09:58.418856 5780 sys_catalog.cc:263] Verifying existing consensus state
I20251029 09:09:58.419569 5780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0: Bootstrap starting.
I20251029 09:09:58.422689 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 5713
I20251029 09:09:58.422829 5047 kudu-admin-test.cc:735] Forcing unsafe config change on tserver d892e53e79f742d9acdff11cdcba8cf9
I20251029 09:09:58.427757 5780 log.cc:826] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0: Log is configured to *not* fsync() on all Append() calls
I20251029 09:09:58.429562 5780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251029 09:09:58.429862 5780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0: Bootstrap complete.
I20251029 09:09:58.431970 5780 raft_consensus.cc:359] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46473c25ec53419cb336a062e90273d0" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37015 } }
I20251029 09:09:58.432181 5780 raft_consensus.cc:740] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46473c25ec53419cb336a062e90273d0, State: Initialized, Role: FOLLOWER
I20251029 09:09:58.432329 5780 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46473c25ec53419cb336a062e90273d0" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37015 } }
I20251029 09:09:58.432408 5780 raft_consensus.cc:399] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:09:58.432456 5780 raft_consensus.cc:493] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:09:58.432507 5780 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 1 FOLLOWER]: Advancing to term 2
I20251029 09:09:58.433346 5780 raft_consensus.cc:515] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46473c25ec53419cb336a062e90273d0" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37015 } }
I20251029 09:09:58.433452 5780 leader_election.cc:304] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46473c25ec53419cb336a062e90273d0; no voters:
I20251029 09:09:58.433624 5780 leader_election.cc:290] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20251029 09:09:58.433678 5784 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 2 FOLLOWER]: Leader election won for term 2
I20251029 09:09:58.433802 5784 raft_consensus.cc:697] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [term 2 LEADER]: Becoming Leader. State: Replica: 46473c25ec53419cb336a062e90273d0, State: Running, Role: LEADER
I20251029 09:09:58.433878 5780 sys_catalog.cc:565] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [sys.catalog]: configured and running, proceeding with master startup.
I20251029 09:09:58.433888 5784 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46473c25ec53419cb336a062e90273d0" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37015 } }
I20251029 09:09:58.434209 5784 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46473c25ec53419cb336a062e90273d0. Latest consensus state: current_term: 2 leader_uuid: "46473c25ec53419cb336a062e90273d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46473c25ec53419cb336a062e90273d0" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37015 } } }
I20251029 09:09:58.434278 5784 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [sys.catalog]: This master's current role is: LEADER
I20251029 09:09:58.434453 5785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "46473c25ec53419cb336a062e90273d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46473c25ec53419cb336a062e90273d0" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37015 } } }
I20251029 09:09:58.434525 5785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0 [sys.catalog]: This master's current role is: LEADER
I20251029 09:09:58.434533 5788 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251029 09:09:58.435322 5788 catalog_manager.cc:679] Loaded metadata for table TestTable [id=218bd96136a54091af6abdfbdd98bee6]
I20251029 09:09:58.435585 5788 tablet_loader.cc:96] loaded metadata for tablet 4145d472d6854b09af953d59a6cdccbe (table TestTable [id=218bd96136a54091af6abdfbdd98bee6])
I20251029 09:09:58.435647 5788 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251029 09:09:58.435736 5788 catalog_manager.cc:1269] Loaded cluster ID: 267ca649ed894369b5551dde92b6c3b3
I20251029 09:09:58.435774 5788 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251029 09:09:58.436857 5788 catalog_manager.cc:1514] Loading token signing keys...
I20251029 09:09:58.437032 5788 catalog_manager.cc:6033] T 00000000000000000000000000000000 P 46473c25ec53419cb336a062e90273d0: Loaded TSK: 0
I20251029 09:09:58.437237 5788 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20251029 09:09:58.523034 5782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:09:58.523243 5782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:09:58.524782 5782 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20251029 09:09:58.544653 5627 tablet_service.cc:2003] Received UnsafeChangeConfig RPC: dest_uuid: "d892e53e79f742d9acdff11cdcba8cf9"
tablet_id: "4145d472d6854b09af953d59a6cdccbe"
caller_id: "kudu-tools"
new_config {
peers {
permanent_uuid: "1a73658c1c494fe4bb19c6586731756a"
}
peers {
permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9"
}
}
from {username='slave'} at 127.0.0.1:47380
W20251029 09:09:58.544867 5627 raft_consensus.cc:2218] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 1 FOLLOWER]: PROCEEDING WITH UNSAFE CONFIG CHANGE ON THIS SERVER, COMMITTED CONFIG: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc49484a113414497eb16e7c23b3ffb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35427 } } peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } }NEW CONFIG: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } unsafe_config_change: true
I20251029 09:09:58.544962 5627 raft_consensus.cc:3060] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 1 FOLLOWER]: Advancing to term 2
I20251029 09:09:58.551075 5744 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" instance_seqno: 1761728997410612) as {username='slave'} at 127.4.237.196:52769; Asking this server to re-register.
I20251029 09:09:58.551575 5673 heartbeater.cc:461] Registering TS with master...
I20251029 09:09:58.551663 5673 heartbeater.cc:507] Master 127.4.237.254:37015 requested a full tablet report, sending...
I20251029 09:09:58.552042 5744 ts_manager.cc:194] Registered new tserver with Master: d892e53e79f742d9acdff11cdcba8cf9 (127.4.237.196:41731)
I20251029 09:09:59.182852 5744 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c8904c821435433b8aaf14f3dd5cd606" instance_seqno: 1761728997170721) as {username='slave'} at 127.4.237.194:58101; Asking this server to re-register.
I20251029 09:09:59.183136 5411 heartbeater.cc:461] Registering TS with master...
I20251029 09:09:59.183212 5411 heartbeater.cc:507] Master 127.4.237.254:37015 requested a full tablet report, sending...
I20251029 09:09:59.183444 5744 ts_manager.cc:194] Registered new tserver with Master: c8904c821435433b8aaf14f3dd5cd606 (127.4.237.194:33325)
I20251029 09:09:59.280351 5744 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" instance_seqno: 1761728997292825) as {username='slave'} at 127.4.237.195:39605; Asking this server to re-register.
I20251029 09:09:59.280803 5542 heartbeater.cc:461] Registering TS with master...
I20251029 09:09:59.280929 5542 heartbeater.cc:507] Master 127.4.237.254:37015 requested a full tablet report, sending...
I20251029 09:09:59.281345 5744 ts_manager.cc:194] Registered new tserver with Master: 1a73658c1c494fe4bb19c6586731756a (127.4.237.195:46639)
I20251029 09:09:59.776867 5824 raft_consensus.cc:493] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc49484a113414497eb16e7c23b3ffb)
I20251029 09:09:59.776988 5824 raft_consensus.cc:515] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc49484a113414497eb16e7c23b3ffb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35427 } } peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } }
I20251029 09:09:59.777318 5824 leader_election.cc:290] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc49484a113414497eb16e7c23b3ffb (127.4.237.193:35427), d892e53e79f742d9acdff11cdcba8cf9 (127.4.237.196:41731)
W20251029 09:09:59.777688 5432 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.237.193:35427: connect: Connection refused (error 111)
W20251029 09:09:59.778102 5432 leader_election.cc:336] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer efc49484a113414497eb16e7c23b3ffb (127.4.237.193:35427): Network error: Client connection negotiation failed: client connection to 127.4.237.193:35427: connect: Connection refused (error 111)
I20251029 09:09:59.780094 5627 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4145d472d6854b09af953d59a6cdccbe" candidate_uuid: "1a73658c1c494fe4bb19c6586731756a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d892e53e79f742d9acdff11cdcba8cf9" is_pre_election: true
I20251029 09:09:59.780386 5430 leader_election.cc:304] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a73658c1c494fe4bb19c6586731756a; no voters: d892e53e79f742d9acdff11cdcba8cf9, efc49484a113414497eb16e7c23b3ffb
I20251029 09:09:59.780519 5824 raft_consensus.cc:2749] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251029 09:10:00.046422 5828 raft_consensus.cc:493] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader kudu-tools)
I20251029 09:10:00.046541 5828 raft_consensus.cc:515] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } unsafe_config_change: true
I20251029 09:10:00.046782 5828 leader_election.cc:290] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a73658c1c494fe4bb19c6586731756a (127.4.237.195:46639)
I20251029 09:10:00.049587 5496 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4145d472d6854b09af953d59a6cdccbe" candidate_uuid: "d892e53e79f742d9acdff11cdcba8cf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a73658c1c494fe4bb19c6586731756a" is_pre_election: true
I20251029 09:10:00.049705 5496 raft_consensus.cc:2468] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d892e53e79f742d9acdff11cdcba8cf9 in term 1.
I20251029 09:10:00.049911 5562 leader_election.cc:304] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a73658c1c494fe4bb19c6586731756a, d892e53e79f742d9acdff11cdcba8cf9; no voters:
I20251029 09:10:00.050068 5828 raft_consensus.cc:2804] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251029 09:10:00.050143 5828 raft_consensus.cc:493] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader kudu-tools)
I20251029 09:10:00.050195 5828 raft_consensus.cc:3060] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 2 FOLLOWER]: Advancing to term 3
I20251029 09:10:00.050961 5828 raft_consensus.cc:515] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } unsafe_config_change: true
I20251029 09:10:00.051096 5828 leader_election.cc:290] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [CANDIDATE]: Term 3 election: Requested vote from peers 1a73658c1c494fe4bb19c6586731756a (127.4.237.195:46639)
I20251029 09:10:00.051338 5496 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4145d472d6854b09af953d59a6cdccbe" candidate_uuid: "d892e53e79f742d9acdff11cdcba8cf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a73658c1c494fe4bb19c6586731756a"
I20251029 09:10:00.051427 5496 raft_consensus.cc:3060] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 1 FOLLOWER]: Advancing to term 3
I20251029 09:10:00.052043 5496 raft_consensus.cc:2468] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d892e53e79f742d9acdff11cdcba8cf9 in term 3.
I20251029 09:10:00.052235 5562 leader_election.cc:304] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a73658c1c494fe4bb19c6586731756a, d892e53e79f742d9acdff11cdcba8cf9; no voters:
I20251029 09:10:00.052332 5828 raft_consensus.cc:2804] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 3 FOLLOWER]: Leader election won for term 3
I20251029 09:10:00.052464 5828 raft_consensus.cc:697] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 3 LEADER]: Becoming Leader. State: Replica: d892e53e79f742d9acdff11cdcba8cf9, State: Running, Role: LEADER
I20251029 09:10:00.052553 5828 consensus_queue.cc:237] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } unsafe_config_change: true
I20251029 09:10:00.053210 5744 catalog_manager.cc:5649] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 reported cstate change: term changed from 1 to 3, leader changed from efc49484a113414497eb16e7c23b3ffb (127.4.237.193) to d892e53e79f742d9acdff11cdcba8cf9 (127.4.237.196), now has a pending config: VOTER 1a73658c1c494fe4bb19c6586731756a (127.4.237.195), VOTER d892e53e79f742d9acdff11cdcba8cf9 (127.4.237.196). New cstate: current_term: 3 leader_uuid: "d892e53e79f742d9acdff11cdcba8cf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc49484a113414497eb16e7c23b3ffb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35427 } } peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } unsafe_config_change: true }
I20251029 09:10:00.573354 5496 raft_consensus.cc:1275] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 3 FOLLOWER]: Refusing update from remote peer d892e53e79f742d9acdff11cdcba8cf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251029 09:10:00.573750 5837 consensus_queue.cc:1048] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20251029 09:10:00.575047 5840 raft_consensus.cc:2955] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 3 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, VOTER efc49484a113414497eb16e7c23b3ffb (127.4.237.193) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } unsafe_config_change: true }
I20251029 09:10:00.575177 5496 raft_consensus.cc:2955] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 3 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, VOTER efc49484a113414497eb16e7c23b3ffb (127.4.237.193) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } unsafe_config_change: true }
I20251029 09:10:00.576395 5744 catalog_manager.cc:5649] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a reported cstate change: config changed from index -1 to 2, VOTER efc49484a113414497eb16e7c23b3ffb (127.4.237.193) evicted, no longer has a pending config: VOTER 1a73658c1c494fe4bb19c6586731756a (127.4.237.195), VOTER d892e53e79f742d9acdff11cdcba8cf9 (127.4.237.196). New cstate: current_term: 3 leader_uuid: "d892e53e79f742d9acdff11cdcba8cf9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } unsafe_config_change: true }
W20251029 09:10:00.577353 5744 catalog_manager.cc:5841] Failed to send DeleteTablet RPC for tablet 4145d472d6854b09af953d59a6cdccbe on TS efc49484a113414497eb16e7c23b3ffb: Not found: failed to reset TS proxy: Could not find TS for UUID efc49484a113414497eb16e7c23b3ffb
I20251029 09:10:00.580687 5627 consensus_queue.cc:237] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } peers { permanent_uuid: "c8904c821435433b8aaf14f3dd5cd606" member_type: NON_VOTER last_known_addr { host: "127.4.237.194" port: 33325 } attrs { promote: true } } unsafe_config_change: true
I20251029 09:10:00.581454 5496 raft_consensus.cc:1275] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 3 FOLLOWER]: Refusing update from remote peer d892e53e79f742d9acdff11cdcba8cf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251029 09:10:00.581700 5837 consensus_queue.cc:1048] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251029 09:10:00.582515 5840 raft_consensus.cc:2955] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, NON_VOTER c8904c821435433b8aaf14f3dd5cd606 (127.4.237.194) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } peers { permanent_uuid: "c8904c821435433b8aaf14f3dd5cd606" member_type: NON_VOTER last_known_addr { host: "127.4.237.194" port: 33325 } attrs { promote: true } } unsafe_config_change: true }
I20251029 09:10:00.582695 5496 raft_consensus.cc:2955] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, NON_VOTER c8904c821435433b8aaf14f3dd5cd606 (127.4.237.194) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } peers { permanent_uuid: "c8904c821435433b8aaf14f3dd5cd606" member_type: NON_VOTER last_known_addr { host: "127.4.237.194" port: 33325 } attrs { promote: true } } unsafe_config_change: true }
I20251029 09:10:00.583655 5729 catalog_manager.cc:5162] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 4145d472d6854b09af953d59a6cdccbe with cas_config_opid_index 2: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20251029 09:10:00.583739 5743 catalog_manager.cc:5649] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a reported cstate change: config changed from index 2 to 4, NON_VOTER c8904c821435433b8aaf14f3dd5cd606 (127.4.237.194) added. New cstate: current_term: 3 leader_uuid: "d892e53e79f742d9acdff11cdcba8cf9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } peers { permanent_uuid: "c8904c821435433b8aaf14f3dd5cd606" member_type: NON_VOTER last_known_addr { host: "127.4.237.194" port: 33325 } attrs { promote: true } } unsafe_config_change: true }
W20251029 09:10:00.584888 5562 consensus_peers.cc:597] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 -> Peer c8904c821435433b8aaf14f3dd5cd606 (127.4.237.194:33325): Couldn't send request to peer c8904c821435433b8aaf14f3dd5cd606. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4145d472d6854b09af953d59a6cdccbe. This is attempt 1: this message will repeat every 5th retry.
W20251029 09:10:00.630076 5729 catalog_manager.cc:4767] Async tablet task DeleteTablet RPC for tablet 4145d472d6854b09af953d59a6cdccbe on TS efc49484a113414497eb16e7c23b3ffb failed: Not found: failed to reset TS proxy: Could not find TS for UUID efc49484a113414497eb16e7c23b3ffb
I20251029 09:10:01.131798 5853 ts_tablet_manager.cc:933] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606: Initiating tablet copy from peer d892e53e79f742d9acdff11cdcba8cf9 (127.4.237.196:41731)
I20251029 09:10:01.132031 5853 tablet_copy_client.cc:323] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606: tablet copy: Beginning tablet copy session from remote peer at address 127.4.237.196:41731
I20251029 09:10:01.135260 5647 tablet_copy_service.cc:140] P d892e53e79f742d9acdff11cdcba8cf9: Received BeginTabletCopySession request for tablet 4145d472d6854b09af953d59a6cdccbe from peer c8904c821435433b8aaf14f3dd5cd606 ({username='slave'} at 127.4.237.194:33631)
I20251029 09:10:01.135372 5647 tablet_copy_service.cc:161] P d892e53e79f742d9acdff11cdcba8cf9: Beginning new tablet copy session on tablet 4145d472d6854b09af953d59a6cdccbe from peer c8904c821435433b8aaf14f3dd5cd606 at {username='slave'} at 127.4.237.194:33631: session id = c8904c821435433b8aaf14f3dd5cd606-4145d472d6854b09af953d59a6cdccbe
I20251029 09:10:01.136075 5647 tablet_copy_source_session.cc:215] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9: Tablet Copy: opened 0 blocks and 1 log segments
I20251029 09:10:01.136968 5853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4145d472d6854b09af953d59a6cdccbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:01.139281 5853 tablet_copy_client.cc:806] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606: tablet copy: Starting download of 0 data blocks...
I20251029 09:10:01.139434 5853 tablet_copy_client.cc:670] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606: tablet copy: Starting download of 1 WAL segments...
I20251029 09:10:01.140431 5853 tablet_copy_client.cc:538] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251029 09:10:01.141289 5853 tablet_bootstrap.cc:492] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606: Bootstrap starting.
I20251029 09:10:01.142656 5853 log.cc:826] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:01.143790 5853 tablet_bootstrap.cc:492] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251029 09:10:01.144017 5853 tablet_bootstrap.cc:492] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606: Bootstrap complete.
I20251029 09:10:01.144127 5853 ts_tablet_manager.cc:1403] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251029 09:10:01.145249 5853 raft_consensus.cc:359] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } peers { permanent_uuid: "c8904c821435433b8aaf14f3dd5cd606" member_type: NON_VOTER last_known_addr { host: "127.4.237.194" port: 33325 } attrs { promote: true } } unsafe_config_change: true
I20251029 09:10:01.145411 5853 raft_consensus.cc:740] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: c8904c821435433b8aaf14f3dd5cd606, State: Initialized, Role: LEARNER
I20251029 09:10:01.145464 5853 consensus_queue.cc:260] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } peers { permanent_uuid: "c8904c821435433b8aaf14f3dd5cd606" member_type: NON_VOTER last_known_addr { host: "127.4.237.194" port: 33325 } attrs { promote: true } } unsafe_config_change: true
I20251029 09:10:01.145725 5853 ts_tablet_manager.cc:1434] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20251029 09:10:01.146152 5647 tablet_copy_service.cc:342] P d892e53e79f742d9acdff11cdcba8cf9: Request end of tablet copy session c8904c821435433b8aaf14f3dd5cd606-4145d472d6854b09af953d59a6cdccbe received from {username='slave'} at 127.4.237.194:33631
I20251029 09:10:01.146229 5647 tablet_copy_service.cc:434] P d892e53e79f742d9acdff11cdcba8cf9: ending tablet copy session c8904c821435433b8aaf14f3dd5cd606-4145d472d6854b09af953d59a6cdccbe on tablet 4145d472d6854b09af953d59a6cdccbe with peer c8904c821435433b8aaf14f3dd5cd606
I20251029 09:10:01.519179 5365 raft_consensus.cc:1217] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4] Dedup: 3.4->[]
W20251029 09:10:01.796303 5729 catalog_manager.cc:4767] Async tablet task DeleteTablet RPC for tablet 4145d472d6854b09af953d59a6cdccbe on TS efc49484a113414497eb16e7c23b3ffb failed: Not found: failed to reset TS proxy: Could not find TS for UUID efc49484a113414497eb16e7c23b3ffb
I20251029 09:10:02.032931 5852 raft_consensus.cc:1064] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9: attempting to promote NON_VOTER c8904c821435433b8aaf14f3dd5cd606 to VOTER
I20251029 09:10:02.033217 5852 consensus_queue.cc:237] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } peers { permanent_uuid: "c8904c821435433b8aaf14f3dd5cd606" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 33325 } attrs { promote: false } } unsafe_config_change: true
I20251029 09:10:02.033814 5365 raft_consensus.cc:1275] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606 [term 3 LEARNER]: Refusing update from remote peer d892e53e79f742d9acdff11cdcba8cf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251029 09:10:02.033917 5496 raft_consensus.cc:1275] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 3 FOLLOWER]: Refusing update from remote peer d892e53e79f742d9acdff11cdcba8cf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251029 09:10:02.034107 5862 consensus_queue.cc:1048] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8904c821435433b8aaf14f3dd5cd606" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 33325 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251029 09:10:02.034260 5852 consensus_queue.cc:1048] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251029 09:10:02.035176 5862 raft_consensus.cc:2955] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, c8904c821435433b8aaf14f3dd5cd606 (127.4.237.194) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } peers { permanent_uuid: "c8904c821435433b8aaf14f3dd5cd606" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 33325 } attrs { promote: false } } unsafe_config_change: true }
I20251029 09:10:02.035396 5496 raft_consensus.cc:2955] T 4145d472d6854b09af953d59a6cdccbe P 1a73658c1c494fe4bb19c6586731756a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, c8904c821435433b8aaf14f3dd5cd606 (127.4.237.194) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } peers { permanent_uuid: "c8904c821435433b8aaf14f3dd5cd606" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 33325 } attrs { promote: false } } unsafe_config_change: true }
I20251029 09:10:02.035768 5365 raft_consensus.cc:2955] T 4145d472d6854b09af953d59a6cdccbe P c8904c821435433b8aaf14f3dd5cd606 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, c8904c821435433b8aaf14f3dd5cd606 (127.4.237.194) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } } peers { permanent_uuid: "c8904c821435433b8aaf14f3dd5cd606" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 33325 } attrs { promote: false } } unsafe_config_change: true }
I20251029 09:10:02.036710 5744 catalog_manager.cc:5649] T 4145d472d6854b09af953d59a6cdccbe P d892e53e79f742d9acdff11cdcba8cf9 reported cstate change: config changed from index 4 to 5, c8904c821435433b8aaf14f3dd5cd606 (127.4.237.194) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "d892e53e79f742d9acdff11cdcba8cf9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a73658c1c494fe4bb19c6586731756a" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 46639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9" member_type: VOTER last_known_addr { host: "127.4.237.196" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8904c821435433b8aaf14f3dd5cd606" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 33325 } attrs { promote: false } health_report { overall_health: HEALTHY } } unsafe_config_change: true }
I20251029 09:10:02.086479 5047 kudu-admin-test.cc:751] Waiting for Master to see new config...
I20251029 09:10:02.090096 5047 kudu-admin-test.cc:756] Tablet locations:
tablet_locations {
tablet_id: "4145d472d6854b09af953d59a6cdccbe"
DEPRECATED_stale: false
partition {
partition_key_start: ""
partition_key_end: ""
}
interned_replicas {
ts_info_idx: 0
role: FOLLOWER
}
interned_replicas {
ts_info_idx: 1
role: LEADER
}
interned_replicas {
ts_info_idx: 2
role: FOLLOWER
}
}
ts_infos {
permanent_uuid: "1a73658c1c494fe4bb19c6586731756a"
rpc_addresses {
host: "127.4.237.195"
port: 46639
}
}
ts_infos {
permanent_uuid: "d892e53e79f742d9acdff11cdcba8cf9"
rpc_addresses {
host: "127.4.237.196"
port: 41731
}
}
ts_infos {
permanent_uuid: "c8904c821435433b8aaf14f3dd5cd606"
rpc_addresses {
host: "127.4.237.194"
port: 33325
}
}
I20251029 09:10:02.090483 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 5283
I20251029 09:10:02.095193 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 5414
I20251029 09:10:02.099889 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 5545
I20251029 09:10:02.105207 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 5713
2025-10-29T09:10:02Z chronyd exiting
[ OK ] AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes (5380 ms)
[ RUN ] AdminCliTest.TestGracefulSpecificLeaderStepDown
I20251029 09:10:02.126663 5047 test_util.cc:276] Using random seed: 2136784191
I20251029 09:10:02.127238 5047 ts_itest-base.cc:115] Starting cluster with:
I20251029 09:10:02.127274 5047 ts_itest-base.cc:116] --------------
I20251029 09:10:02.127295 5047 ts_itest-base.cc:117] 3 tablet servers
I20251029 09:10:02.127313 5047 ts_itest-base.cc:118] 3 replicas per TS
I20251029 09:10:02.127341 5047 ts_itest-base.cc:119] --------------
2025-10-29T09:10:02Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-10-29T09:10:02Z Disabled control of system clock
I20251029 09:10:02.134773 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:45023
--webserver_interface=127.4.237.254
--webserver_port=0
--builtin_ntp_servers=127.4.237.212:39127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.237.254:45023
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20251029 09:10:02.220566 5880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:02.220768 5880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:02.220808 5880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:02.222283 5880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251029 09:10:02.222333 5880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:02.222354 5880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251029 09:10:02.222375 5880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251029 09:10:02.224009 5880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:39127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.4.237.254:45023
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:45023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.4.237.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.5880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:02.224278 5880 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:02.224525 5880 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:02.227141 5888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:02.227259 5880 server_base.cc:1047] running on GCE node
W20251029 09:10:02.227156 5886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:02.227156 5885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:02.227748 5880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:02.228034 5880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:02.229183 5880 hybrid_clock.cc:648] HybridClock initialized: now 1761729002229164 us; error 42 us; skew 500 ppm
I20251029 09:10:02.230444 5880 webserver.cc:492] Webserver started at http://127.4.237.254:43651/ using document root <none> and password file <none>
I20251029 09:10:02.230660 5880 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:02.230710 5880 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:02.230849 5880 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:02.231743 5880 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "6f979744b3be4f01920f0dfdfd57ec63"
format_stamp: "Formatted at 2025-10-29 09:10:02 on dist-test-slave-z9gc"
I20251029 09:10:02.232074 5880 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "6f979744b3be4f01920f0dfdfd57ec63"
format_stamp: "Formatted at 2025-10-29 09:10:02 on dist-test-slave-z9gc"
I20251029 09:10:02.233388 5880 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20251029 09:10:02.234197 5894 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:02.234431 5880 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251029 09:10:02.234522 5880 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
uuid: "6f979744b3be4f01920f0dfdfd57ec63"
format_stamp: "Formatted at 2025-10-29 09:10:02 on dist-test-slave-z9gc"
I20251029 09:10:02.234591 5880 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:02.267190 5880 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:02.267573 5880 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:02.267701 5880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:02.271689 5880 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.254:45023
I20251029 09:10:02.271729 5946 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.254:45023 every 8 connection(s)
I20251029 09:10:02.272086 5880 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251029 09:10:02.272708 5947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:02.275099 5947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63: Bootstrap starting.
I20251029 09:10:02.275748 5947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:02.276021 5947 log.cc:826] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:02.276816 5947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63: No bootstrap required, opened a new log
I20251029 09:10:02.278121 5947 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f979744b3be4f01920f0dfdfd57ec63" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 45023 } }
I20251029 09:10:02.278261 5947 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:02.278282 5947 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f979744b3be4f01920f0dfdfd57ec63, State: Initialized, Role: FOLLOWER
I20251029 09:10:02.278477 5947 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f979744b3be4f01920f0dfdfd57ec63" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 45023 } }
I20251029 09:10:02.278549 5947 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:02.278573 5947 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:02.278622 5947 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:02.279079 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 5880
I20251029 09:10:02.279153 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251029 09:10:02.279197 5947 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f979744b3be4f01920f0dfdfd57ec63" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 45023 } }
I20251029 09:10:02.279311 5947 leader_election.cc:304] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f979744b3be4f01920f0dfdfd57ec63; no voters:
I20251029 09:10:02.279466 5947 leader_election.cc:290] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251029 09:10:02.279547 5950 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:02.279703 5950 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [term 1 LEADER]: Becoming Leader. State: Replica: 6f979744b3be4f01920f0dfdfd57ec63, State: Running, Role: LEADER
I20251029 09:10:02.279842 5950 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f979744b3be4f01920f0dfdfd57ec63" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 45023 } }
I20251029 09:10:02.279714 5947 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [sys.catalog]: configured and running, proceeding with master startup.
I20251029 09:10:02.280153 5952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f979744b3be4f01920f0dfdfd57ec63. Latest consensus state: current_term: 1 leader_uuid: "6f979744b3be4f01920f0dfdfd57ec63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f979744b3be4f01920f0dfdfd57ec63" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 45023 } } }
I20251029 09:10:02.280225 5952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:02.280407 5951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f979744b3be4f01920f0dfdfd57ec63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f979744b3be4f01920f0dfdfd57ec63" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 45023 } } }
I20251029 09:10:02.280432 5956 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251029 09:10:02.280483 5951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:02.280979 5956 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251029 09:10:02.282536 5956 catalog_manager.cc:1357] Generated new cluster ID: 638ca61ff7194e638830deafdf51f377
I20251029 09:10:02.282594 5956 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251029 09:10:02.294691 5956 catalog_manager.cc:1380] Generated new certificate authority record
I20251029 09:10:02.295280 5956 catalog_manager.cc:1514] Loading token signing keys...
I20251029 09:10:02.299036 5956 catalog_manager.cc:6022] T 00000000000000000000000000000000 P 6f979744b3be4f01920f0dfdfd57ec63: Generated new TSK 0
I20251029 09:10:02.299242 5956 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251029 09:10:02.303918 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.193:0
--local_ip_for_outbound_sockets=127.4.237.193
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:45023
--builtin_ntp_servers=127.4.237.212:39127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20251029 09:10:02.386806 5971 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20251029 09:10:02.386982 5971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:02.386998 5971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:02.387017 5971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:02.388504 5971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:02.388581 5971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.193
I20251029 09:10:02.390157 5971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:39127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:45023
--never_fsync=true
--heap_profile_path=/tmp/kudu.5971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.193
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:02.390377 5971 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:02.390642 5971 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:02.393174 5977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:02.393182 5976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:02.393306 5979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:02.393512 5971 server_base.cc:1047] running on GCE node
I20251029 09:10:02.393664 5971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:02.393910 5971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:02.395051 5971 hybrid_clock.cc:648] HybridClock initialized: now 1761729002395038 us; error 35 us; skew 500 ppm
I20251029 09:10:02.396186 5971 webserver.cc:492] Webserver started at http://127.4.237.193:37743/ using document root <none> and password file <none>
I20251029 09:10:02.396394 5971 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:02.396435 5971 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:02.396543 5971 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:02.397454 5971 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "8e985d3939e442b78b45fd0597f44bda"
format_stamp: "Formatted at 2025-10-29 09:10:02 on dist-test-slave-z9gc"
I20251029 09:10:02.397765 5971 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "8e985d3939e442b78b45fd0597f44bda"
format_stamp: "Formatted at 2025-10-29 09:10:02 on dist-test-slave-z9gc"
I20251029 09:10:02.399070 5971 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20251029 09:10:02.399833 5985 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:02.400041 5971 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251029 09:10:02.400139 5971 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "8e985d3939e442b78b45fd0597f44bda"
format_stamp: "Formatted at 2025-10-29 09:10:02 on dist-test-slave-z9gc"
I20251029 09:10:02.400213 5971 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:02.415567 5971 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:02.415934 5971 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:02.416076 5971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:02.416357 5971 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:02.416762 5971 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:02.416822 5971 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:02.416865 5971 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:02.416891 5971 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:02.424636 5971 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.193:36603
I20251029 09:10:02.424701 6098 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.193:36603 every 8 connection(s)
I20251029 09:10:02.425094 5971 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251029 09:10:02.428874 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 5971
I20251029 09:10:02.428965 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251029 09:10:02.430541 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.194:0
--local_ip_for_outbound_sockets=127.4.237.194
--webserver_interface=127.4.237.194
--webserver_port=0
--tserver_master_addrs=127.4.237.254:45023
--builtin_ntp_servers=127.4.237.212:39127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20251029 09:10:02.431435 6099 heartbeater.cc:344] Connected to a master server at 127.4.237.254:45023
I20251029 09:10:02.431564 6099 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:02.431799 6099 heartbeater.cc:507] Master 127.4.237.254:45023 requested a full tablet report, sending...
I20251029 09:10:02.432302 5911 ts_manager.cc:194] Registered new tserver with Master: 8e985d3939e442b78b45fd0597f44bda (127.4.237.193:36603)
I20251029 09:10:02.433288 5911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.193:48967
W20251029 09:10:02.512806 6102 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20251029 09:10:02.512997 6102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:02.513023 6102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:02.513051 6102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:02.514482 6102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:02.514536 6102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.194
I20251029 09:10:02.516040 6102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:39127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.4.237.194
--webserver_port=0
--tserver_master_addrs=127.4.237.254:45023
--never_fsync=true
--heap_profile_path=/tmp/kudu.6102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.194
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:02.516281 6102 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:02.516530 6102 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:02.519227 6107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:02.519263 6108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:02.519387 6102 server_base.cc:1047] running on GCE node
W20251029 09:10:02.519268 6110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:02.519624 6102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:02.519852 6102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:02.520985 6102 hybrid_clock.cc:648] HybridClock initialized: now 1761729002520960 us; error 39 us; skew 500 ppm
I20251029 09:10:02.522111 6102 webserver.cc:492] Webserver started at http://127.4.237.194:35395/ using document root <none> and password file <none>
I20251029 09:10:02.522325 6102 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:02.522374 6102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:02.522517 6102 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:02.523391 6102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "8bd8c74f320543a0988750b1225b1eb7"
format_stamp: "Formatted at 2025-10-29 09:10:02 on dist-test-slave-z9gc"
I20251029 09:10:02.523691 6102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "8bd8c74f320543a0988750b1225b1eb7"
format_stamp: "Formatted at 2025-10-29 09:10:02 on dist-test-slave-z9gc"
I20251029 09:10:02.524859 6102 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251029 09:10:02.525565 6116 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:02.525735 6102 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251029 09:10:02.525810 6102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "8bd8c74f320543a0988750b1225b1eb7"
format_stamp: "Formatted at 2025-10-29 09:10:02 on dist-test-slave-z9gc"
I20251029 09:10:02.525871 6102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:02.551903 6102 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:02.552184 6102 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:02.552304 6102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:02.552503 6102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:02.552872 6102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:02.552912 6102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:02.552950 6102 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:02.552980 6102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:02.558629 6102 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.194:38983
I20251029 09:10:02.558714 6229 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.194:38983 every 8 connection(s)
I20251029 09:10:02.559031 6102 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251029 09:10:02.563491 6230 heartbeater.cc:344] Connected to a master server at 127.4.237.254:45023
I20251029 09:10:02.563586 6230 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:02.563797 6230 heartbeater.cc:507] Master 127.4.237.254:45023 requested a full tablet report, sending...
I20251029 09:10:02.564134 5911 ts_manager.cc:194] Registered new tserver with Master: 8bd8c74f320543a0988750b1225b1eb7 (127.4.237.194:38983)
I20251029 09:10:02.564515 5911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.194:38345
I20251029 09:10:02.566047 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 6102
I20251029 09:10:02.566111 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251029 09:10:02.567229 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.195:0
--local_ip_for_outbound_sockets=127.4.237.195
--webserver_interface=127.4.237.195
--webserver_port=0
--tserver_master_addrs=127.4.237.254:45023
--builtin_ntp_servers=127.4.237.212:39127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20251029 09:10:02.646150 6233 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20251029 09:10:02.646350 6233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:02.646378 6233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:02.646422 6233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:02.647871 6233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:02.647933 6233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.195
I20251029 09:10:02.649456 6233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:39127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.4.237.195
--webserver_port=0
--tserver_master_addrs=127.4.237.254:45023
--never_fsync=true
--heap_profile_path=/tmp/kudu.6233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.195
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:02.649701 6233 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:02.649947 6233 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:02.652552 6239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:02.652585 6241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:02.652617 6238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:02.652843 6233 server_base.cc:1047] running on GCE node
I20251029 09:10:02.653031 6233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:02.653249 6233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:02.654384 6233 hybrid_clock.cc:648] HybridClock initialized: now 1761729002654374 us; error 30 us; skew 500 ppm
I20251029 09:10:02.655591 6233 webserver.cc:492] Webserver started at http://127.4.237.195:38205/ using document root <none> and password file <none>
I20251029 09:10:02.655795 6233 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:02.655844 6233 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:02.655961 6233 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:02.656814 6233 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "923187608aa54b6c94e896d12e52f954"
format_stamp: "Formatted at 2025-10-29 09:10:02 on dist-test-slave-z9gc"
I20251029 09:10:02.657112 6233 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "923187608aa54b6c94e896d12e52f954"
format_stamp: "Formatted at 2025-10-29 09:10:02 on dist-test-slave-z9gc"
I20251029 09:10:02.658303 6233 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20251029 09:10:02.659161 6247 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:02.659344 6233 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:02.659410 6233 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "923187608aa54b6c94e896d12e52f954"
format_stamp: "Formatted at 2025-10-29 09:10:02 on dist-test-slave-z9gc"
I20251029 09:10:02.659476 6233 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:02.674067 6233 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:02.674352 6233 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:02.674507 6233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:02.674747 6233 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:02.675069 6233 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:02.675103 6233 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:02.675139 6233 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:02.675159 6233 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:02.680796 6233 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.195:45993
I20251029 09:10:02.680860 6360 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.195:45993 every 8 connection(s)
I20251029 09:10:02.681155 6233 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251029 09:10:02.686060 6361 heartbeater.cc:344] Connected to a master server at 127.4.237.254:45023
I20251029 09:10:02.686182 6361 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:02.686416 6361 heartbeater.cc:507] Master 127.4.237.254:45023 requested a full tablet report, sending...
I20251029 09:10:02.686935 5911 ts_manager.cc:194] Registered new tserver with Master: 923187608aa54b6c94e896d12e52f954 (127.4.237.195:45993)
I20251029 09:10:02.687301 5911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.195:50645
I20251029 09:10:02.691331 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 6233
I20251029 09:10:02.691404 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251029 09:10:02.692283 5047 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251029 09:10:02.698311 5911 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51614:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20251029 09:10:02.699697 5911 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251029 09:10:02.706187 6295 tablet_service.cc:1505] Processing CreateTablet for tablet 8e6d7ade24be4ab0a09c756b3b2ba37b (DEFAULT_TABLE table=TestTable [id=905a1def97f84020bcb5e16c1abb8480]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:02.706557 6295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6d7ade24be4ab0a09c756b3b2ba37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:02.706481 6033 tablet_service.cc:1505] Processing CreateTablet for tablet 8e6d7ade24be4ab0a09c756b3b2ba37b (DEFAULT_TABLE table=TestTable [id=905a1def97f84020bcb5e16c1abb8480]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:02.706764 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6d7ade24be4ab0a09c756b3b2ba37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:02.706923 6164 tablet_service.cc:1505] Processing CreateTablet for tablet 8e6d7ade24be4ab0a09c756b3b2ba37b (DEFAULT_TABLE table=TestTable [id=905a1def97f84020bcb5e16c1abb8480]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:02.707171 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6d7ade24be4ab0a09c756b3b2ba37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:02.708753 6375 tablet_bootstrap.cc:492] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8e985d3939e442b78b45fd0597f44bda: Bootstrap starting.
I20251029 09:10:02.709343 6375 tablet_bootstrap.cc:654] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8e985d3939e442b78b45fd0597f44bda: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:02.709363 6376 tablet_bootstrap.cc:492] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954: Bootstrap starting.
I20251029 09:10:02.709684 6375 log.cc:826] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8e985d3939e442b78b45fd0597f44bda: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:02.709993 6377 tablet_bootstrap.cc:492] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7: Bootstrap starting.
I20251029 09:10:02.710016 6376 tablet_bootstrap.cc:654] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:02.710299 6376 log.cc:826] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:02.710520 6375 tablet_bootstrap.cc:492] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8e985d3939e442b78b45fd0597f44bda: No bootstrap required, opened a new log
I20251029 09:10:02.710569 6377 tablet_bootstrap.cc:654] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:02.710595 6375 ts_tablet_manager.cc:1403] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8e985d3939e442b78b45fd0597f44bda: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251029 09:10:02.710875 6377 log.cc:826] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:02.711174 6376 tablet_bootstrap.cc:492] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954: No bootstrap required, opened a new log
I20251029 09:10:02.711243 6376 ts_tablet_manager.cc:1403] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251029 09:10:02.711498 6377 tablet_bootstrap.cc:492] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7: No bootstrap required, opened a new log
I20251029 09:10:02.711555 6377 ts_tablet_manager.cc:1403] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251029 09:10:02.712098 6375 raft_consensus.cc:359] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8e985d3939e442b78b45fd0597f44bda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e985d3939e442b78b45fd0597f44bda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 36603 } } peers { permanent_uuid: "8bd8c74f320543a0988750b1225b1eb7" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 38983 } } peers { permanent_uuid: "923187608aa54b6c94e896d12e52f954" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 45993 } }
I20251029 09:10:02.712270 6375 raft_consensus.cc:740] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8e985d3939e442b78b45fd0597f44bda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e985d3939e442b78b45fd0597f44bda, State: Initialized, Role: FOLLOWER
I20251029 09:10:02.712328 6375 consensus_queue.cc:260] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8e985d3939e442b78b45fd0597f44bda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e985d3939e442b78b45fd0597f44bda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 36603 } } peers { permanent_uuid: "8bd8c74f320543a0988750b1225b1eb7" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 38983 } } peers { permanent_uuid: "923187608aa54b6c94e896d12e52f954" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 45993 } }
I20251029 09:10:02.712559 6375 ts_tablet_manager.cc:1434] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8e985d3939e442b78b45fd0597f44bda: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251029 09:10:02.712674 6099 heartbeater.cc:499] Master 127.4.237.254:45023 was elected leader, sending a full tablet report...
I20251029 09:10:02.712816 6376 raft_consensus.cc:359] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e985d3939e442b78b45fd0597f44bda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 36603 } } peers { permanent_uuid: "8bd8c74f320543a0988750b1225b1eb7" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 38983 } } peers { permanent_uuid: "923187608aa54b6c94e896d12e52f954" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 45993 } }
I20251029 09:10:02.712949 6376 raft_consensus.cc:740] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 923187608aa54b6c94e896d12e52f954, State: Initialized, Role: FOLLOWER
I20251029 09:10:02.712996 6376 consensus_queue.cc:260] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e985d3939e442b78b45fd0597f44bda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 36603 } } peers { permanent_uuid: "8bd8c74f320543a0988750b1225b1eb7" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 38983 } } peers { permanent_uuid: "923187608aa54b6c94e896d12e52f954" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 45993 } }
I20251029 09:10:02.713063 6377 raft_consensus.cc:359] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e985d3939e442b78b45fd0597f44bda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 36603 } } peers { permanent_uuid: "8bd8c74f320543a0988750b1225b1eb7" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 38983 } } peers { permanent_uuid: "923187608aa54b6c94e896d12e52f954" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 45993 } }
I20251029 09:10:02.713218 6377 raft_consensus.cc:740] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bd8c74f320543a0988750b1225b1eb7, State: Initialized, Role: FOLLOWER
I20251029 09:10:02.713230 6376 ts_tablet_manager.cc:1434] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251029 09:10:02.713284 6377 consensus_queue.cc:260] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e985d3939e442b78b45fd0597f44bda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 36603 } } peers { permanent_uuid: "8bd8c74f320543a0988750b1225b1eb7" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 38983 } } peers { permanent_uuid: "923187608aa54b6c94e896d12e52f954" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 45993 } }
I20251029 09:10:02.713374 6361 heartbeater.cc:499] Master 127.4.237.254:45023 was elected leader, sending a full tablet report...
I20251029 09:10:02.713547 6377 ts_tablet_manager.cc:1434] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251029 09:10:02.713646 6230 heartbeater.cc:499] Master 127.4.237.254:45023 was elected leader, sending a full tablet report...
I20251029 09:10:02.717748 5047 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251029 09:10:02.718281 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 8e985d3939e442b78b45fd0597f44bda to finish bootstrapping
I20251029 09:10:02.721846 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 8bd8c74f320543a0988750b1225b1eb7 to finish bootstrapping
I20251029 09:10:02.725016 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 923187608aa54b6c94e896d12e52f954 to finish bootstrapping
I20251029 09:10:02.736924 6184 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "8e6d7ade24be4ab0a09c756b3b2ba37b"
dest_uuid: "8bd8c74f320543a0988750b1225b1eb7"
from {username='slave'} at 127.0.0.1:49102
I20251029 09:10:02.737052 6184 raft_consensus.cc:493] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20251029 09:10:02.737120 6184 raft_consensus.cc:3060] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:02.738085 6184 raft_consensus.cc:515] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e985d3939e442b78b45fd0597f44bda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 36603 } } peers { permanent_uuid: "8bd8c74f320543a0988750b1225b1eb7" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 38983 } } peers { permanent_uuid: "923187608aa54b6c94e896d12e52f954" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 45993 } }
I20251029 09:10:02.738394 6184 leader_election.cc:290] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [CANDIDATE]: Term 1 election: Requested vote from peers 8e985d3939e442b78b45fd0597f44bda (127.4.237.193:36603), 923187608aa54b6c94e896d12e52f954 (127.4.237.195:45993)
I20251029 09:10:02.739987 5047 cluster_itest_util.cc:257] Not converged past 1 yet: 0.0 0.0 0.0
I20251029 09:10:02.741442 6053 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e6d7ade24be4ab0a09c756b3b2ba37b" candidate_uuid: "8bd8c74f320543a0988750b1225b1eb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8e985d3939e442b78b45fd0597f44bda"
I20251029 09:10:02.741564 6053 raft_consensus.cc:3060] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8e985d3939e442b78b45fd0597f44bda [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:02.741992 6315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e6d7ade24be4ab0a09c756b3b2ba37b" candidate_uuid: "8bd8c74f320543a0988750b1225b1eb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "923187608aa54b6c94e896d12e52f954"
I20251029 09:10:02.742113 6315 raft_consensus.cc:3060] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:02.742977 6053 raft_consensus.cc:2468] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8e985d3939e442b78b45fd0597f44bda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bd8c74f320543a0988750b1225b1eb7 in term 1.
I20251029 09:10:02.743227 6118 leader_election.cc:304] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bd8c74f320543a0988750b1225b1eb7, 8e985d3939e442b78b45fd0597f44bda; no voters:
I20251029 09:10:02.743400 6383 raft_consensus.cc:2804] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:02.743423 6315 raft_consensus.cc:2468] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bd8c74f320543a0988750b1225b1eb7 in term 1.
I20251029 09:10:02.743589 6383 raft_consensus.cc:697] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 1 LEADER]: Becoming Leader. State: Replica: 8bd8c74f320543a0988750b1225b1eb7, State: Running, Role: LEADER
I20251029 09:10:02.743713 6383 consensus_queue.cc:237] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e985d3939e442b78b45fd0597f44bda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 36603 } } peers { permanent_uuid: "8bd8c74f320543a0988750b1225b1eb7" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 38983 } } peers { permanent_uuid: "923187608aa54b6c94e896d12e52f954" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 45993 } }
I20251029 09:10:02.744648 5910 catalog_manager.cc:5649] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bd8c74f320543a0988750b1225b1eb7 (127.4.237.194). New cstate: current_term: 1 leader_uuid: "8bd8c74f320543a0988750b1225b1eb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e985d3939e442b78b45fd0597f44bda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bd8c74f320543a0988750b1225b1eb7" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 38983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "923187608aa54b6c94e896d12e52f954" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 45993 } health_report { overall_health: UNKNOWN } } }
W20251029 09:10:02.809703 6231 tablet.cc:2378] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251029 09:10:02.841499 5047 cluster_itest_util.cc:257] Not converged past 1 yet: 1.1 0.0 0.0
W20251029 09:10:02.925843 6100 tablet.cc:2378] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8e985d3939e442b78b45fd0597f44bda: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251029 09:10:02.931655 6362 tablet.cc:2378] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251029 09:10:03.043128 5047 cluster_itest_util.cc:257] Not converged past 1 yet: 1.1 0.0 0.0
I20251029 09:10:03.171320 6383 consensus_queue.cc:1048] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e985d3939e442b78b45fd0597f44bda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251029 09:10:03.173511 6386 consensus_queue.cc:1048] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "923187608aa54b6c94e896d12e52f954" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 45993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251029 09:10:03.455504 6184 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "8e6d7ade24be4ab0a09c756b3b2ba37b"
dest_uuid: "8bd8c74f320543a0988750b1225b1eb7"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:49116
I20251029 09:10:03.455619 6184 raft_consensus.cc:606] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 1 LEADER]: Received request to transfer leadership
I20251029 09:10:03.631052 6383 raft_consensus.cc:993] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7: : Instructing follower 923187608aa54b6c94e896d12e52f954 to start an election
I20251029 09:10:03.631170 6383 raft_consensus.cc:1081] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 1 LEADER]: Signalling peer 923187608aa54b6c94e896d12e52f954 to start an election
I20251029 09:10:03.631446 6315 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "8e6d7ade24be4ab0a09c756b3b2ba37b"
dest_uuid: "923187608aa54b6c94e896d12e52f954"
from {username='slave'} at 127.4.237.194:55315
I20251029 09:10:03.631567 6315 raft_consensus.cc:493] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251029 09:10:03.631590 6315 raft_consensus.cc:3060] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954 [term 1 FOLLOWER]: Advancing to term 2
I20251029 09:10:03.632239 6315 raft_consensus.cc:515] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e985d3939e442b78b45fd0597f44bda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 36603 } } peers { permanent_uuid: "8bd8c74f320543a0988750b1225b1eb7" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 38983 } } peers { permanent_uuid: "923187608aa54b6c94e896d12e52f954" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 45993 } }
I20251029 09:10:03.632547 6315 leader_election.cc:290] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954 [CANDIDATE]: Term 2 election: Requested vote from peers 8e985d3939e442b78b45fd0597f44bda (127.4.237.193:36603), 8bd8c74f320543a0988750b1225b1eb7 (127.4.237.194:38983)
I20251029 09:10:03.635351 6053 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e6d7ade24be4ab0a09c756b3b2ba37b" candidate_uuid: "923187608aa54b6c94e896d12e52f954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e985d3939e442b78b45fd0597f44bda"
I20251029 09:10:03.635457 6053 raft_consensus.cc:3060] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8e985d3939e442b78b45fd0597f44bda [term 1 FOLLOWER]: Advancing to term 2
I20251029 09:10:03.635453 6184 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e6d7ade24be4ab0a09c756b3b2ba37b" candidate_uuid: "923187608aa54b6c94e896d12e52f954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bd8c74f320543a0988750b1225b1eb7"
I20251029 09:10:03.635571 6184 raft_consensus.cc:3055] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 1 LEADER]: Stepping down as leader of term 1
I20251029 09:10:03.635614 6184 raft_consensus.cc:740] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8bd8c74f320543a0988750b1225b1eb7, State: Running, Role: LEADER
I20251029 09:10:03.635669 6184 consensus_queue.cc:260] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e985d3939e442b78b45fd0597f44bda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 36603 } } peers { permanent_uuid: "8bd8c74f320543a0988750b1225b1eb7" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 38983 } } peers { permanent_uuid: "923187608aa54b6c94e896d12e52f954" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 45993 } }
I20251029 09:10:03.635802 6184 raft_consensus.cc:3060] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 1 FOLLOWER]: Advancing to term 2
I20251029 09:10:03.636324 6053 raft_consensus.cc:2468] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8e985d3939e442b78b45fd0597f44bda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 923187608aa54b6c94e896d12e52f954 in term 2.
I20251029 09:10:03.636561 6184 raft_consensus.cc:2468] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 923187608aa54b6c94e896d12e52f954 in term 2.
I20251029 09:10:03.636588 6249 leader_election.cc:304] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e985d3939e442b78b45fd0597f44bda, 923187608aa54b6c94e896d12e52f954; no voters:
I20251029 09:10:03.636749 6382 raft_consensus.cc:2804] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954 [term 2 FOLLOWER]: Leader election won for term 2
I20251029 09:10:03.636899 6382 raft_consensus.cc:697] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954 [term 2 LEADER]: Becoming Leader. State: Replica: 923187608aa54b6c94e896d12e52f954, State: Running, Role: LEADER
I20251029 09:10:03.636996 6382 consensus_queue.cc:237] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e985d3939e442b78b45fd0597f44bda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 36603 } } peers { permanent_uuid: "8bd8c74f320543a0988750b1225b1eb7" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 38983 } } peers { permanent_uuid: "923187608aa54b6c94e896d12e52f954" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 45993 } }
I20251029 09:10:03.637635 5909 catalog_manager.cc:5649] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 923187608aa54b6c94e896d12e52f954 reported cstate change: term changed from 1 to 2, leader changed from 8bd8c74f320543a0988750b1225b1eb7 (127.4.237.194) to 923187608aa54b6c94e896d12e52f954 (127.4.237.195). New cstate: current_term: 2 leader_uuid: "923187608aa54b6c94e896d12e52f954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e985d3939e442b78b45fd0597f44bda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bd8c74f320543a0988750b1225b1eb7" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 38983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "923187608aa54b6c94e896d12e52f954" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 45993 } health_report { overall_health: HEALTHY } } }
I20251029 09:10:03.755097 6184 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "8e6d7ade24be4ab0a09c756b3b2ba37b"
dest_uuid: "8bd8c74f320543a0988750b1225b1eb7"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:49126
I20251029 09:10:03.755194 6184 raft_consensus.cc:606] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 2 FOLLOWER]: Received request to transfer leadership
I20251029 09:10:03.755215 6184 raft_consensus.cc:614] T 8e6d7ade24be4ab0a09c756b3b2ba37b P 8bd8c74f320543a0988750b1225b1eb7 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20251029 09:10:03.811321 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 5971
I20251029 09:10:03.816243 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 6102
I20251029 09:10:03.820863 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 6233
I20251029 09:10:03.825367 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 5880
2025-10-29T09:10:03Z chronyd exiting
[ OK ] AdminCliTest.TestGracefulSpecificLeaderStepDown (1718 ms)
[ RUN ] AdminCliTest.TestDescribeTableColumnFlags
I20251029 09:10:03.845290 5047 test_util.cc:276] Using random seed: 2138502820
I20251029 09:10:03.845868 5047 ts_itest-base.cc:115] Starting cluster with:
I20251029 09:10:03.845916 5047 ts_itest-base.cc:116] --------------
I20251029 09:10:03.845937 5047 ts_itest-base.cc:117] 3 tablet servers
I20251029 09:10:03.845955 5047 ts_itest-base.cc:118] 3 replicas per TS
I20251029 09:10:03.845981 5047 ts_itest-base.cc:119] --------------
2025-10-29T09:10:03Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-10-29T09:10:03Z Disabled control of system clock
I20251029 09:10:03.853322 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:42385
--webserver_interface=127.4.237.254
--webserver_port=0
--builtin_ntp_servers=127.4.237.212:44413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.237.254:42385 with env {}
W20251029 09:10:03.934252 6440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:03.934484 6440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:03.934517 6440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:03.935983 6440 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251029 09:10:03.936033 6440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:03.936053 6440 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251029 09:10:03.936074 6440 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251029 09:10:03.937666 6440 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:44413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.237.254:42385
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:42385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.4.237.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.6440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:03.937939 6440 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:03.938179 6440 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:03.941066 6448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:03.941062 6445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:03.941062 6446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:03.941254 6440 server_base.cc:1047] running on GCE node
I20251029 09:10:03.941445 6440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:03.941653 6440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:03.942780 6440 hybrid_clock.cc:648] HybridClock initialized: now 1761729003942772 us; error 28 us; skew 500 ppm
I20251029 09:10:03.943989 6440 webserver.cc:492] Webserver started at http://127.4.237.254:35041/ using document root <none> and password file <none>
I20251029 09:10:03.944193 6440 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:03.944234 6440 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:03.944353 6440 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:03.945230 6440 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "750235e118884a509d71c728caa69d49"
format_stamp: "Formatted at 2025-10-29 09:10:03 on dist-test-slave-z9gc"
I20251029 09:10:03.945573 6440 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "750235e118884a509d71c728caa69d49"
format_stamp: "Formatted at 2025-10-29 09:10:03 on dist-test-slave-z9gc"
I20251029 09:10:03.947113 6440 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20251029 09:10:03.947957 6454 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:03.948160 6440 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:03.948233 6440 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
uuid: "750235e118884a509d71c728caa69d49"
format_stamp: "Formatted at 2025-10-29 09:10:03 on dist-test-slave-z9gc"
I20251029 09:10:03.948305 6440 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:03.984570 6440 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:03.984902 6440 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:03.985009 6440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:03.989017 6440 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.254:42385
I20251029 09:10:03.989069 6506 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.254:42385 every 8 connection(s)
I20251029 09:10:03.989393 6440 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251029 09:10:03.990005 6507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:03.992599 6507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49: Bootstrap starting.
I20251029 09:10:03.993237 6507 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:03.993510 6507 log.cc:826] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:03.994185 6507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49: No bootstrap required, opened a new log
I20251029 09:10:03.995438 6507 raft_consensus.cc:359] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750235e118884a509d71c728caa69d49" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 42385 } }
I20251029 09:10:03.995584 6507 raft_consensus.cc:385] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:03.995618 6507 raft_consensus.cc:740] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 750235e118884a509d71c728caa69d49, State: Initialized, Role: FOLLOWER
I20251029 09:10:03.995775 6507 consensus_queue.cc:260] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750235e118884a509d71c728caa69d49" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 42385 } }
I20251029 09:10:03.995872 6507 raft_consensus.cc:399] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:03.995910 6507 raft_consensus.cc:493] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:03.995960 6507 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:03.996508 6507 raft_consensus.cc:515] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750235e118884a509d71c728caa69d49" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 42385 } }
I20251029 09:10:03.996619 6507 leader_election.cc:304] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 750235e118884a509d71c728caa69d49; no voters:
I20251029 09:10:03.996778 6507 leader_election.cc:290] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251029 09:10:03.996882 6510 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:03.997067 6510 raft_consensus.cc:697] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [term 1 LEADER]: Becoming Leader. State: Replica: 750235e118884a509d71c728caa69d49, State: Running, Role: LEADER
I20251029 09:10:03.997166 6510 consensus_queue.cc:237] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750235e118884a509d71c728caa69d49" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 42385 } }
I20251029 09:10:03.997195 6507 sys_catalog.cc:565] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [sys.catalog]: configured and running, proceeding with master startup.
I20251029 09:10:03.997534 6512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 750235e118884a509d71c728caa69d49. Latest consensus state: current_term: 1 leader_uuid: "750235e118884a509d71c728caa69d49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750235e118884a509d71c728caa69d49" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 42385 } } }
I20251029 09:10:03.997555 6511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "750235e118884a509d71c728caa69d49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750235e118884a509d71c728caa69d49" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 42385 } } }
I20251029 09:10:03.997627 6512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:03.997675 6511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:03.997920 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 6440
I20251029 09:10:03.998023 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251029 09:10:03.998461 6515 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251029 09:10:03.998981 6515 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251029 09:10:04.002038 6515 catalog_manager.cc:1357] Generated new cluster ID: 96bf9ffa606f4902b44bc4adeef0dfd2
I20251029 09:10:04.002115 6515 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251029 09:10:04.019800 6515 catalog_manager.cc:1380] Generated new certificate authority record
I20251029 09:10:04.020399 6515 catalog_manager.cc:1514] Loading token signing keys...
I20251029 09:10:04.034148 6515 catalog_manager.cc:6022] T 00000000000000000000000000000000 P 750235e118884a509d71c728caa69d49: Generated new TSK 0
I20251029 09:10:04.034386 6515 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251029 09:10:04.037335 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.193:0
--local_ip_for_outbound_sockets=127.4.237.193
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:42385
--builtin_ntp_servers=127.4.237.212:44413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251029 09:10:04.138936 6531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:04.139137 6531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:04.139169 6531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:04.140805 6531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:04.140887 6531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.193
I20251029 09:10:04.142673 6531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:44413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:42385
--never_fsync=true
--heap_profile_path=/tmp/kudu.6531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.193
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:04.142939 6531 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:04.143187 6531 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:04.145824 6536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:04.145819 6537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:04.145884 6539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:04.146720 6531 server_base.cc:1047] running on GCE node
I20251029 09:10:04.146929 6531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:04.147145 6531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:04.148294 6531 hybrid_clock.cc:648] HybridClock initialized: now 1761729004148272 us; error 43 us; skew 500 ppm
I20251029 09:10:04.149530 6531 webserver.cc:492] Webserver started at http://127.4.237.193:38373/ using document root <none> and password file <none>
I20251029 09:10:04.149739 6531 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:04.149804 6531 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:04.149941 6531 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:04.150874 6531 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "83eabe35ce644ac8af2a65db5fad537b"
format_stamp: "Formatted at 2025-10-29 09:10:04 on dist-test-slave-z9gc"
I20251029 09:10:04.151352 6531 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "83eabe35ce644ac8af2a65db5fad537b"
format_stamp: "Formatted at 2025-10-29 09:10:04 on dist-test-slave-z9gc"
I20251029 09:10:04.152927 6531 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251029 09:10:04.153733 6545 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:04.153995 6531 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:04.154072 6531 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "83eabe35ce644ac8af2a65db5fad537b"
format_stamp: "Formatted at 2025-10-29 09:10:04 on dist-test-slave-z9gc"
I20251029 09:10:04.154140 6531 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:04.179124 6531 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:04.179427 6531 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:04.179560 6531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:04.179816 6531 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:04.180164 6531 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:04.180202 6531 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:04.180238 6531 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:04.180270 6531 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:04.186028 6531 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.193:34001
I20251029 09:10:04.186110 6658 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.193:34001 every 8 connection(s)
I20251029 09:10:04.186468 6531 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251029 09:10:04.191267 6659 heartbeater.cc:344] Connected to a master server at 127.4.237.254:42385
I20251029 09:10:04.191381 6659 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:04.191602 6659 heartbeater.cc:507] Master 127.4.237.254:42385 requested a full tablet report, sending...
I20251029 09:10:04.192112 6471 ts_manager.cc:194] Registered new tserver with Master: 83eabe35ce644ac8af2a65db5fad537b (127.4.237.193:34001)
I20251029 09:10:04.192798 6471 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.193:59181
I20251029 09:10:04.193450 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 6531
I20251029 09:10:04.193519 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251029 09:10:04.194648 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.194:0
--local_ip_for_outbound_sockets=127.4.237.194
--webserver_interface=127.4.237.194
--webserver_port=0
--tserver_master_addrs=127.4.237.254:42385
--builtin_ntp_servers=127.4.237.212:44413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251029 09:10:04.277072 6662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:04.277289 6662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:04.277311 6662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:04.278966 6662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:04.279038 6662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.194
I20251029 09:10:04.280691 6662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:44413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.4.237.194
--webserver_port=0
--tserver_master_addrs=127.4.237.254:42385
--never_fsync=true
--heap_profile_path=/tmp/kudu.6662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.194
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:04.280984 6662 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:04.281257 6662 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:04.283905 6668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:04.283926 6667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:04.283901 6670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:04.284396 6662 server_base.cc:1047] running on GCE node
I20251029 09:10:04.284575 6662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:04.284761 6662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:04.285898 6662 hybrid_clock.cc:648] HybridClock initialized: now 1761729004285889 us; error 29 us; skew 500 ppm
I20251029 09:10:04.287160 6662 webserver.cc:492] Webserver started at http://127.4.237.194:38023/ using document root <none> and password file <none>
I20251029 09:10:04.287379 6662 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:04.287422 6662 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:04.287564 6662 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:04.288511 6662 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "53d8b343919b480f9b87abde58448cb6"
format_stamp: "Formatted at 2025-10-29 09:10:04 on dist-test-slave-z9gc"
I20251029 09:10:04.288810 6662 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "53d8b343919b480f9b87abde58448cb6"
format_stamp: "Formatted at 2025-10-29 09:10:04 on dist-test-slave-z9gc"
I20251029 09:10:04.290066 6662 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251029 09:10:04.290927 6676 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:04.291105 6662 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:04.291181 6662 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "53d8b343919b480f9b87abde58448cb6"
format_stamp: "Formatted at 2025-10-29 09:10:04 on dist-test-slave-z9gc"
I20251029 09:10:04.291246 6662 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:04.305193 6662 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:04.305495 6662 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:04.305636 6662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:04.305863 6662 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:04.306176 6662 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:04.306209 6662 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:04.306248 6662 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:04.306280 6662 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:04.312215 6662 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.194:41457
I20251029 09:10:04.312264 6789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.194:41457 every 8 connection(s)
I20251029 09:10:04.312623 6662 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251029 09:10:04.317579 6790 heartbeater.cc:344] Connected to a master server at 127.4.237.254:42385
I20251029 09:10:04.317703 6790 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:04.317927 6790 heartbeater.cc:507] Master 127.4.237.254:42385 requested a full tablet report, sending...
I20251029 09:10:04.318312 6471 ts_manager.cc:194] Registered new tserver with Master: 53d8b343919b480f9b87abde58448cb6 (127.4.237.194:41457)
I20251029 09:10:04.318781 6471 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.194:60191
I20251029 09:10:04.319147 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 6662
I20251029 09:10:04.319239 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251029 09:10:04.320273 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.195:0
--local_ip_for_outbound_sockets=127.4.237.195
--webserver_interface=127.4.237.195
--webserver_port=0
--tserver_master_addrs=127.4.237.254:42385
--builtin_ntp_servers=127.4.237.212:44413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251029 09:10:04.403328 6793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:04.403530 6793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:04.403563 6793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:04.405112 6793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:04.405182 6793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.195
I20251029 09:10:04.406884 6793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:44413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.4.237.195
--webserver_port=0
--tserver_master_addrs=127.4.237.254:42385
--never_fsync=true
--heap_profile_path=/tmp/kudu.6793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.195
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:04.407160 6793 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:04.407406 6793 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:04.410015 6799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:04.410034 6798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:04.410184 6793 server_base.cc:1047] running on GCE node
W20251029 09:10:04.410027 6801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:04.410596 6793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:04.410867 6793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:04.412039 6793 hybrid_clock.cc:648] HybridClock initialized: now 1761729004412009 us; error 54 us; skew 500 ppm
I20251029 09:10:04.413273 6793 webserver.cc:492] Webserver started at http://127.4.237.195:36349/ using document root <none> and password file <none>
I20251029 09:10:04.413488 6793 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:04.413574 6793 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:04.413717 6793 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:04.414688 6793 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "c1693877dbce45a4aed817611a51d0af"
format_stamp: "Formatted at 2025-10-29 09:10:04 on dist-test-slave-z9gc"
I20251029 09:10:04.414991 6793 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "c1693877dbce45a4aed817611a51d0af"
format_stamp: "Formatted at 2025-10-29 09:10:04 on dist-test-slave-z9gc"
I20251029 09:10:04.416225 6793 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251029 09:10:04.417058 6807 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:04.417254 6793 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251029 09:10:04.417321 6793 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "c1693877dbce45a4aed817611a51d0af"
format_stamp: "Formatted at 2025-10-29 09:10:04 on dist-test-slave-z9gc"
I20251029 09:10:04.417385 6793 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:04.441282 6793 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:04.441578 6793 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:04.441673 6793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:04.441879 6793 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:04.442237 6793 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:04.442271 6793 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:04.442296 6793 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:04.442318 6793 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:04.448797 6793 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.195:39843
I20251029 09:10:04.448868 6920 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.195:39843 every 8 connection(s)
I20251029 09:10:04.449169 6793 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251029 09:10:04.453926 6921 heartbeater.cc:344] Connected to a master server at 127.4.237.254:42385
I20251029 09:10:04.454051 6921 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:04.454282 6921 heartbeater.cc:507] Master 127.4.237.254:42385 requested a full tablet report, sending...
I20251029 09:10:04.454730 6471 ts_manager.cc:194] Registered new tserver with Master: c1693877dbce45a4aed817611a51d0af (127.4.237.195:39843)
I20251029 09:10:04.454932 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 6793
I20251029 09:10:04.455018 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251029 09:10:04.455176 6471 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.195:40373
I20251029 09:10:04.456068 5047 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251029 09:10:04.462154 6471 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41418:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20251029 09:10:04.463547 6471 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251029 09:10:04.470649 6593 tablet_service.cc:1505] Processing CreateTablet for tablet 5062461a496647a0b6b339b7f6b03070 (DEFAULT_TABLE table=TestTable [id=444cb1e743c54b2186ac928472e7cdd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:04.471055 6593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5062461a496647a0b6b339b7f6b03070. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:04.471192 6855 tablet_service.cc:1505] Processing CreateTablet for tablet 5062461a496647a0b6b339b7f6b03070 (DEFAULT_TABLE table=TestTable [id=444cb1e743c54b2186ac928472e7cdd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:04.471479 6855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5062461a496647a0b6b339b7f6b03070. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:04.472514 6724 tablet_service.cc:1505] Processing CreateTablet for tablet 5062461a496647a0b6b339b7f6b03070 (DEFAULT_TABLE table=TestTable [id=444cb1e743c54b2186ac928472e7cdd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:04.472780 6724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5062461a496647a0b6b339b7f6b03070. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:04.473336 6935 tablet_bootstrap.cc:492] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b: Bootstrap starting.
I20251029 09:10:04.473995 6935 tablet_bootstrap.cc:654] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:04.474336 6936 tablet_bootstrap.cc:492] T 5062461a496647a0b6b339b7f6b03070 P c1693877dbce45a4aed817611a51d0af: Bootstrap starting.
I20251029 09:10:04.474347 6935 log.cc:826] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:04.475015 6935 tablet_bootstrap.cc:492] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b: No bootstrap required, opened a new log
I20251029 09:10:04.475033 6936 tablet_bootstrap.cc:654] T 5062461a496647a0b6b339b7f6b03070 P c1693877dbce45a4aed817611a51d0af: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:04.475078 6935 ts_tablet_manager.cc:1403] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251029 09:10:04.475304 6936 log.cc:826] T 5062461a496647a0b6b339b7f6b03070 P c1693877dbce45a4aed817611a51d0af: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:04.475629 6938 tablet_bootstrap.cc:492] T 5062461a496647a0b6b339b7f6b03070 P 53d8b343919b480f9b87abde58448cb6: Bootstrap starting.
I20251029 09:10:04.475962 6936 tablet_bootstrap.cc:492] T 5062461a496647a0b6b339b7f6b03070 P c1693877dbce45a4aed817611a51d0af: No bootstrap required, opened a new log
I20251029 09:10:04.476034 6936 ts_tablet_manager.cc:1403] T 5062461a496647a0b6b339b7f6b03070 P c1693877dbce45a4aed817611a51d0af: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251029 09:10:04.476473 6935 raft_consensus.cc:359] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.476595 6935 raft_consensus.cc:385] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:04.476616 6935 raft_consensus.cc:740] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83eabe35ce644ac8af2a65db5fad537b, State: Initialized, Role: FOLLOWER
I20251029 09:10:04.476699 6935 consensus_queue.cc:260] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.476936 6935 ts_tablet_manager.cc:1434] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251029 09:10:04.477301 6936 raft_consensus.cc:359] T 5062461a496647a0b6b339b7f6b03070 P c1693877dbce45a4aed817611a51d0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.477411 6936 raft_consensus.cc:385] T 5062461a496647a0b6b339b7f6b03070 P c1693877dbce45a4aed817611a51d0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:04.477442 6936 raft_consensus.cc:740] T 5062461a496647a0b6b339b7f6b03070 P c1693877dbce45a4aed817611a51d0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1693877dbce45a4aed817611a51d0af, State: Initialized, Role: FOLLOWER
I20251029 09:10:04.477548 6936 consensus_queue.cc:260] T 5062461a496647a0b6b339b7f6b03070 P c1693877dbce45a4aed817611a51d0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.477787 6936 ts_tablet_manager.cc:1434] T 5062461a496647a0b6b339b7f6b03070 P c1693877dbce45a4aed817611a51d0af: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251029 09:10:04.477851 6921 heartbeater.cc:499] Master 127.4.237.254:42385 was elected leader, sending a full tablet report...
I20251029 09:10:04.477903 6659 heartbeater.cc:499] Master 127.4.237.254:42385 was elected leader, sending a full tablet report...
I20251029 09:10:04.478892 6938 tablet_bootstrap.cc:654] T 5062461a496647a0b6b339b7f6b03070 P 53d8b343919b480f9b87abde58448cb6: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:04.479167 6938 log.cc:826] T 5062461a496647a0b6b339b7f6b03070 P 53d8b343919b480f9b87abde58448cb6: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:04.479776 6938 tablet_bootstrap.cc:492] T 5062461a496647a0b6b339b7f6b03070 P 53d8b343919b480f9b87abde58448cb6: No bootstrap required, opened a new log
I20251029 09:10:04.479831 6938 ts_tablet_manager.cc:1403] T 5062461a496647a0b6b339b7f6b03070 P 53d8b343919b480f9b87abde58448cb6: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20251029 09:10:04.480908 6938 raft_consensus.cc:359] T 5062461a496647a0b6b339b7f6b03070 P 53d8b343919b480f9b87abde58448cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.481027 6938 raft_consensus.cc:385] T 5062461a496647a0b6b339b7f6b03070 P 53d8b343919b480f9b87abde58448cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:04.481047 6938 raft_consensus.cc:740] T 5062461a496647a0b6b339b7f6b03070 P 53d8b343919b480f9b87abde58448cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53d8b343919b480f9b87abde58448cb6, State: Initialized, Role: FOLLOWER
I20251029 09:10:04.481143 6938 consensus_queue.cc:260] T 5062461a496647a0b6b339b7f6b03070 P 53d8b343919b480f9b87abde58448cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.481348 6938 ts_tablet_manager.cc:1434] T 5062461a496647a0b6b339b7f6b03070 P 53d8b343919b480f9b87abde58448cb6: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20251029 09:10:04.481417 6790 heartbeater.cc:499] Master 127.4.237.254:42385 was elected leader, sending a full tablet report...
I20251029 09:10:04.538956 6940 raft_consensus.cc:493] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251029 09:10:04.539096 6940 raft_consensus.cc:515] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.539435 6940 leader_election.cc:290] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53d8b343919b480f9b87abde58448cb6 (127.4.237.194:41457), c1693877dbce45a4aed817611a51d0af (127.4.237.195:39843)
I20251029 09:10:04.542393 6744 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5062461a496647a0b6b339b7f6b03070" candidate_uuid: "83eabe35ce644ac8af2a65db5fad537b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d8b343919b480f9b87abde58448cb6" is_pre_election: true
I20251029 09:10:04.542634 6744 raft_consensus.cc:2468] T 5062461a496647a0b6b339b7f6b03070 P 53d8b343919b480f9b87abde58448cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83eabe35ce644ac8af2a65db5fad537b in term 0.
I20251029 09:10:04.542894 6549 leader_election.cc:304] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53d8b343919b480f9b87abde58448cb6, 83eabe35ce644ac8af2a65db5fad537b; no voters:
I20251029 09:10:04.543059 6940 raft_consensus.cc:2804] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251029 09:10:04.543144 6940 raft_consensus.cc:493] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251029 09:10:04.543165 6940 raft_consensus.cc:3060] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:04.543169 6875 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5062461a496647a0b6b339b7f6b03070" candidate_uuid: "83eabe35ce644ac8af2a65db5fad537b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1693877dbce45a4aed817611a51d0af" is_pre_election: true
I20251029 09:10:04.543309 6875 raft_consensus.cc:2468] T 5062461a496647a0b6b339b7f6b03070 P c1693877dbce45a4aed817611a51d0af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83eabe35ce644ac8af2a65db5fad537b in term 0.
I20251029 09:10:04.543931 6940 raft_consensus.cc:515] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.544068 6940 leader_election.cc:290] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [CANDIDATE]: Term 1 election: Requested vote from peers 53d8b343919b480f9b87abde58448cb6 (127.4.237.194:41457), c1693877dbce45a4aed817611a51d0af (127.4.237.195:39843)
I20251029 09:10:04.544234 6875 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5062461a496647a0b6b339b7f6b03070" candidate_uuid: "83eabe35ce644ac8af2a65db5fad537b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1693877dbce45a4aed817611a51d0af"
I20251029 09:10:04.544238 6744 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5062461a496647a0b6b339b7f6b03070" candidate_uuid: "83eabe35ce644ac8af2a65db5fad537b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d8b343919b480f9b87abde58448cb6"
I20251029 09:10:04.544322 6875 raft_consensus.cc:3060] T 5062461a496647a0b6b339b7f6b03070 P c1693877dbce45a4aed817611a51d0af [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:04.544322 6744 raft_consensus.cc:3060] T 5062461a496647a0b6b339b7f6b03070 P 53d8b343919b480f9b87abde58448cb6 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:04.545169 6875 raft_consensus.cc:2468] T 5062461a496647a0b6b339b7f6b03070 P c1693877dbce45a4aed817611a51d0af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83eabe35ce644ac8af2a65db5fad537b in term 1.
I20251029 09:10:04.545169 6744 raft_consensus.cc:2468] T 5062461a496647a0b6b339b7f6b03070 P 53d8b343919b480f9b87abde58448cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83eabe35ce644ac8af2a65db5fad537b in term 1.
I20251029 09:10:04.545346 6549 leader_election.cc:304] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53d8b343919b480f9b87abde58448cb6, 83eabe35ce644ac8af2a65db5fad537b; no voters:
I20251029 09:10:04.545445 6940 raft_consensus.cc:2804] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:04.545583 6940 raft_consensus.cc:697] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [term 1 LEADER]: Becoming Leader. State: Replica: 83eabe35ce644ac8af2a65db5fad537b, State: Running, Role: LEADER
I20251029 09:10:04.545689 6940 consensus_queue.cc:237] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.546541 6470 catalog_manager.cc:5649] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b reported cstate change: term changed from 0 to 1, leader changed from <none> to 83eabe35ce644ac8af2a65db5fad537b (127.4.237.193). New cstate: current_term: 1 leader_uuid: "83eabe35ce644ac8af2a65db5fad537b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } health_report { overall_health: UNKNOWN } } }
I20251029 09:10:04.560557 5047 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251029 09:10:04.561012 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 83eabe35ce644ac8af2a65db5fad537b to finish bootstrapping
W20251029 09:10:04.563134 6791 tablet.cc:2378] T 5062461a496647a0b6b339b7f6b03070 P 53d8b343919b480f9b87abde58448cb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251029 09:10:04.564764 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 53d8b343919b480f9b87abde58448cb6 to finish bootstrapping
I20251029 09:10:04.568254 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver c1693877dbce45a4aed817611a51d0af to finish bootstrapping
I20251029 09:10:04.572221 6470 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41418:
name: "TestAnotherTable"
schema {
columns {
name: "foo"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "bar"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
comment: "comment for bar"
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "foo"
}
}
}
W20251029 09:10:04.572420 6470 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestAnotherTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251029 09:10:04.574154 6855 tablet_service.cc:1505] Processing CreateTablet for tablet b2957358e20f414fbfc97a8e0559c90f (DEFAULT_TABLE table=TestAnotherTable [id=3a630bf3143441038fdbec88886867c9]), partition=RANGE (foo) PARTITION UNBOUNDED
I20251029 09:10:04.574137 6724 tablet_service.cc:1505] Processing CreateTablet for tablet b2957358e20f414fbfc97a8e0559c90f (DEFAULT_TABLE table=TestAnotherTable [id=3a630bf3143441038fdbec88886867c9]), partition=RANGE (foo) PARTITION UNBOUNDED
I20251029 09:10:04.574316 6724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2957358e20f414fbfc97a8e0559c90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:04.574314 6855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2957358e20f414fbfc97a8e0559c90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:04.575623 6936 tablet_bootstrap.cc:492] T b2957358e20f414fbfc97a8e0559c90f P c1693877dbce45a4aed817611a51d0af: Bootstrap starting.
I20251029 09:10:04.575623 6938 tablet_bootstrap.cc:492] T b2957358e20f414fbfc97a8e0559c90f P 53d8b343919b480f9b87abde58448cb6: Bootstrap starting.
I20251029 09:10:04.575701 6593 tablet_service.cc:1505] Processing CreateTablet for tablet b2957358e20f414fbfc97a8e0559c90f (DEFAULT_TABLE table=TestAnotherTable [id=3a630bf3143441038fdbec88886867c9]), partition=RANGE (foo) PARTITION UNBOUNDED
I20251029 09:10:04.575824 6593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2957358e20f414fbfc97a8e0559c90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:04.576159 6936 tablet_bootstrap.cc:654] T b2957358e20f414fbfc97a8e0559c90f P c1693877dbce45a4aed817611a51d0af: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:04.576160 6938 tablet_bootstrap.cc:654] T b2957358e20f414fbfc97a8e0559c90f P 53d8b343919b480f9b87abde58448cb6: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:04.576637 6935 tablet_bootstrap.cc:492] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b: Bootstrap starting.
I20251029 09:10:04.576860 6938 tablet_bootstrap.cc:492] T b2957358e20f414fbfc97a8e0559c90f P 53d8b343919b480f9b87abde58448cb6: No bootstrap required, opened a new log
I20251029 09:10:04.576913 6938 ts_tablet_manager.cc:1403] T b2957358e20f414fbfc97a8e0559c90f P 53d8b343919b480f9b87abde58448cb6: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20251029 09:10:04.577126 6935 tablet_bootstrap.cc:654] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:04.577139 6938 raft_consensus.cc:359] T b2957358e20f414fbfc97a8e0559c90f P 53d8b343919b480f9b87abde58448cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.577217 6938 raft_consensus.cc:385] T b2957358e20f414fbfc97a8e0559c90f P 53d8b343919b480f9b87abde58448cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:04.577241 6938 raft_consensus.cc:740] T b2957358e20f414fbfc97a8e0559c90f P 53d8b343919b480f9b87abde58448cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53d8b343919b480f9b87abde58448cb6, State: Initialized, Role: FOLLOWER
I20251029 09:10:04.577294 6938 consensus_queue.cc:260] T b2957358e20f414fbfc97a8e0559c90f P 53d8b343919b480f9b87abde58448cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.577411 6938 ts_tablet_manager.cc:1434] T b2957358e20f414fbfc97a8e0559c90f P 53d8b343919b480f9b87abde58448cb6: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20251029 09:10:04.577672 6936 tablet_bootstrap.cc:492] T b2957358e20f414fbfc97a8e0559c90f P c1693877dbce45a4aed817611a51d0af: No bootstrap required, opened a new log
I20251029 09:10:04.577719 6936 ts_tablet_manager.cc:1403] T b2957358e20f414fbfc97a8e0559c90f P c1693877dbce45a4aed817611a51d0af: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251029 09:10:04.577870 6936 raft_consensus.cc:359] T b2957358e20f414fbfc97a8e0559c90f P c1693877dbce45a4aed817611a51d0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.577921 6936 raft_consensus.cc:385] T b2957358e20f414fbfc97a8e0559c90f P c1693877dbce45a4aed817611a51d0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:04.577943 6936 raft_consensus.cc:740] T b2957358e20f414fbfc97a8e0559c90f P c1693877dbce45a4aed817611a51d0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1693877dbce45a4aed817611a51d0af, State: Initialized, Role: FOLLOWER
I20251029 09:10:04.577996 6936 consensus_queue.cc:260] T b2957358e20f414fbfc97a8e0559c90f P c1693877dbce45a4aed817611a51d0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.578091 6936 ts_tablet_manager.cc:1434] T b2957358e20f414fbfc97a8e0559c90f P c1693877dbce45a4aed817611a51d0af: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:04.578660 6935 tablet_bootstrap.cc:492] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b: No bootstrap required, opened a new log
I20251029 09:10:04.578717 6935 ts_tablet_manager.cc:1403] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251029 09:10:04.578888 6935 raft_consensus.cc:359] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.578967 6935 raft_consensus.cc:385] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:04.578989 6935 raft_consensus.cc:740] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83eabe35ce644ac8af2a65db5fad537b, State: Initialized, Role: FOLLOWER
I20251029 09:10:04.579046 6935 consensus_queue.cc:260] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.579136 6935 ts_tablet_manager.cc:1434] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20251029 09:10:04.687270 6660 tablet.cc:2378] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251029 09:10:04.699680 6922 tablet.cc:2378] T 5062461a496647a0b6b339b7f6b03070 P c1693877dbce45a4aed817611a51d0af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251029 09:10:04.854254 6940 raft_consensus.cc:493] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251029 09:10:04.854364 6940 raft_consensus.cc:515] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.854543 6940 leader_election.cc:290] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53d8b343919b480f9b87abde58448cb6 (127.4.237.194:41457), c1693877dbce45a4aed817611a51d0af (127.4.237.195:39843)
I20251029 09:10:04.854835 6744 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b2957358e20f414fbfc97a8e0559c90f" candidate_uuid: "83eabe35ce644ac8af2a65db5fad537b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d8b343919b480f9b87abde58448cb6" is_pre_election: true
I20251029 09:10:04.854835 6875 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b2957358e20f414fbfc97a8e0559c90f" candidate_uuid: "83eabe35ce644ac8af2a65db5fad537b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1693877dbce45a4aed817611a51d0af" is_pre_election: true
I20251029 09:10:04.854951 6744 raft_consensus.cc:2468] T b2957358e20f414fbfc97a8e0559c90f P 53d8b343919b480f9b87abde58448cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83eabe35ce644ac8af2a65db5fad537b in term 0.
I20251029 09:10:04.854951 6875 raft_consensus.cc:2468] T b2957358e20f414fbfc97a8e0559c90f P c1693877dbce45a4aed817611a51d0af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83eabe35ce644ac8af2a65db5fad537b in term 0.
I20251029 09:10:04.855140 6546 leader_election.cc:304] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83eabe35ce644ac8af2a65db5fad537b, c1693877dbce45a4aed817611a51d0af; no voters:
I20251029 09:10:04.855310 6940 raft_consensus.cc:2804] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251029 09:10:04.855370 6940 raft_consensus.cc:493] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251029 09:10:04.855396 6940 raft_consensus.cc:3060] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:04.856050 6940 raft_consensus.cc:515] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.856191 6940 leader_election.cc:290] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [CANDIDATE]: Term 1 election: Requested vote from peers 53d8b343919b480f9b87abde58448cb6 (127.4.237.194:41457), c1693877dbce45a4aed817611a51d0af (127.4.237.195:39843)
I20251029 09:10:04.856389 6744 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b2957358e20f414fbfc97a8e0559c90f" candidate_uuid: "83eabe35ce644ac8af2a65db5fad537b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53d8b343919b480f9b87abde58448cb6"
I20251029 09:10:04.856397 6875 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b2957358e20f414fbfc97a8e0559c90f" candidate_uuid: "83eabe35ce644ac8af2a65db5fad537b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1693877dbce45a4aed817611a51d0af"
I20251029 09:10:04.856478 6744 raft_consensus.cc:3060] T b2957358e20f414fbfc97a8e0559c90f P 53d8b343919b480f9b87abde58448cb6 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:04.856478 6875 raft_consensus.cc:3060] T b2957358e20f414fbfc97a8e0559c90f P c1693877dbce45a4aed817611a51d0af [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:04.857277 6875 raft_consensus.cc:2468] T b2957358e20f414fbfc97a8e0559c90f P c1693877dbce45a4aed817611a51d0af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83eabe35ce644ac8af2a65db5fad537b in term 1.
I20251029 09:10:04.857313 6744 raft_consensus.cc:2468] T b2957358e20f414fbfc97a8e0559c90f P 53d8b343919b480f9b87abde58448cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83eabe35ce644ac8af2a65db5fad537b in term 1.
I20251029 09:10:04.857456 6546 leader_election.cc:304] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83eabe35ce644ac8af2a65db5fad537b, c1693877dbce45a4aed817611a51d0af; no voters:
I20251029 09:10:04.857581 6940 raft_consensus.cc:2804] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:04.857643 6940 raft_consensus.cc:697] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [term 1 LEADER]: Becoming Leader. State: Replica: 83eabe35ce644ac8af2a65db5fad537b, State: Running, Role: LEADER
I20251029 09:10:04.857730 6940 consensus_queue.cc:237] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } }
I20251029 09:10:04.858301 6471 catalog_manager.cc:5649] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b reported cstate change: term changed from 0 to 1, leader changed from <none> to 83eabe35ce644ac8af2a65db5fad537b (127.4.237.193). New cstate: current_term: 1 leader_uuid: "83eabe35ce644ac8af2a65db5fad537b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83eabe35ce644ac8af2a65db5fad537b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 34001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 } health_report { overall_health: UNKNOWN } } }
W20251029 09:10:05.011891 6952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:05.012120 6952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:05.013739 6952 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20251029 09:10:05.024361 6940 consensus_queue.cc:1048] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [LEADER]: Connected to new peer: Peer: permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251029 09:10:05.026575 6940 consensus_queue.cc:1048] T 5062461a496647a0b6b339b7f6b03070 P 83eabe35ce644ac8af2a65db5fad537b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251029 09:10:05.162091 6968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:05.162290 6968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:05.163919 6968 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
W20251029 09:10:05.311026 6978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:05.311209 6978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:05.312966 6978 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20251029 09:10:05.327661 6940 consensus_queue.cc:1048] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [LEADER]: Connected to new peer: Peer: permanent_uuid: "53d8b343919b480f9b87abde58448cb6" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 41457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251029 09:10:05.329136 6989 consensus_queue.cc:1048] T b2957358e20f414fbfc97a8e0559c90f P 83eabe35ce644ac8af2a65db5fad537b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1693877dbce45a4aed817611a51d0af" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 39843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251029 09:10:05.461266 6991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:05.461484 6991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:05.463171 6991 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20251029 09:10:05.531333 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 6531
I20251029 09:10:05.536492 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 6662
I20251029 09:10:05.541366 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 6793
I20251029 09:10:05.546588 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 6440
2025-10-29T09:10:05Z chronyd exiting
[ OK ] AdminCliTest.TestDescribeTableColumnFlags (1722 ms)
[ RUN ] AdminCliTest.TestAuthzResetCacheNotAuthorized
I20251029 09:10:05.567492 5047 test_util.cc:276] Using random seed: 2140225023
I20251029 09:10:05.568011 5047 ts_itest-base.cc:115] Starting cluster with:
I20251029 09:10:05.568050 5047 ts_itest-base.cc:116] --------------
I20251029 09:10:05.568063 5047 ts_itest-base.cc:117] 3 tablet servers
I20251029 09:10:05.568073 5047 ts_itest-base.cc:118] 3 replicas per TS
I20251029 09:10:05.568082 5047 ts_itest-base.cc:119] --------------
2025-10-29T09:10:05Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-10-29T09:10:05Z Disabled control of system clock
I20251029 09:10:05.575496 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:40317
--webserver_interface=127.4.237.254
--webserver_port=0
--builtin_ntp_servers=127.4.237.212:40615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.237.254:40317
--superuser_acl=no-such-user with env {}
W20251029 09:10:05.654920 7008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:05.655113 7008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:05.655146 7008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:05.656569 7008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251029 09:10:05.656615 7008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:05.656635 7008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251029 09:10:05.656658 7008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251029 09:10:05.658229 7008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.237.254:40317
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:40317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.4.237.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.7008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:05.658543 7008 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:05.658782 7008 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:05.661312 7014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:05.661324 7016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:05.661520 7008 server_base.cc:1047] running on GCE node
W20251029 09:10:05.661312 7013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:05.661808 7008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:05.662037 7008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:05.663172 7008 hybrid_clock.cc:648] HybridClock initialized: now 1761729005663151 us; error 34 us; skew 500 ppm
I20251029 09:10:05.664382 7008 webserver.cc:492] Webserver started at http://127.4.237.254:46421/ using document root <none> and password file <none>
I20251029 09:10:05.664609 7008 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:05.664661 7008 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:05.664790 7008 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:05.665653 7008 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "f5ddea3fc864447d87b80c624dcbee16"
format_stamp: "Formatted at 2025-10-29 09:10:05 on dist-test-slave-z9gc"
I20251029 09:10:05.665975 7008 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "f5ddea3fc864447d87b80c624dcbee16"
format_stamp: "Formatted at 2025-10-29 09:10:05 on dist-test-slave-z9gc"
I20251029 09:10:05.667213 7008 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20251029 09:10:05.667950 7022 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:05.668217 7008 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251029 09:10:05.668292 7008 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
uuid: "f5ddea3fc864447d87b80c624dcbee16"
format_stamp: "Formatted at 2025-10-29 09:10:05 on dist-test-slave-z9gc"
I20251029 09:10:05.668355 7008 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:05.682366 7008 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:05.682751 7008 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:05.682878 7008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:05.686748 7008 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.254:40317
I20251029 09:10:05.686779 7074 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.254:40317 every 8 connection(s)
I20251029 09:10:05.687148 7008 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251029 09:10:05.687779 7075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:05.689626 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 7008
I20251029 09:10:05.689731 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251029 09:10:05.691085 7075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16: Bootstrap starting.
I20251029 09:10:05.691685 7075 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:05.691969 7075 log.cc:826] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:05.692920 7075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16: No bootstrap required, opened a new log
I20251029 09:10:05.694392 7075 raft_consensus.cc:359] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5ddea3fc864447d87b80c624dcbee16" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 40317 } }
I20251029 09:10:05.694579 7075 raft_consensus.cc:385] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:05.694619 7075 raft_consensus.cc:740] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ddea3fc864447d87b80c624dcbee16, State: Initialized, Role: FOLLOWER
I20251029 09:10:05.694736 7075 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5ddea3fc864447d87b80c624dcbee16" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 40317 } }
I20251029 09:10:05.694805 7075 raft_consensus.cc:399] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:05.694836 7075 raft_consensus.cc:493] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:05.694877 7075 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:05.695577 7075 raft_consensus.cc:515] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5ddea3fc864447d87b80c624dcbee16" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 40317 } }
I20251029 09:10:05.695698 7075 leader_election.cc:304] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5ddea3fc864447d87b80c624dcbee16; no voters:
I20251029 09:10:05.695888 7075 leader_election.cc:290] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251029 09:10:05.696051 7080 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:05.696194 7075 sys_catalog.cc:565] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [sys.catalog]: configured and running, proceeding with master startup.
I20251029 09:10:05.696774 7080 raft_consensus.cc:697] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [term 1 LEADER]: Becoming Leader. State: Replica: f5ddea3fc864447d87b80c624dcbee16, State: Running, Role: LEADER
I20251029 09:10:05.696877 7080 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5ddea3fc864447d87b80c624dcbee16" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 40317 } }
I20251029 09:10:05.697284 7080 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5ddea3fc864447d87b80c624dcbee16. Latest consensus state: current_term: 1 leader_uuid: "f5ddea3fc864447d87b80c624dcbee16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5ddea3fc864447d87b80c624dcbee16" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 40317 } } }
I20251029 09:10:05.697355 7080 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:05.697742 7081 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5ddea3fc864447d87b80c624dcbee16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5ddea3fc864447d87b80c624dcbee16" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 40317 } } }
I20251029 09:10:05.698055 7081 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:05.698694 7092 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251029 09:10:05.699098 7092 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251029 09:10:05.700728 7092 catalog_manager.cc:1357] Generated new cluster ID: 186bd329b4fb4e6eba4ea9b8149f7b4d
I20251029 09:10:05.700783 7092 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251029 09:10:05.707901 7092 catalog_manager.cc:1380] Generated new certificate authority record
I20251029 09:10:05.708463 7092 catalog_manager.cc:1514] Loading token signing keys...
I20251029 09:10:05.713032 7092 catalog_manager.cc:6022] T 00000000000000000000000000000000 P f5ddea3fc864447d87b80c624dcbee16: Generated new TSK 0
I20251029 09:10:05.713227 7092 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251029 09:10:05.716032 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.193:0
--local_ip_for_outbound_sockets=127.4.237.193
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:40317
--builtin_ntp_servers=127.4.237.212:40615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251029 09:10:05.798724 7099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:05.798914 7099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:05.798938 7099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:05.800582 7099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:05.800655 7099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.193
I20251029 09:10:05.802314 7099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:40317
--never_fsync=true
--heap_profile_path=/tmp/kudu.7099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.193
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:05.802670 7099 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:05.802961 7099 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:05.805792 7104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:05.805795 7107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:05.805795 7105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:05.806200 7099 server_base.cc:1047] running on GCE node
I20251029 09:10:05.806362 7099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:05.806624 7099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:05.807832 7099 hybrid_clock.cc:648] HybridClock initialized: now 1761729005807811 us; error 34 us; skew 500 ppm
I20251029 09:10:05.809106 7099 webserver.cc:492] Webserver started at http://127.4.237.193:40733/ using document root <none> and password file <none>
I20251029 09:10:05.809331 7099 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:05.809376 7099 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:05.809494 7099 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:05.810485 7099 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "cfb255f99af84affb24be274397f24bb"
format_stamp: "Formatted at 2025-10-29 09:10:05 on dist-test-slave-z9gc"
I20251029 09:10:05.810786 7099 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "cfb255f99af84affb24be274397f24bb"
format_stamp: "Formatted at 2025-10-29 09:10:05 on dist-test-slave-z9gc"
I20251029 09:10:05.811982 7099 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:05.812754 7113 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:05.812964 7099 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:05.813041 7099 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "cfb255f99af84affb24be274397f24bb"
format_stamp: "Formatted at 2025-10-29 09:10:05 on dist-test-slave-z9gc"
I20251029 09:10:05.813107 7099 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:05.820740 7099 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:05.821013 7099 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:05.821131 7099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:05.821343 7099 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:05.821688 7099 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:05.821722 7099 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:05.821758 7099 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:05.821789 7099 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:05.827529 7099 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.193:38275
I20251029 09:10:05.827702 7226 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.193:38275 every 8 connection(s)
I20251029 09:10:05.827978 7099 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251029 09:10:05.830531 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 7099
I20251029 09:10:05.830626 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251029 09:10:05.831725 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.194:0
--local_ip_for_outbound_sockets=127.4.237.194
--webserver_interface=127.4.237.194
--webserver_port=0
--tserver_master_addrs=127.4.237.254:40317
--builtin_ntp_servers=127.4.237.212:40615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251029 09:10:05.833859 7227 heartbeater.cc:344] Connected to a master server at 127.4.237.254:40317
I20251029 09:10:05.833981 7227 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:05.834213 7227 heartbeater.cc:507] Master 127.4.237.254:40317 requested a full tablet report, sending...
I20251029 09:10:05.834795 7039 ts_manager.cc:194] Registered new tserver with Master: cfb255f99af84affb24be274397f24bb (127.4.237.193:38275)
I20251029 09:10:05.835937 7039 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.193:52969
W20251029 09:10:05.915642 7230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:05.915876 7230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:05.915901 7230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:05.917574 7230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:05.917651 7230 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.194
I20251029 09:10:05.919377 7230 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.4.237.194
--webserver_port=0
--tserver_master_addrs=127.4.237.254:40317
--never_fsync=true
--heap_profile_path=/tmp/kudu.7230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.194
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:05.919600 7230 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:05.919819 7230 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:05.922590 7236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:05.922607 7235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:05.922717 7230 server_base.cc:1047] running on GCE node
W20251029 09:10:05.922593 7238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:05.923022 7230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:05.923269 7230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:05.924420 7230 hybrid_clock.cc:648] HybridClock initialized: now 1761729005924405 us; error 28 us; skew 500 ppm
I20251029 09:10:05.925668 7230 webserver.cc:492] Webserver started at http://127.4.237.194:42995/ using document root <none> and password file <none>
I20251029 09:10:05.925882 7230 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:05.925948 7230 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:05.926074 7230 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:05.927028 7230 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "511b21c92b3f4ecbb762b00644beb01e"
format_stamp: "Formatted at 2025-10-29 09:10:05 on dist-test-slave-z9gc"
I20251029 09:10:05.927341 7230 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "511b21c92b3f4ecbb762b00644beb01e"
format_stamp: "Formatted at 2025-10-29 09:10:05 on dist-test-slave-z9gc"
I20251029 09:10:05.928486 7230 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251029 09:10:05.929217 7244 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:05.929381 7230 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251029 09:10:05.929452 7230 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "511b21c92b3f4ecbb762b00644beb01e"
format_stamp: "Formatted at 2025-10-29 09:10:05 on dist-test-slave-z9gc"
I20251029 09:10:05.929510 7230 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:05.951165 7230 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:05.951449 7230 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:05.951597 7230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:05.951840 7230 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:05.952183 7230 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:05.952231 7230 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:05.952266 7230 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:05.952339 7230 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:05.958352 7230 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.194:39659
I20251029 09:10:05.958487 7357 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.194:39659 every 8 connection(s)
I20251029 09:10:05.958832 7230 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251029 09:10:05.963646 7358 heartbeater.cc:344] Connected to a master server at 127.4.237.254:40317
I20251029 09:10:05.963765 7358 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:05.964001 7358 heartbeater.cc:507] Master 127.4.237.254:40317 requested a full tablet report, sending...
I20251029 09:10:05.964398 7039 ts_manager.cc:194] Registered new tserver with Master: 511b21c92b3f4ecbb762b00644beb01e (127.4.237.194:39659)
I20251029 09:10:05.964783 7039 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.194:58155
I20251029 09:10:05.967469 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 7230
I20251029 09:10:05.967553 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251029 09:10:05.968816 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.195:0
--local_ip_for_outbound_sockets=127.4.237.195
--webserver_interface=127.4.237.195
--webserver_port=0
--tserver_master_addrs=127.4.237.254:40317
--builtin_ntp_servers=127.4.237.212:40615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251029 09:10:06.051817 7361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:06.052042 7361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:06.052062 7361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:06.053664 7361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:06.053753 7361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.195
I20251029 09:10:06.055612 7361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.4.237.195
--webserver_port=0
--tserver_master_addrs=127.4.237.254:40317
--never_fsync=true
--heap_profile_path=/tmp/kudu.7361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.195
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:06.055891 7361 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:06.056116 7361 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:06.058949 7369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:06.058959 7367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:06.059147 7361 server_base.cc:1047] running on GCE node
W20251029 09:10:06.059176 7366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:06.059408 7361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:06.059703 7361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:06.060860 7361 hybrid_clock.cc:648] HybridClock initialized: now 1761729006060846 us; error 30 us; skew 500 ppm
I20251029 09:10:06.062099 7361 webserver.cc:492] Webserver started at http://127.4.237.195:45321/ using document root <none> and password file <none>
I20251029 09:10:06.062314 7361 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:06.062363 7361 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:06.062536 7361 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:06.063444 7361 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "6195290a2a22416c95699890e66ac4d4"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:06.063769 7361 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "6195290a2a22416c95699890e66ac4d4"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:06.065040 7361 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251029 09:10:06.065979 7375 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:06.066172 7361 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251029 09:10:06.066249 7361 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "6195290a2a22416c95699890e66ac4d4"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:06.066324 7361 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:06.082088 7361 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:06.082376 7361 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:06.082526 7361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:06.082769 7361 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:06.083077 7361 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:06.083109 7361 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:06.083145 7361 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:06.083175 7361 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:06.089071 7361 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.195:42015
I20251029 09:10:06.089130 7488 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.195:42015 every 8 connection(s)
I20251029 09:10:06.089470 7361 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251029 09:10:06.093902 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 7361
I20251029 09:10:06.094010 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251029 09:10:06.094497 7489 heartbeater.cc:344] Connected to a master server at 127.4.237.254:40317
I20251029 09:10:06.094648 7489 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:06.094907 7489 heartbeater.cc:507] Master 127.4.237.254:40317 requested a full tablet report, sending...
I20251029 09:10:06.095271 7039 ts_manager.cc:194] Registered new tserver with Master: 6195290a2a22416c95699890e66ac4d4 (127.4.237.195:42015)
I20251029 09:10:06.095630 7039 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.195:56361
I20251029 09:10:06.106452 5047 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251029 09:10:06.112077 7039 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57680:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20251029 09:10:06.113349 7039 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251029 09:10:06.120240 7292 tablet_service.cc:1505] Processing CreateTablet for tablet 29cbc32573bc4168a43e2e63803daacc (DEFAULT_TABLE table=TestTable [id=0e77c8f19c1848b695e7ee339dbd278e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:06.120240 7423 tablet_service.cc:1505] Processing CreateTablet for tablet 29cbc32573bc4168a43e2e63803daacc (DEFAULT_TABLE table=TestTable [id=0e77c8f19c1848b695e7ee339dbd278e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:06.120589 7292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29cbc32573bc4168a43e2e63803daacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:06.120589 7423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29cbc32573bc4168a43e2e63803daacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:06.123364 7504 tablet_bootstrap.cc:492] T 29cbc32573bc4168a43e2e63803daacc P 511b21c92b3f4ecbb762b00644beb01e: Bootstrap starting.
I20251029 09:10:06.123874 7159 tablet_service.cc:1505] Processing CreateTablet for tablet 29cbc32573bc4168a43e2e63803daacc (DEFAULT_TABLE table=TestTable [id=0e77c8f19c1848b695e7ee339dbd278e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:06.124061 7504 tablet_bootstrap.cc:654] T 29cbc32573bc4168a43e2e63803daacc P 511b21c92b3f4ecbb762b00644beb01e: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:06.124109 7159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29cbc32573bc4168a43e2e63803daacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:06.124274 7504 log.cc:826] T 29cbc32573bc4168a43e2e63803daacc P 511b21c92b3f4ecbb762b00644beb01e: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:06.124568 7503 tablet_bootstrap.cc:492] T 29cbc32573bc4168a43e2e63803daacc P 6195290a2a22416c95699890e66ac4d4: Bootstrap starting.
I20251029 09:10:06.124948 7504 tablet_bootstrap.cc:492] T 29cbc32573bc4168a43e2e63803daacc P 511b21c92b3f4ecbb762b00644beb01e: No bootstrap required, opened a new log
I20251029 09:10:06.125006 7504 ts_tablet_manager.cc:1403] T 29cbc32573bc4168a43e2e63803daacc P 511b21c92b3f4ecbb762b00644beb01e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251029 09:10:06.125052 7503 tablet_bootstrap.cc:654] T 29cbc32573bc4168a43e2e63803daacc P 6195290a2a22416c95699890e66ac4d4: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:06.125242 7503 log.cc:826] T 29cbc32573bc4168a43e2e63803daacc P 6195290a2a22416c95699890e66ac4d4: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:06.125775 7503 tablet_bootstrap.cc:492] T 29cbc32573bc4168a43e2e63803daacc P 6195290a2a22416c95699890e66ac4d4: No bootstrap required, opened a new log
I20251029 09:10:06.125818 7503 ts_tablet_manager.cc:1403] T 29cbc32573bc4168a43e2e63803daacc P 6195290a2a22416c95699890e66ac4d4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:06.126550 7507 tablet_bootstrap.cc:492] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb: Bootstrap starting.
I20251029 09:10:06.126742 7504 raft_consensus.cc:359] T 29cbc32573bc4168a43e2e63803daacc P 511b21c92b3f4ecbb762b00644beb01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6195290a2a22416c95699890e66ac4d4" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 42015 } } peers { permanent_uuid: "511b21c92b3f4ecbb762b00644beb01e" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 39659 } } peers { permanent_uuid: "cfb255f99af84affb24be274397f24bb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 38275 } }
I20251029 09:10:06.126963 7504 raft_consensus.cc:385] T 29cbc32573bc4168a43e2e63803daacc P 511b21c92b3f4ecbb762b00644beb01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:06.127051 7504 raft_consensus.cc:740] T 29cbc32573bc4168a43e2e63803daacc P 511b21c92b3f4ecbb762b00644beb01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511b21c92b3f4ecbb762b00644beb01e, State: Initialized, Role: FOLLOWER
I20251029 09:10:06.127228 7504 consensus_queue.cc:260] T 29cbc32573bc4168a43e2e63803daacc P 511b21c92b3f4ecbb762b00644beb01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6195290a2a22416c95699890e66ac4d4" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 42015 } } peers { permanent_uuid: "511b21c92b3f4ecbb762b00644beb01e" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 39659 } } peers { permanent_uuid: "cfb255f99af84affb24be274397f24bb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 38275 } }
I20251029 09:10:06.127367 7507 tablet_bootstrap.cc:654] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:06.127322 7503 raft_consensus.cc:359] T 29cbc32573bc4168a43e2e63803daacc P 6195290a2a22416c95699890e66ac4d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6195290a2a22416c95699890e66ac4d4" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 42015 } } peers { permanent_uuid: "511b21c92b3f4ecbb762b00644beb01e" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 39659 } } peers { permanent_uuid: "cfb255f99af84affb24be274397f24bb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 38275 } }
I20251029 09:10:06.127472 7503 raft_consensus.cc:385] T 29cbc32573bc4168a43e2e63803daacc P 6195290a2a22416c95699890e66ac4d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:06.127514 7503 raft_consensus.cc:740] T 29cbc32573bc4168a43e2e63803daacc P 6195290a2a22416c95699890e66ac4d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6195290a2a22416c95699890e66ac4d4, State: Initialized, Role: FOLLOWER
I20251029 09:10:06.127632 7504 ts_tablet_manager.cc:1434] T 29cbc32573bc4168a43e2e63803daacc P 511b21c92b3f4ecbb762b00644beb01e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20251029 09:10:06.127619 7503 consensus_queue.cc:260] T 29cbc32573bc4168a43e2e63803daacc P 6195290a2a22416c95699890e66ac4d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6195290a2a22416c95699890e66ac4d4" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 42015 } } peers { permanent_uuid: "511b21c92b3f4ecbb762b00644beb01e" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 39659 } } peers { permanent_uuid: "cfb255f99af84affb24be274397f24bb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 38275 } }
I20251029 09:10:06.127655 7507 log.cc:826] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:06.127746 7358 heartbeater.cc:499] Master 127.4.237.254:40317 was elected leader, sending a full tablet report...
I20251029 09:10:06.127842 7503 ts_tablet_manager.cc:1434] T 29cbc32573bc4168a43e2e63803daacc P 6195290a2a22416c95699890e66ac4d4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251029 09:10:06.127990 7489 heartbeater.cc:499] Master 127.4.237.254:40317 was elected leader, sending a full tablet report...
I20251029 09:10:06.128623 7507 tablet_bootstrap.cc:492] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb: No bootstrap required, opened a new log
I20251029 09:10:06.128705 7507 ts_tablet_manager.cc:1403] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251029 09:10:06.129879 7507 raft_consensus.cc:359] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6195290a2a22416c95699890e66ac4d4" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 42015 } } peers { permanent_uuid: "511b21c92b3f4ecbb762b00644beb01e" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 39659 } } peers { permanent_uuid: "cfb255f99af84affb24be274397f24bb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 38275 } }
I20251029 09:10:06.130003 7507 raft_consensus.cc:385] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:06.130024 7507 raft_consensus.cc:740] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfb255f99af84affb24be274397f24bb, State: Initialized, Role: FOLLOWER
I20251029 09:10:06.130105 7507 consensus_queue.cc:260] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6195290a2a22416c95699890e66ac4d4" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 42015 } } peers { permanent_uuid: "511b21c92b3f4ecbb762b00644beb01e" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 39659 } } peers { permanent_uuid: "cfb255f99af84affb24be274397f24bb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 38275 } }
I20251029 09:10:06.130319 7507 ts_tablet_manager.cc:1434] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251029 09:10:06.130388 7227 heartbeater.cc:499] Master 127.4.237.254:40317 was elected leader, sending a full tablet report...
W20251029 09:10:06.209370 7359 tablet.cc:2378] T 29cbc32573bc4168a43e2e63803daacc P 511b21c92b3f4ecbb762b00644beb01e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251029 09:10:06.290676 7511 raft_consensus.cc:493] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251029 09:10:06.290824 7511 raft_consensus.cc:515] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6195290a2a22416c95699890e66ac4d4" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 42015 } } peers { permanent_uuid: "511b21c92b3f4ecbb762b00644beb01e" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 39659 } } peers { permanent_uuid: "cfb255f99af84affb24be274397f24bb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 38275 } }
I20251029 09:10:06.291159 7511 leader_election.cc:290] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6195290a2a22416c95699890e66ac4d4 (127.4.237.195:42015), 511b21c92b3f4ecbb762b00644beb01e (127.4.237.194:39659)
I20251029 09:10:06.294008 7443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29cbc32573bc4168a43e2e63803daacc" candidate_uuid: "cfb255f99af84affb24be274397f24bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6195290a2a22416c95699890e66ac4d4" is_pre_election: true
I20251029 09:10:06.294159 7443 raft_consensus.cc:2468] T 29cbc32573bc4168a43e2e63803daacc P 6195290a2a22416c95699890e66ac4d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfb255f99af84affb24be274397f24bb in term 0.
I20251029 09:10:06.294335 7312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29cbc32573bc4168a43e2e63803daacc" candidate_uuid: "cfb255f99af84affb24be274397f24bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511b21c92b3f4ecbb762b00644beb01e" is_pre_election: true
I20251029 09:10:06.294382 7115 leader_election.cc:304] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6195290a2a22416c95699890e66ac4d4, cfb255f99af84affb24be274397f24bb; no voters:
I20251029 09:10:06.294525 7312 raft_consensus.cc:2468] T 29cbc32573bc4168a43e2e63803daacc P 511b21c92b3f4ecbb762b00644beb01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfb255f99af84affb24be274397f24bb in term 0.
I20251029 09:10:06.294523 7511 raft_consensus.cc:2804] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251029 09:10:06.294601 7511 raft_consensus.cc:493] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251029 09:10:06.294632 7511 raft_consensus.cc:3060] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:06.295259 7511 raft_consensus.cc:515] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6195290a2a22416c95699890e66ac4d4" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 42015 } } peers { permanent_uuid: "511b21c92b3f4ecbb762b00644beb01e" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 39659 } } peers { permanent_uuid: "cfb255f99af84affb24be274397f24bb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 38275 } }
I20251029 09:10:06.295368 7511 leader_election.cc:290] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [CANDIDATE]: Term 1 election: Requested vote from peers 6195290a2a22416c95699890e66ac4d4 (127.4.237.195:42015), 511b21c92b3f4ecbb762b00644beb01e (127.4.237.194:39659)
I20251029 09:10:06.295513 7443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29cbc32573bc4168a43e2e63803daacc" candidate_uuid: "cfb255f99af84affb24be274397f24bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6195290a2a22416c95699890e66ac4d4"
I20251029 09:10:06.295585 7443 raft_consensus.cc:3060] T 29cbc32573bc4168a43e2e63803daacc P 6195290a2a22416c95699890e66ac4d4 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:06.295591 7312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29cbc32573bc4168a43e2e63803daacc" candidate_uuid: "cfb255f99af84affb24be274397f24bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511b21c92b3f4ecbb762b00644beb01e"
I20251029 09:10:06.295670 7312 raft_consensus.cc:3060] T 29cbc32573bc4168a43e2e63803daacc P 511b21c92b3f4ecbb762b00644beb01e [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:06.296300 7312 raft_consensus.cc:2468] T 29cbc32573bc4168a43e2e63803daacc P 511b21c92b3f4ecbb762b00644beb01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfb255f99af84affb24be274397f24bb in term 1.
I20251029 09:10:06.296314 7443 raft_consensus.cc:2468] T 29cbc32573bc4168a43e2e63803daacc P 6195290a2a22416c95699890e66ac4d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfb255f99af84affb24be274397f24bb in term 1.
I20251029 09:10:06.296490 7115 leader_election.cc:304] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511b21c92b3f4ecbb762b00644beb01e, cfb255f99af84affb24be274397f24bb; no voters:
I20251029 09:10:06.296609 7511 raft_consensus.cc:2804] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:06.296756 7511 raft_consensus.cc:697] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [term 1 LEADER]: Becoming Leader. State: Replica: cfb255f99af84affb24be274397f24bb, State: Running, Role: LEADER
I20251029 09:10:06.296861 7511 consensus_queue.cc:237] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6195290a2a22416c95699890e66ac4d4" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 42015 } } peers { permanent_uuid: "511b21c92b3f4ecbb762b00644beb01e" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 39659 } } peers { permanent_uuid: "cfb255f99af84affb24be274397f24bb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 38275 } }
I20251029 09:10:06.297708 7039 catalog_manager.cc:5649] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb reported cstate change: term changed from 0 to 1, leader changed from <none> to cfb255f99af84affb24be274397f24bb (127.4.237.193). New cstate: current_term: 1 leader_uuid: "cfb255f99af84affb24be274397f24bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6195290a2a22416c95699890e66ac4d4" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "511b21c92b3f4ecbb762b00644beb01e" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 39659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfb255f99af84affb24be274397f24bb" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 38275 } health_report { overall_health: HEALTHY } } }
W20251029 09:10:06.328795 7228 tablet.cc:2378] T 29cbc32573bc4168a43e2e63803daacc P cfb255f99af84affb24be274397f24bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251029 09:10:06.340003 7490 tablet.cc:2378] T 29cbc32573bc4168a43e2e63803daacc P 6195290a2a22416c95699890e66ac4d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251029 09:10:06.344200 5047 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251029 09:10:06.344774 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver cfb255f99af84affb24be274397f24bb to finish bootstrapping
I20251029 09:10:06.348353 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 511b21c92b3f4ecbb762b00644beb01e to finish bootstrapping
I20251029 09:10:06.351841 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 6195290a2a22416c95699890e66ac4d4 to finish bootstrapping
W20251029 09:10:06.451088 7039 server_base.cc:1129] Unauthorized access attempt to method kudu.master.MasterService.RefreshAuthzCache from {username='slave'} at 127.0.0.1:57686
I20251029 09:10:06.457202 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 7099
I20251029 09:10:06.462371 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 7230
I20251029 09:10:06.467314 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 7361
I20251029 09:10:06.472172 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 7008
2025-10-29T09:10:06Z chronyd exiting
[ OK ] AdminCliTest.TestAuthzResetCacheNotAuthorized (924 ms)
[ RUN ] AdminCliTest.TestRebuildTables
I20251029 09:10:06.492537 5047 test_util.cc:276] Using random seed: 2141150066
I20251029 09:10:06.493098 5047 ts_itest-base.cc:115] Starting cluster with:
I20251029 09:10:06.493139 5047 ts_itest-base.cc:116] --------------
I20251029 09:10:06.493160 5047 ts_itest-base.cc:117] 3 tablet servers
I20251029 09:10:06.493177 5047 ts_itest-base.cc:118] 3 replicas per TS
I20251029 09:10:06.493204 5047 ts_itest-base.cc:119] --------------
2025-10-29T09:10:06Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-10-29T09:10:06Z Disabled control of system clock
I20251029 09:10:06.500485 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:37681
--webserver_interface=127.4.237.254
--webserver_port=0
--builtin_ntp_servers=127.4.237.212:40295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.237.254:37681 with env {}
W20251029 09:10:06.583091 7538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:06.583297 7538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:06.583331 7538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:06.584863 7538 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251029 09:10:06.584923 7538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:06.584946 7538 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251029 09:10:06.584969 7538 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251029 09:10:06.586655 7538 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.237.254:37681
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:37681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.4.237.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.7538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:06.586937 7538 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:06.587184 7538 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:06.589869 7543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:06.589964 7538 server_base.cc:1047] running on GCE node
W20251029 09:10:06.589871 7544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:06.589869 7546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:06.590324 7538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:06.590595 7538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:06.591737 7538 hybrid_clock.cc:648] HybridClock initialized: now 1761729006591712 us; error 43 us; skew 500 ppm
I20251029 09:10:06.592904 7538 webserver.cc:492] Webserver started at http://127.4.237.254:41123/ using document root <none> and password file <none>
I20251029 09:10:06.593092 7538 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:06.593148 7538 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:06.593320 7538 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:06.594205 7538 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "736d985132804d8ba633984b977df324"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:06.594539 7538 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "736d985132804d8ba633984b977df324"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:06.595732 7538 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251029 09:10:06.596439 7552 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:06.596618 7538 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251029 09:10:06.596679 7538 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
uuid: "736d985132804d8ba633984b977df324"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:06.596743 7538 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:06.604099 7538 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:06.604394 7538 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:06.604508 7538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:06.608428 7538 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.254:37681
I20251029 09:10:06.608459 7604 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.254:37681 every 8 connection(s)
I20251029 09:10:06.608801 7538 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251029 09:10:06.609444 7605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:06.612031 7605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324: Bootstrap starting.
I20251029 09:10:06.612619 7605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:06.612888 7605 log.cc:826] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:06.613639 7605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324: No bootstrap required, opened a new log
I20251029 09:10:06.614861 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 7538
I20251029 09:10:06.614956 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251029 09:10:06.615234 7605 raft_consensus.cc:359] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } }
I20251029 09:10:06.615376 7605 raft_consensus.cc:385] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:06.615399 7605 raft_consensus.cc:740] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736d985132804d8ba633984b977df324, State: Initialized, Role: FOLLOWER
I20251029 09:10:06.615581 7605 consensus_queue.cc:260] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } }
I20251029 09:10:06.615705 7605 raft_consensus.cc:399] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:06.615756 7605 raft_consensus.cc:493] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:06.615810 7605 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:06.616353 7605 raft_consensus.cc:515] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } }
I20251029 09:10:06.616469 7605 leader_election.cc:304] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 736d985132804d8ba633984b977df324; no voters:
I20251029 09:10:06.616624 7605 leader_election.cc:290] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251029 09:10:06.616672 7610 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:06.616794 7610 raft_consensus.cc:697] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 1 LEADER]: Becoming Leader. State: Replica: 736d985132804d8ba633984b977df324, State: Running, Role: LEADER
I20251029 09:10:06.616883 7605 sys_catalog.cc:565] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [sys.catalog]: configured and running, proceeding with master startup.
I20251029 09:10:06.616941 7610 consensus_queue.cc:237] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } }
I20251029 09:10:06.617359 7612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "736d985132804d8ba633984b977df324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } } }
I20251029 09:10:06.617503 7612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:06.617677 7612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 736d985132804d8ba633984b977df324. Latest consensus state: current_term: 1 leader_uuid: "736d985132804d8ba633984b977df324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } } }
I20251029 09:10:06.617815 7612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:06.618168 7617 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251029 09:10:06.618741 7617 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251029 09:10:06.620807 7617 catalog_manager.cc:1357] Generated new cluster ID: 960c06338ba54e7ea828eae750741089
I20251029 09:10:06.620875 7617 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251029 09:10:06.656709 7617 catalog_manager.cc:1380] Generated new certificate authority record
I20251029 09:10:06.657320 7617 catalog_manager.cc:1514] Loading token signing keys...
I20251029 09:10:06.661442 7617 catalog_manager.cc:6022] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324: Generated new TSK 0
I20251029 09:10:06.661660 7617 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251029 09:10:06.666651 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.193:0
--local_ip_for_outbound_sockets=127.4.237.193
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:37681
--builtin_ntp_servers=127.4.237.212:40295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251029 09:10:06.749702 7630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:06.749908 7630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:06.749930 7630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:06.751504 7630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:06.751590 7630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.193
I20251029 09:10:06.753168 7630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:37681
--never_fsync=true
--heap_profile_path=/tmp/kudu.7630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.193
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:06.753399 7630 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:06.753643 7630 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:06.756249 7635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:06.756306 7636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:06.756421 7638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:06.756456 7630 server_base.cc:1047] running on GCE node
I20251029 09:10:06.756660 7630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:06.756870 7630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:06.758002 7630 hybrid_clock.cc:648] HybridClock initialized: now 1761729006757990 us; error 30 us; skew 500 ppm
I20251029 09:10:06.759171 7630 webserver.cc:492] Webserver started at http://127.4.237.193:36871/ using document root <none> and password file <none>
I20251029 09:10:06.759378 7630 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:06.759429 7630 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:06.759553 7630 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:06.760435 7630 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "6072590c722340edbf91e0bbb516874b"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:06.760748 7630 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "6072590c722340edbf91e0bbb516874b"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:06.762066 7630 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20251029 09:10:06.762907 7644 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:06.763093 7630 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251029 09:10:06.763178 7630 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "6072590c722340edbf91e0bbb516874b"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:06.763244 7630 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:06.776789 7630 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:06.777069 7630 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:06.777190 7630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:06.777416 7630 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:06.777750 7630 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:06.777787 7630 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:06.777823 7630 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:06.777853 7630 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:06.783542 7630 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.193:37663
I20251029 09:10:06.783624 7757 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.193:37663 every 8 connection(s)
I20251029 09:10:06.783931 7630 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251029 09:10:06.788676 7758 heartbeater.cc:344] Connected to a master server at 127.4.237.254:37681
I20251029 09:10:06.788774 7758 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:06.788975 7758 heartbeater.cc:507] Master 127.4.237.254:37681 requested a full tablet report, sending...
I20251029 09:10:06.789443 7569 ts_manager.cc:194] Registered new tserver with Master: 6072590c722340edbf91e0bbb516874b (127.4.237.193:37663)
I20251029 09:10:06.790164 7569 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.193:33869
I20251029 09:10:06.791694 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 7630
I20251029 09:10:06.791780 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251029 09:10:06.792831 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.194:0
--local_ip_for_outbound_sockets=127.4.237.194
--webserver_interface=127.4.237.194
--webserver_port=0
--tserver_master_addrs=127.4.237.254:37681
--builtin_ntp_servers=127.4.237.212:40295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251029 09:10:06.874794 7761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:06.875005 7761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:06.875037 7761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:06.876529 7761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:06.876607 7761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.194
I20251029 09:10:06.878201 7761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.4.237.194
--webserver_port=0
--tserver_master_addrs=127.4.237.254:37681
--never_fsync=true
--heap_profile_path=/tmp/kudu.7761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.194
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:06.878504 7761 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:06.878760 7761 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:06.881539 7767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:06.881558 7766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:06.881543 7769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:06.881767 7761 server_base.cc:1047] running on GCE node
I20251029 09:10:06.882006 7761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:06.882223 7761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:06.883371 7761 hybrid_clock.cc:648] HybridClock initialized: now 1761729006883329 us; error 56 us; skew 500 ppm
I20251029 09:10:06.884621 7761 webserver.cc:492] Webserver started at http://127.4.237.194:44695/ using document root <none> and password file <none>
I20251029 09:10:06.884840 7761 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:06.884896 7761 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:06.885028 7761 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:06.885946 7761 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "c5cf56d4bc2e485ab1874041f7eca3c5"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:06.886255 7761 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "c5cf56d4bc2e485ab1874041f7eca3c5"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:06.887593 7761 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251029 09:10:06.888422 7775 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:06.888648 7761 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251029 09:10:06.888729 7761 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "c5cf56d4bc2e485ab1874041f7eca3c5"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:06.888801 7761 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:06.897231 7761 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:06.897543 7761 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:06.897691 7761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:06.897905 7761 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:06.898224 7761 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:06.898257 7761 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:06.898295 7761 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:06.898324 7761 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:06.904031 7761 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.194:34579
I20251029 09:10:06.904121 7888 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.194:34579 every 8 connection(s)
I20251029 09:10:06.904448 7761 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251029 09:10:06.907884 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 7761
I20251029 09:10:06.907994 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251029 09:10:06.909109 7889 heartbeater.cc:344] Connected to a master server at 127.4.237.254:37681
I20251029 09:10:06.909230 7889 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:06.909235 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.195:0
--local_ip_for_outbound_sockets=127.4.237.195
--webserver_interface=127.4.237.195
--webserver_port=0
--tserver_master_addrs=127.4.237.254:37681
--builtin_ntp_servers=127.4.237.212:40295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251029 09:10:06.909488 7889 heartbeater.cc:507] Master 127.4.237.254:37681 requested a full tablet report, sending...
I20251029 09:10:06.909991 7569 ts_manager.cc:194] Registered new tserver with Master: c5cf56d4bc2e485ab1874041f7eca3c5 (127.4.237.194:34579)
I20251029 09:10:06.910557 7569 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.194:54887
W20251029 09:10:06.991931 7892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:06.992126 7892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:06.992147 7892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:06.993772 7892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:06.993850 7892 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.195
I20251029 09:10:06.995582 7892 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.4.237.195
--webserver_port=0
--tserver_master_addrs=127.4.237.254:37681
--never_fsync=true
--heap_profile_path=/tmp/kudu.7892
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.195
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:06.995824 7892 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:06.996045 7892 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:06.998773 7900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:06.998821 7898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:06.998858 7897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:06.999084 7892 server_base.cc:1047] running on GCE node
I20251029 09:10:06.999286 7892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:06.999516 7892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:07.000689 7892 hybrid_clock.cc:648] HybridClock initialized: now 1761729007000670 us; error 28 us; skew 500 ppm
I20251029 09:10:07.002130 7892 webserver.cc:492] Webserver started at http://127.4.237.195:34759/ using document root <none> and password file <none>
I20251029 09:10:07.002363 7892 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:07.002440 7892 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:07.002624 7892 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:07.003592 7892 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "97aea9f830ad47529c5515f5af6f813b"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:07.003891 7892 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "97aea9f830ad47529c5515f5af6f813b"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:07.005074 7892 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251029 09:10:07.005870 7906 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:07.006059 7892 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251029 09:10:07.006129 7892 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "97aea9f830ad47529c5515f5af6f813b"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:07.006192 7892 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:07.026819 7892 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:07.027135 7892 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:07.027272 7892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:07.027518 7892 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:07.027894 7892 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:07.027937 7892 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:07.027976 7892 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:07.028013 7892 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:07.034219 7892 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.195:36319
I20251029 09:10:07.034422 8019 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.195:36319 every 8 connection(s)
I20251029 09:10:07.034696 7892 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251029 09:10:07.039528 8020 heartbeater.cc:344] Connected to a master server at 127.4.237.254:37681
I20251029 09:10:07.039666 8020 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:07.039872 8020 heartbeater.cc:507] Master 127.4.237.254:37681 requested a full tablet report, sending...
I20251029 09:10:07.040232 7569 ts_manager.cc:194] Registered new tserver with Master: 97aea9f830ad47529c5515f5af6f813b (127.4.237.195:36319)
I20251029 09:10:07.040602 7569 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.195:46805
I20251029 09:10:07.044673 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 7892
I20251029 09:10:07.044762 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251029 09:10:07.045920 5047 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251029 09:10:07.051836 5047 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251029 09:10:07.051910 5047 test_util.cc:276] Using random seed: 2141709445
I20251029 09:10:07.058280 7569 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56580:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251029 09:10:07.064618 7823 tablet_service.cc:1505] Processing CreateTablet for tablet 96abbea2b80d427c98792650e906467b (DEFAULT_TABLE table=TestTable [id=a5005b9127bd46d6b71299c33ee27c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:07.064981 7823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96abbea2b80d427c98792650e906467b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:07.067420 8035 tablet_bootstrap.cc:492] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5: Bootstrap starting.
I20251029 09:10:07.068079 8035 tablet_bootstrap.cc:654] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:07.068370 8035 log.cc:826] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:07.069109 8035 tablet_bootstrap.cc:492] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5: No bootstrap required, opened a new log
I20251029 09:10:07.069192 8035 ts_tablet_manager.cc:1403] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251029 09:10:07.070497 8035 raft_consensus.cc:359] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } }
I20251029 09:10:07.070644 8035 raft_consensus.cc:385] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:07.070665 8035 raft_consensus.cc:740] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5cf56d4bc2e485ab1874041f7eca3c5, State: Initialized, Role: FOLLOWER
I20251029 09:10:07.070760 8035 consensus_queue.cc:260] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } }
I20251029 09:10:07.070832 8035 raft_consensus.cc:399] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:07.070869 8035 raft_consensus.cc:493] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:07.070926 8035 raft_consensus.cc:3060] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:07.071538 8035 raft_consensus.cc:515] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } }
I20251029 09:10:07.071646 8035 leader_election.cc:304] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5cf56d4bc2e485ab1874041f7eca3c5; no voters:
I20251029 09:10:07.071827 8035 leader_election.cc:290] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251029 09:10:07.071894 8037 raft_consensus.cc:2804] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:07.072058 8035 ts_tablet_manager.cc:1434] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20251029 09:10:07.072096 7889 heartbeater.cc:499] Master 127.4.237.254:37681 was elected leader, sending a full tablet report...
I20251029 09:10:07.072084 8037 raft_consensus.cc:697] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 1 LEADER]: Becoming Leader. State: Replica: c5cf56d4bc2e485ab1874041f7eca3c5, State: Running, Role: LEADER
I20251029 09:10:07.072397 8037 consensus_queue.cc:237] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } }
I20251029 09:10:07.073257 7569 catalog_manager.cc:5649] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5cf56d4bc2e485ab1874041f7eca3c5 (127.4.237.194). New cstate: current_term: 1 leader_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } health_report { overall_health: HEALTHY } } }
I20251029 09:10:07.099982 5047 test_util.cc:276] Using random seed: 2141757504
I20251029 09:10:07.105113 7566 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56596:
name: "TestTable1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251029 09:10:07.110531 7692 tablet_service.cc:1505] Processing CreateTablet for tablet 561b0d512eef4a52be79ed4671e220f6 (DEFAULT_TABLE table=TestTable1 [id=95cf812313394636bde776ece14872dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:07.110894 7692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 561b0d512eef4a52be79ed4671e220f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:07.113250 8057 tablet_bootstrap.cc:492] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b: Bootstrap starting.
I20251029 09:10:07.113867 8057 tablet_bootstrap.cc:654] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:07.114143 8057 log.cc:826] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:07.114820 8057 tablet_bootstrap.cc:492] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b: No bootstrap required, opened a new log
I20251029 09:10:07.114881 8057 ts_tablet_manager.cc:1403] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251029 09:10:07.116171 8057 raft_consensus.cc:359] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } }
I20251029 09:10:07.116298 8057 raft_consensus.cc:385] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:07.116319 8057 raft_consensus.cc:740] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6072590c722340edbf91e0bbb516874b, State: Initialized, Role: FOLLOWER
I20251029 09:10:07.116421 8057 consensus_queue.cc:260] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } }
I20251029 09:10:07.116479 8057 raft_consensus.cc:399] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:07.116505 8057 raft_consensus.cc:493] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:07.116564 8057 raft_consensus.cc:3060] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:07.117112 8057 raft_consensus.cc:515] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } }
I20251029 09:10:07.117221 8057 leader_election.cc:304] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6072590c722340edbf91e0bbb516874b; no voters:
I20251029 09:10:07.117422 8057 leader_election.cc:290] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [CANDIDATE]: Term 1 election: Requested vote from peers
I20251029 09:10:07.117470 8059 raft_consensus.cc:2804] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:07.117622 8059 raft_consensus.cc:697] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 1 LEADER]: Becoming Leader. State: Replica: 6072590c722340edbf91e0bbb516874b, State: Running, Role: LEADER
I20251029 09:10:07.117642 8057 ts_tablet_manager.cc:1434] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20251029 09:10:07.117662 7758 heartbeater.cc:499] Master 127.4.237.254:37681 was elected leader, sending a full tablet report...
I20251029 09:10:07.117724 8059 consensus_queue.cc:237] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } }
I20251029 09:10:07.118696 7566 catalog_manager.cc:5649] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6072590c722340edbf91e0bbb516874b (127.4.237.193). New cstate: current_term: 1 leader_uuid: "6072590c722340edbf91e0bbb516874b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } health_report { overall_health: HEALTHY } } }
I20251029 09:10:07.134649 5047 test_util.cc:276] Using random seed: 2141792174
I20251029 09:10:07.139422 7564 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56606:
name: "TestTable2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251029 09:10:07.144521 7954 tablet_service.cc:1505] Processing CreateTablet for tablet b40ca376958f48f38e3d17d4478d6f5a (DEFAULT_TABLE table=TestTable2 [id=4dde7df7a98b4cec86991d066c1beb33]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:07.144834 7954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b40ca376958f48f38e3d17d4478d6f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:07.146991 8077 tablet_bootstrap.cc:492] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b: Bootstrap starting.
I20251029 09:10:07.147637 8077 tablet_bootstrap.cc:654] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:07.147892 8077 log.cc:826] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:07.148466 8077 tablet_bootstrap.cc:492] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b: No bootstrap required, opened a new log
I20251029 09:10:07.148519 8077 ts_tablet_manager.cc:1403] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251029 09:10:07.149624 8077 raft_consensus.cc:359] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 36319 } }
I20251029 09:10:07.149740 8077 raft_consensus.cc:385] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:07.149760 8077 raft_consensus.cc:740] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97aea9f830ad47529c5515f5af6f813b, State: Initialized, Role: FOLLOWER
I20251029 09:10:07.149853 8077 consensus_queue.cc:260] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 36319 } }
I20251029 09:10:07.149917 8077 raft_consensus.cc:399] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:07.149942 8077 raft_consensus.cc:493] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:07.149991 8077 raft_consensus.cc:3060] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:07.150573 8077 raft_consensus.cc:515] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 36319 } }
I20251029 09:10:07.150682 8077 leader_election.cc:304] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97aea9f830ad47529c5515f5af6f813b; no voters:
I20251029 09:10:07.150830 8077 leader_election.cc:290] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [CANDIDATE]: Term 1 election: Requested vote from peers
I20251029 09:10:07.150903 8079 raft_consensus.cc:2804] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:07.151041 8077 ts_tablet_manager.cc:1434] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20251029 09:10:07.151068 8020 heartbeater.cc:499] Master 127.4.237.254:37681 was elected leader, sending a full tablet report...
I20251029 09:10:07.151049 8079 raft_consensus.cc:697] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 1 LEADER]: Becoming Leader. State: Replica: 97aea9f830ad47529c5515f5af6f813b, State: Running, Role: LEADER
I20251029 09:10:07.151185 8079 consensus_queue.cc:237] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 36319 } }
I20251029 09:10:07.151919 7564 catalog_manager.cc:5649] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b reported cstate change: term changed from 0 to 1, leader changed from <none> to 97aea9f830ad47529c5515f5af6f813b (127.4.237.195). New cstate: current_term: 1 leader_uuid: "97aea9f830ad47529c5515f5af6f813b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 36319 } health_report { overall_health: HEALTHY } } }
I20251029 09:10:07.165470 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 7538
I20251029 09:10:07.610571 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 7630
I20251029 09:10:07.615844 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 7761
I20251029 09:10:07.620397 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 7892
I20251029 09:10:07.625262 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:37681
--webserver_interface=127.4.237.254
--webserver_port=41123
--builtin_ntp_servers=127.4.237.212:40295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.237.254:37681 with env {}
W20251029 09:10:07.713407 8134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:07.713651 8134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:07.713682 8134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:07.715164 8134 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251029 09:10:07.715224 8134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:07.715250 8134 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251029 09:10:07.715265 8134 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251029 09:10:07.716933 8134 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.237.254:37681
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:37681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.4.237.254
--webserver_port=41123
--never_fsync=true
--heap_profile_path=/tmp/kudu.8134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:07.717238 8134 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:07.717491 8134 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:07.720080 8140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:07.720094 8142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:07.720203 8134 server_base.cc:1047] running on GCE node
W20251029 09:10:07.720080 8139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:07.720530 8134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:07.720821 8134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:07.721954 8134 hybrid_clock.cc:648] HybridClock initialized: now 1761729007721934 us; error 37 us; skew 500 ppm
I20251029 09:10:07.723115 8134 webserver.cc:492] Webserver started at http://127.4.237.254:41123/ using document root <none> and password file <none>
I20251029 09:10:07.723330 8134 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:07.723378 8134 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:07.724617 8134 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20251029 09:10:07.725337 8148 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:07.725540 8134 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251029 09:10:07.725617 8134 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
uuid: "736d985132804d8ba633984b977df324"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:07.725917 8134 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:07.750648 8134 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:07.750962 8134 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:07.751082 8134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:07.754917 8134 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.254:37681
I20251029 09:10:07.754958 8200 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.254:37681 every 8 connection(s)
I20251029 09:10:07.755290 8134 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251029 09:10:07.756376 8201 sys_catalog.cc:263] Verifying existing consensus state
I20251029 09:10:07.756979 8201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324: Bootstrap starting.
I20251029 09:10:07.758777 8201 log.cc:826] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:07.760260 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 8134
I20251029 09:10:07.760519 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.193:37663
--local_ip_for_outbound_sockets=127.4.237.193
--tserver_master_addrs=127.4.237.254:37681
--webserver_port=36871
--webserver_interface=127.4.237.193
--builtin_ntp_servers=127.4.237.212:40295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251029 09:10:07.761063 8201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=0 applied=18 ignored=0} inserts{seen=13 ignored=0} mutations{seen=10 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251029 09:10:07.761329 8201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324: Bootstrap complete.
I20251029 09:10:07.763103 8201 raft_consensus.cc:359] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } }
I20251029 09:10:07.763305 8201 raft_consensus.cc:740] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736d985132804d8ba633984b977df324, State: Initialized, Role: FOLLOWER
I20251029 09:10:07.763451 8201 consensus_queue.cc:260] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 2.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } }
I20251029 09:10:07.763517 8201 raft_consensus.cc:399] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:07.763558 8201 raft_consensus.cc:493] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:07.763612 8201 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 2 FOLLOWER]: Advancing to term 3
I20251029 09:10:07.764611 8201 raft_consensus.cc:515] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } }
I20251029 09:10:07.764730 8201 leader_election.cc:304] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 736d985132804d8ba633984b977df324; no voters:
I20251029 09:10:07.764887 8201 leader_election.cc:290] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [CANDIDATE]: Term 3 election: Requested vote from peers
I20251029 09:10:07.764943 8205 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 3 FOLLOWER]: Leader election won for term 3
I20251029 09:10:07.765082 8205 raft_consensus.cc:697] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 3 LEADER]: Becoming Leader. State: Replica: 736d985132804d8ba633984b977df324, State: Running, Role: LEADER
I20251029 09:10:07.765149 8201 sys_catalog.cc:565] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [sys.catalog]: configured and running, proceeding with master startup.
I20251029 09:10:07.765214 8205 consensus_queue.cc:237] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 2.18, Last appended by leader: 18, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } }
I20251029 09:10:07.765487 8205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 736d985132804d8ba633984b977df324. Latest consensus state: current_term: 3 leader_uuid: "736d985132804d8ba633984b977df324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } } }
I20251029 09:10:07.765568 8205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:07.765499 8206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "736d985132804d8ba633984b977df324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } } }
I20251029 09:10:07.765615 8206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:07.766537 8209 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251029 09:10:07.767216 8209 catalog_manager.cc:679] Loaded metadata for table TestTable2 [id=4dde7df7a98b4cec86991d066c1beb33]
I20251029 09:10:07.767351 8209 catalog_manager.cc:679] Loaded metadata for table TestTable [id=a04185b81bb34b0cb90a3ddcfd1580c4]
I20251029 09:10:07.767403 8209 catalog_manager.cc:679] Loaded metadata for table TestTable1 [id=ff0846236bb04a50815a61439c99c522]
I20251029 09:10:07.767634 8209 tablet_loader.cc:96] loaded metadata for tablet 561b0d512eef4a52be79ed4671e220f6 (table TestTable1 [id=ff0846236bb04a50815a61439c99c522])
I20251029 09:10:07.767693 8209 tablet_loader.cc:96] loaded metadata for tablet 96abbea2b80d427c98792650e906467b (table TestTable [id=a04185b81bb34b0cb90a3ddcfd1580c4])
I20251029 09:10:07.767740 8209 tablet_loader.cc:96] loaded metadata for tablet b40ca376958f48f38e3d17d4478d6f5a (table TestTable2 [id=4dde7df7a98b4cec86991d066c1beb33])
I20251029 09:10:07.767774 8209 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251029 09:10:07.767887 8209 catalog_manager.cc:1269] Loaded cluster ID: 960c06338ba54e7ea828eae750741089
I20251029 09:10:07.767925 8209 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251029 09:10:07.768862 8209 catalog_manager.cc:1514] Loading token signing keys...
I20251029 09:10:07.769032 8209 catalog_manager.cc:6033] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324: Loaded TSK: 0
I20251029 09:10:07.769219 8209 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20251029 09:10:07.853433 8204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:07.853660 8204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:07.853682 8204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:07.855278 8204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:07.855348 8204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.193
I20251029 09:10:07.856959 8204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.193:37663
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.4.237.193
--webserver_port=36871
--tserver_master_addrs=127.4.237.254:37681
--never_fsync=true
--heap_profile_path=/tmp/kudu.8204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.193
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:07.857213 8204 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:07.857491 8204 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:07.860121 8227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:07.860162 8228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:07.860167 8230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:07.860358 8204 server_base.cc:1047] running on GCE node
I20251029 09:10:07.860541 8204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:07.860780 8204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:07.861924 8204 hybrid_clock.cc:648] HybridClock initialized: now 1761729007861907 us; error 36 us; skew 500 ppm
I20251029 09:10:07.863109 8204 webserver.cc:492] Webserver started at http://127.4.237.193:36871/ using document root <none> and password file <none>
I20251029 09:10:07.863322 8204 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:07.863385 8204 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:07.864593 8204 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:07.865249 8236 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:07.865449 8204 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251029 09:10:07.865538 8204 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "6072590c722340edbf91e0bbb516874b"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:07.865873 8204 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:07.892752 8204 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:07.893081 8204 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:07.893196 8204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:07.893430 8204 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:07.893924 8243 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251029 09:10:07.894873 8204 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251029 09:10:07.894922 8204 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251029 09:10:07.894948 8204 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251029 09:10:07.895480 8204 ts_tablet_manager.cc:616] Registered 1 tablets
I20251029 09:10:07.895524 8204 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20251029 09:10:07.895568 8243 tablet_bootstrap.cc:492] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b: Bootstrap starting.
I20251029 09:10:07.903512 8204 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.193:37663
I20251029 09:10:07.904013 8204 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251029 09:10:07.905647 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 8204
I20251029 09:10:07.905941 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.194:34579
--local_ip_for_outbound_sockets=127.4.237.194
--tserver_master_addrs=127.4.237.254:37681
--webserver_port=44695
--webserver_interface=127.4.237.194
--builtin_ntp_servers=127.4.237.212:40295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251029 09:10:07.907738 8243 log.cc:826] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:07.908047 8350 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.193:37663 every 8 connection(s)
I20251029 09:10:07.910239 8243 tablet_bootstrap.cc:492] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=250 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251029 09:10:07.910560 8243 tablet_bootstrap.cc:492] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b: Bootstrap complete.
I20251029 09:10:07.911679 8243 ts_tablet_manager.cc:1403] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.008s
I20251029 09:10:07.912927 8243 raft_consensus.cc:359] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } }
I20251029 09:10:07.913194 8243 raft_consensus.cc:740] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6072590c722340edbf91e0bbb516874b, State: Initialized, Role: FOLLOWER
I20251029 09:10:07.913307 8243 consensus_queue.cc:260] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } }
I20251029 09:10:07.913324 8351 heartbeater.cc:344] Connected to a master server at 127.4.237.254:37681
I20251029 09:10:07.913379 8243 raft_consensus.cc:399] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:07.913419 8243 raft_consensus.cc:493] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:07.913420 8351 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:07.913475 8243 raft_consensus.cc:3060] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 1 FOLLOWER]: Advancing to term 2
I20251029 09:10:07.913683 8351 heartbeater.cc:507] Master 127.4.237.254:37681 requested a full tablet report, sending...
I20251029 09:10:07.914539 8243 raft_consensus.cc:515] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } }
I20251029 09:10:07.915114 8243 leader_election.cc:304] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6072590c722340edbf91e0bbb516874b; no voters:
I20251029 09:10:07.915287 8243 leader_election.cc:290] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [CANDIDATE]: Term 2 election: Requested vote from peers
I20251029 09:10:07.915472 8243 ts_tablet_manager.cc:1434] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20251029 09:10:07.915548 8165 ts_manager.cc:194] Registered new tserver with Master: 6072590c722340edbf91e0bbb516874b (127.4.237.193:37663)
I20251029 09:10:07.915604 8358 raft_consensus.cc:2804] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 2 FOLLOWER]: Leader election won for term 2
I20251029 09:10:07.915701 8358 raft_consensus.cc:697] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 2 LEADER]: Becoming Leader. State: Replica: 6072590c722340edbf91e0bbb516874b, State: Running, Role: LEADER
I20251029 09:10:07.915771 8358 consensus_queue.cc:237] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } }
I20251029 09:10:07.916666 8165 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.193:36617
I20251029 09:10:07.917596 8351 heartbeater.cc:499] Master 127.4.237.254:37681 was elected leader, sending a full tablet report...
I20251029 09:10:07.917971 8165 catalog_manager.cc:5649] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b reported cstate change: term changed from 0 to 2, leader changed from <none> to 6072590c722340edbf91e0bbb516874b (127.4.237.193), VOTER 6072590c722340edbf91e0bbb516874b (127.4.237.193) added. New cstate: current_term: 2 leader_uuid: "6072590c722340edbf91e0bbb516874b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } health_report { overall_health: HEALTHY } } }
W20251029 09:10:07.920377 8165 catalog_manager.cc:5327] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 561b0d512eef4a52be79ed4671e220f6 with cas_config_opid_index -1: no extra replica candidate found for tablet 561b0d512eef4a52be79ed4671e220f6 (table TestTable1 [id=ff0846236bb04a50815a61439c99c522]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy: the total number of registered tablet servers (1) does not allow for adding an extra replica; consider bringing up more to have at least 4 tablet servers up and running
W20251029 09:10:08.007618 8355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:08.007828 8355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:08.007849 8355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:08.009253 8355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:08.009312 8355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.194
I20251029 09:10:08.010829 8355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.194:34579
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.4.237.194
--webserver_port=44695
--tserver_master_addrs=127.4.237.254:37681
--never_fsync=true
--heap_profile_path=/tmp/kudu.8355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.194
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:08.011050 8355 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:08.011258 8355 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:08.013828 8368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:08.013804 8367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:08.013833 8370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:08.014128 8355 server_base.cc:1047] running on GCE node
I20251029 09:10:08.014312 8355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:08.014546 8355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:08.015697 8355 hybrid_clock.cc:648] HybridClock initialized: now 1761729008015673 us; error 36 us; skew 500 ppm
I20251029 09:10:08.016919 8355 webserver.cc:492] Webserver started at http://127.4.237.194:44695/ using document root <none> and password file <none>
I20251029 09:10:08.017119 8355 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:08.017186 8355 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:08.018465 8355 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:08.019179 8376 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:08.019359 8355 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251029 09:10:08.019435 8355 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "c5cf56d4bc2e485ab1874041f7eca3c5"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:08.019755 8355 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:08.030719 8355 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:08.031011 8355 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:08.031132 8355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:08.031366 8355 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:08.031800 8383 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251029 09:10:08.032703 8355 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251029 09:10:08.032756 8355 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251029 09:10:08.032796 8355 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251029 09:10:08.033375 8355 ts_tablet_manager.cc:616] Registered 1 tablets
I20251029 09:10:08.033411 8355 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20251029 09:10:08.033489 8383 tablet_bootstrap.cc:492] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5: Bootstrap starting.
I20251029 09:10:08.039731 8355 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.194:34579
I20251029 09:10:08.039803 8490 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.194:34579 every 8 connection(s)
I20251029 09:10:08.040115 8355 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251029 09:10:08.044315 8383 log.cc:826] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:08.045193 8491 heartbeater.cc:344] Connected to a master server at 127.4.237.254:37681
I20251029 09:10:08.045305 8491 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:08.045506 8491 heartbeater.cc:507] Master 127.4.237.254:37681 requested a full tablet report, sending...
I20251029 09:10:08.046072 8165 ts_manager.cc:194] Registered new tserver with Master: c5cf56d4bc2e485ab1874041f7eca3c5 (127.4.237.194:34579)
I20251029 09:10:08.046530 8165 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.194:41677
I20251029 09:10:08.046793 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 8355
I20251029 09:10:08.047040 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.195:36319
--local_ip_for_outbound_sockets=127.4.237.195
--tserver_master_addrs=127.4.237.254:37681
--webserver_port=34759
--webserver_interface=127.4.237.195
--builtin_ntp_servers=127.4.237.212:40295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251029 09:10:08.052007 8383 tablet_bootstrap.cc:492] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=24 overwritten=0 applied=24 ignored=0} inserts{seen=1150 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251029 09:10:08.052424 8383 tablet_bootstrap.cc:492] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5: Bootstrap complete.
I20251029 09:10:08.053627 8383 ts_tablet_manager.cc:1403] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5: Time spent bootstrapping tablet: real 0.020s user 0.013s sys 0.004s
I20251029 09:10:08.055289 8383 raft_consensus.cc:359] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } }
I20251029 09:10:08.055624 8383 raft_consensus.cc:740] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5cf56d4bc2e485ab1874041f7eca3c5, State: Initialized, Role: FOLLOWER
I20251029 09:10:08.055753 8383 consensus_queue.cc:260] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 24, Last appended: 1.24, Last appended by leader: 24, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } }
I20251029 09:10:08.055832 8383 raft_consensus.cc:399] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:08.055886 8383 raft_consensus.cc:493] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:08.055953 8383 raft_consensus.cc:3060] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 1 FOLLOWER]: Advancing to term 2
I20251029 09:10:08.057428 8383 raft_consensus.cc:515] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } }
I20251029 09:10:08.057564 8383 leader_election.cc:304] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5cf56d4bc2e485ab1874041f7eca3c5; no voters:
I20251029 09:10:08.057754 8383 leader_election.cc:290] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20251029 09:10:08.057919 8496 raft_consensus.cc:2804] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 2 FOLLOWER]: Leader election won for term 2
I20251029 09:10:08.057977 8383 ts_tablet_manager.cc:1434] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5: Time spent starting tablet: real 0.004s user 0.007s sys 0.000s
I20251029 09:10:08.058084 8496 raft_consensus.cc:697] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 2 LEADER]: Becoming Leader. State: Replica: c5cf56d4bc2e485ab1874041f7eca3c5, State: Running, Role: LEADER
I20251029 09:10:08.058117 8491 heartbeater.cc:499] Master 127.4.237.254:37681 was elected leader, sending a full tablet report...
I20251029 09:10:08.058215 8496 consensus_queue.cc:237] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 1.24, Last appended by leader: 24, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } }
I20251029 09:10:08.059190 8165 catalog_manager.cc:5649] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 reported cstate change: term changed from 0 to 2, leader changed from <none> to c5cf56d4bc2e485ab1874041f7eca3c5 (127.4.237.194), VOTER c5cf56d4bc2e485ab1874041f7eca3c5 (127.4.237.194) added. New cstate: current_term: 2 leader_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } health_report { overall_health: HEALTHY } } }
I20251029 09:10:08.064162 8445 consensus_queue.cc:237] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 2.25, Last appended by leader: 24, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } } peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: NON_VOTER last_known_addr { host: "127.4.237.193" port: 37663 } attrs { promote: true } }
I20251029 09:10:08.064657 8496 raft_consensus.cc:2955] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 2 LEADER]: Committing config change with OpId 2.26: config changed from index -1 to 26, NON_VOTER 6072590c722340edbf91e0bbb516874b (127.4.237.193) added. New config: { opid_index: 26 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } } peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: NON_VOTER last_known_addr { host: "127.4.237.193" port: 37663 } attrs { promote: true } } }
I20251029 09:10:08.065951 8152 catalog_manager.cc:5162] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 96abbea2b80d427c98792650e906467b with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20251029 09:10:08.066102 8165 catalog_manager.cc:5649] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 reported cstate change: config changed from index -1 to 26, NON_VOTER 6072590c722340edbf91e0bbb516874b (127.4.237.193) added. New cstate: current_term: 2 leader_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" committed_config { opid_index: 26 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: NON_VOTER last_known_addr { host: "127.4.237.193" port: 37663 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251029 09:10:08.069607 8377 consensus_peers.cc:597] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 -> Peer 6072590c722340edbf91e0bbb516874b (127.4.237.193:37663): Couldn't send request to peer 6072590c722340edbf91e0bbb516874b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96abbea2b80d427c98792650e906467b. This is attempt 1: this message will repeat every 5th retry.
I20251029 09:10:08.130489 8305 consensus_queue.cc:237] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 2.7, Last appended by leader: 6, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } } peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: NON_VOTER last_known_addr { host: "127.4.237.194" port: 34579 } attrs { promote: true } }
I20251029 09:10:08.130970 8357 raft_consensus.cc:2955] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 2 LEADER]: Committing config change with OpId 2.8: config changed from index -1 to 8, NON_VOTER c5cf56d4bc2e485ab1874041f7eca3c5 (127.4.237.194) added. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } } peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: NON_VOTER last_known_addr { host: "127.4.237.194" port: 34579 } attrs { promote: true } } }
I20251029 09:10:08.131942 8149 catalog_manager.cc:5162] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 561b0d512eef4a52be79ed4671e220f6 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 4)
I20251029 09:10:08.132218 8165 catalog_manager.cc:5649] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b reported cstate change: config changed from index -1 to 8, NON_VOTER c5cf56d4bc2e485ab1874041f7eca3c5 (127.4.237.194) added. New cstate: current_term: 2 leader_uuid: "6072590c722340edbf91e0bbb516874b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: NON_VOTER last_known_addr { host: "127.4.237.194" port: 34579 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251029 09:10:08.134268 8240 consensus_peers.cc:597] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b -> Peer c5cf56d4bc2e485ab1874041f7eca3c5 (127.4.237.194:34579): Couldn't send request to peer c5cf56d4bc2e485ab1874041f7eca3c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 561b0d512eef4a52be79ed4671e220f6. This is attempt 1: this message will repeat every 5th retry.
W20251029 09:10:08.135295 8495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:08.135455 8495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:08.135489 8495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:08.136979 8495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:08.137042 8495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.195
I20251029 09:10:08.138643 8495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.195:36319
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.4.237.195
--webserver_port=34759
--tserver_master_addrs=127.4.237.254:37681
--never_fsync=true
--heap_profile_path=/tmp/kudu.8495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.195
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:08.138892 8495 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:08.139122 8495 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:08.141724 8511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:08.141662 8509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:08.141674 8508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:08.142066 8495 server_base.cc:1047] running on GCE node
I20251029 09:10:08.142241 8495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:08.142479 8495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:08.143664 8495 hybrid_clock.cc:648] HybridClock initialized: now 1761729008143650 us; error 31 us; skew 500 ppm
I20251029 09:10:08.144766 8495 webserver.cc:492] Webserver started at http://127.4.237.195:34759/ using document root <none> and password file <none>
I20251029 09:10:08.144969 8495 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:08.145033 8495 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:08.146276 8495 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:08.146997 8517 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:08.147157 8495 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:08.147230 8495 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "97aea9f830ad47529c5515f5af6f813b"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:08.147568 8495 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:08.172657 8495 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:08.172945 8495 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:08.173060 8495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:08.173257 8495 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:08.173684 8524 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251029 09:10:08.174618 8495 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251029 09:10:08.174672 8495 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251029 09:10:08.174710 8495 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251029 09:10:08.175292 8495 ts_tablet_manager.cc:616] Registered 1 tablets
I20251029 09:10:08.175330 8495 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20251029 09:10:08.175386 8524 tablet_bootstrap.cc:492] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b: Bootstrap starting.
I20251029 09:10:08.182703 8495 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.195:36319
I20251029 09:10:08.182807 8631 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.195:36319 every 8 connection(s)
I20251029 09:10:08.183095 8495 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251029 09:10:08.183784 8524 log.cc:826] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:08.187002 8524 tablet_bootstrap.cc:492] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251029 09:10:08.187309 8524 tablet_bootstrap.cc:492] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b: Bootstrap complete.
I20251029 09:10:08.188162 8524 ts_tablet_manager.cc:1403] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.003s
I20251029 09:10:08.188973 8524 raft_consensus.cc:359] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 36319 } }
I20251029 09:10:08.189167 8524 raft_consensus.cc:740] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97aea9f830ad47529c5515f5af6f813b, State: Initialized, Role: FOLLOWER
I20251029 09:10:08.189280 8524 consensus_queue.cc:260] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 36319 } }
I20251029 09:10:08.189347 8524 raft_consensus.cc:399] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:08.189392 8524 raft_consensus.cc:493] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:08.189435 8524 raft_consensus.cc:3060] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 1 FOLLOWER]: Advancing to term 2
I20251029 09:10:08.190600 8524 raft_consensus.cc:515] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 36319 } }
I20251029 09:10:08.190723 8524 leader_election.cc:304] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97aea9f830ad47529c5515f5af6f813b; no voters:
I20251029 09:10:08.191048 8524 leader_election.cc:290] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [CANDIDATE]: Term 2 election: Requested vote from peers
I20251029 09:10:08.191109 8632 heartbeater.cc:344] Connected to a master server at 127.4.237.254:37681
I20251029 09:10:08.191148 8636 raft_consensus.cc:2804] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 2 FOLLOWER]: Leader election won for term 2
I20251029 09:10:08.191211 8632 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:08.191299 8524 ts_tablet_manager.cc:1434] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20251029 09:10:08.191396 8636 raft_consensus.cc:697] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [term 2 LEADER]: Becoming Leader. State: Replica: 97aea9f830ad47529c5515f5af6f813b, State: Running, Role: LEADER
I20251029 09:10:08.191491 8632 heartbeater.cc:507] Master 127.4.237.254:37681 requested a full tablet report, sending...
I20251029 09:10:08.191524 8636 consensus_queue.cc:237] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 36319 } }
I20251029 09:10:08.192265 8165 ts_manager.cc:194] Registered new tserver with Master: 97aea9f830ad47529c5515f5af6f813b (127.4.237.195:36319)
I20251029 09:10:08.192349 8165 catalog_manager.cc:5649] T b40ca376958f48f38e3d17d4478d6f5a P 97aea9f830ad47529c5515f5af6f813b reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "97aea9f830ad47529c5515f5af6f813b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 36319 } health_report { overall_health: HEALTHY } } }
I20251029 09:10:08.192842 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 8495
I20251029 09:10:08.192834 8445 consensus_queue.cc:237] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 2.26, Last appended by leader: 24, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } } peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: NON_VOTER last_known_addr { host: "127.4.237.193" port: 37663 } attrs { promote: true } } peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: NON_VOTER last_known_addr { host: "127.4.237.195" port: 36319 } attrs { promote: true } }
I20251029 09:10:08.193168 8497 raft_consensus.cc:2955] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 [term 2 LEADER]: Committing config change with OpId 2.27: config changed from index 26 to 27, NON_VOTER 97aea9f830ad47529c5515f5af6f813b (127.4.237.195) added. New config: { opid_index: 27 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } } peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: NON_VOTER last_known_addr { host: "127.4.237.193" port: 37663 } attrs { promote: true } } peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: NON_VOTER last_known_addr { host: "127.4.237.195" port: 36319 } attrs { promote: true } } }
I20251029 09:10:08.193457 8165 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.195:34263
I20251029 09:10:08.194351 8632 heartbeater.cc:499] Master 127.4.237.254:37681 was elected leader, sending a full tablet report...
I20251029 09:10:08.194518 8152 catalog_manager.cc:5162] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 96abbea2b80d427c98792650e906467b with cas_config_opid_index 26: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 3)
W20251029 09:10:08.194543 8377 consensus_peers.cc:597] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 -> Peer 6072590c722340edbf91e0bbb516874b (127.4.237.193:37663): Couldn't send request to peer 6072590c722340edbf91e0bbb516874b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96abbea2b80d427c98792650e906467b. This is attempt 1: this message will repeat every 5th retry.
I20251029 09:10:08.194746 8165 catalog_manager.cc:5649] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 reported cstate change: config changed from index 26 to 27, NON_VOTER 97aea9f830ad47529c5515f5af6f813b (127.4.237.195) added. New cstate: current_term: 2 leader_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" committed_config { opid_index: 27 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: NON_VOTER last_known_addr { host: "127.4.237.193" port: 37663 } attrs { promote: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: NON_VOTER last_known_addr { host: "127.4.237.195" port: 36319 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251029 09:10:08.197461 5047 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
W20251029 09:10:08.198150 8377 consensus_peers.cc:597] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5 -> Peer 97aea9f830ad47529c5515f5af6f813b (127.4.237.195:36319): Couldn't send request to peer 97aea9f830ad47529c5515f5af6f813b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96abbea2b80d427c98792650e906467b. This is attempt 1: this message will repeat every 5th retry.
I20251029 09:10:08.198247 5047 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251029 09:10:08.198601 8305 consensus_queue.cc:237] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 6, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } } peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: NON_VOTER last_known_addr { host: "127.4.237.194" port: 34579 } attrs { promote: true } } peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: NON_VOTER last_known_addr { host: "127.4.237.195" port: 36319 } attrs { promote: true } }
I20251029 09:10:08.198809 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 6072590c722340edbf91e0bbb516874b to finish bootstrapping
I20251029 09:10:08.199005 8359 raft_consensus.cc:2955] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b [term 2 LEADER]: Committing config change with OpId 2.9: config changed from index 8 to 9, NON_VOTER 97aea9f830ad47529c5515f5af6f813b (127.4.237.195) added. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } } peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: NON_VOTER last_known_addr { host: "127.4.237.194" port: 34579 } attrs { promote: true } } peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: NON_VOTER last_known_addr { host: "127.4.237.195" port: 36319 } attrs { promote: true } } }
W20251029 09:10:08.199240 8240 consensus_peers.cc:597] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b -> Peer c5cf56d4bc2e485ab1874041f7eca3c5 (127.4.237.194:34579): Couldn't send request to peer c5cf56d4bc2e485ab1874041f7eca3c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 561b0d512eef4a52be79ed4671e220f6. This is attempt 1: this message will repeat every 5th retry.
I20251029 09:10:08.200111 8149 catalog_manager.cc:5162] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 561b0d512eef4a52be79ed4671e220f6 with cas_config_opid_index 8: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 2)
I20251029 09:10:08.200349 8165 catalog_manager.cc:5649] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b reported cstate change: config changed from index 8 to 9, NON_VOTER 97aea9f830ad47529c5515f5af6f813b (127.4.237.195) added. New cstate: current_term: 2 leader_uuid: "6072590c722340edbf91e0bbb516874b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: NON_VOTER last_known_addr { host: "127.4.237.194" port: 34579 } attrs { promote: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: NON_VOTER last_known_addr { host: "127.4.237.195" port: 36319 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251029 09:10:08.202124 8237 consensus_peers.cc:597] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b -> Peer 97aea9f830ad47529c5515f5af6f813b (127.4.237.195:36319): Couldn't send request to peer 97aea9f830ad47529c5515f5af6f813b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 561b0d512eef4a52be79ed4671e220f6. This is attempt 1: this message will repeat every 5th retry.
I20251029 09:10:08.203575 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver c5cf56d4bc2e485ab1874041f7eca3c5 to finish bootstrapping
I20251029 09:10:08.206905 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 97aea9f830ad47529c5515f5af6f813b to finish bootstrapping
I20251029 09:10:08.238935 8566 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251029 09:10:08.238937 8425 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251029 09:10:08.239112 8285 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
736d985132804d8ba633984b977df324 | 127.4.237.254:37681 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.4.237.212:40295 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
6072590c722340edbf91e0bbb516874b | 127.4.237.193:37663 | HEALTHY | <none> | 1 | 0
97aea9f830ad47529c5515f5af6f813b | 127.4.237.195:36319 | HEALTHY | <none> | 1 | 0
c5cf56d4bc2e485ab1874041f7eca3c5 | 127.4.237.194:34579 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.4.237.193 | experimental | 127.4.237.193:37663
local_ip_for_outbound_sockets | 127.4.237.194 | experimental | 127.4.237.194:34579
local_ip_for_outbound_sockets | 127.4.237.195 | experimental | 127.4.237.195:36319
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.4.237.193:37663
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.4.237.194:34579
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.4.237.195:36319
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.4.237.212:40295 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
TestTable1 | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
TestTable2 | 1 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 2
First Quartile | 2
Median | 2
Third Quartile | 3
Maximum | 3
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 3
Tablets | 3
Replicas | 7
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20251029 09:10:08.250775 5047 log_verifier.cc:126] Checking tablet 561b0d512eef4a52be79ed4671e220f6
I20251029 09:10:08.258203 5047 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 561b0d512eef4a52be79ed4671e220f6
I20251029 09:10:08.258291 5047 log_verifier.cc:126] Checking tablet 96abbea2b80d427c98792650e906467b
I20251029 09:10:08.265378 5047 log_verifier.cc:177] Verified matching terms for 27 ops in tablet 96abbea2b80d427c98792650e906467b
I20251029 09:10:08.265450 5047 log_verifier.cc:126] Checking tablet b40ca376958f48f38e3d17d4478d6f5a
I20251029 09:10:08.271991 5047 log_verifier.cc:177] Verified matching terms for 10 ops in tablet b40ca376958f48f38e3d17d4478d6f5a
I20251029 09:10:08.272130 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 8134
I20251029 09:10:08.278915 5047 minidump.cc:252] Setting minidump size limit to 20M
I20251029 09:10:08.279206 5047 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:08.279351 5047 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:08.281806 8671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:08.281942 8669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:08.282055 8668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:08.282017 5047 server_base.cc:1047] running on GCE node
I20251029 09:10:08.282369 5047 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251029 09:10:08.282445 5047 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251029 09:10:08.282486 5047 hybrid_clock.cc:648] HybridClock initialized: now 1761729008282485 us; error 0 us; skew 500 ppm
I20251029 09:10:08.283316 5047 webserver.cc:492] Webserver started at http://0.0.0.0:41001/ using document root <none> and password file <none>
I20251029 09:10:08.283514 5047 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:08.283618 5047 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:08.284582 5047 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20251029 09:10:08.285250 8676 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:08.285439 5047 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251029 09:10:08.285573 5047 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
uuid: "736d985132804d8ba633984b977df324"
format_stamp: "Formatted at 2025-10-29 09:10:06 on dist-test-slave-z9gc"
I20251029 09:10:08.285821 5047 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:08.293232 5047 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:08.293507 5047 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:08.293639 5047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:08.294744 5047 sys_catalog.cc:263] Verifying existing consensus state
W20251029 09:10:08.295149 5047 sys_catalog.cc:243] For a single master config, on-disk Raft master: 127.4.237.254:37681 exists but no master address supplied!
I20251029 09:10:08.295815 5047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324: Bootstrap starting.
I20251029 09:10:08.303519 5047 log.cc:826] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:08.306722 5047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=13 ignored=0} mutations{seen=17 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251029 09:10:08.307067 5047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324: Bootstrap complete.
I20251029 09:10:08.308951 5047 raft_consensus.cc:359] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } }
I20251029 09:10:08.309093 5047 raft_consensus.cc:740] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736d985132804d8ba633984b977df324, State: Initialized, Role: FOLLOWER
I20251029 09:10:08.309199 5047 consensus_queue.cc:260] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 3.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } }
I20251029 09:10:08.309257 5047 raft_consensus.cc:399] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 3 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:08.309309 5047 raft_consensus.cc:493] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 3 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:08.309363 5047 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 3 FOLLOWER]: Advancing to term 4
I20251029 09:10:08.310316 5047 raft_consensus.cc:515] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } }
I20251029 09:10:08.310494 5047 leader_election.cc:304] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 736d985132804d8ba633984b977df324; no voters:
I20251029 09:10:08.310698 5047 leader_election.cc:290] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [CANDIDATE]: Term 4 election: Requested vote from peers
I20251029 09:10:08.310770 8683 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 4 FOLLOWER]: Leader election won for term 4
I20251029 09:10:08.310943 8683 raft_consensus.cc:697] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 4 LEADER]: Becoming Leader. State: Replica: 736d985132804d8ba633984b977df324, State: Running, Role: LEADER
I20251029 09:10:08.311048 8683 consensus_queue.cc:237] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 3.26, Last appended by leader: 26, Current term: 4, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } }
I20251029 09:10:08.311335 8684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 leader_uuid: "736d985132804d8ba633984b977df324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } } }
I20251029 09:10:08.311383 8685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 736d985132804d8ba633984b977df324. Latest consensus state: current_term: 4 leader_uuid: "736d985132804d8ba633984b977df324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "736d985132804d8ba633984b977df324" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 37681 } } }
I20251029 09:10:08.311439 8684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:08.311450 8685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:08.313213 5047 tablet_replica.cc:333] stopping tablet replica
I20251029 09:10:08.313290 5047 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 4 LEADER]: Raft consensus shutting down.
I20251029 09:10:08.313342 5047 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 736d985132804d8ba633984b977df324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251029 09:10:08.313756 5047 master.cc:561] Master@0.0.0.0:7051 shutting down...
W20251029 09:10:08.313868 5047 acceptor_pool.cc:194] Could not shut down acceptor socket on 0.0.0.0:7051: Network error: shutdown error: Transport endpoint is not connected (error 107)
I20251029 09:10:08.324746 5047 master.cc:583] Master@0.0.0.0:7051 shutdown complete.
I20251029 09:10:08.584604 8733 ts_tablet_manager.cc:933] T 561b0d512eef4a52be79ed4671e220f6 P c5cf56d4bc2e485ab1874041f7eca3c5: Initiating tablet copy from peer 6072590c722340edbf91e0bbb516874b (127.4.237.193:37663)
I20251029 09:10:08.584815 8733 tablet_copy_client.cc:323] T 561b0d512eef4a52be79ed4671e220f6 P c5cf56d4bc2e485ab1874041f7eca3c5: tablet copy: Beginning tablet copy session from remote peer at address 127.4.237.193:37663
I20251029 09:10:08.585207 8325 tablet_copy_service.cc:140] P 6072590c722340edbf91e0bbb516874b: Received BeginTabletCopySession request for tablet 561b0d512eef4a52be79ed4671e220f6 from peer c5cf56d4bc2e485ab1874041f7eca3c5 ({username='slave'} at 127.4.237.194:45619)
I20251029 09:10:08.585284 8325 tablet_copy_service.cc:161] P 6072590c722340edbf91e0bbb516874b: Beginning new tablet copy session on tablet 561b0d512eef4a52be79ed4671e220f6 from peer c5cf56d4bc2e485ab1874041f7eca3c5 at {username='slave'} at 127.4.237.194:45619: session id = c5cf56d4bc2e485ab1874041f7eca3c5-561b0d512eef4a52be79ed4671e220f6
I20251029 09:10:08.585835 8325 tablet_copy_source_session.cc:215] T 561b0d512eef4a52be79ed4671e220f6 P 6072590c722340edbf91e0bbb516874b: Tablet Copy: opened 0 blocks and 1 log segments
I20251029 09:10:08.586508 8733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 561b0d512eef4a52be79ed4671e220f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:08.587829 8733 tablet_copy_client.cc:806] T 561b0d512eef4a52be79ed4671e220f6 P c5cf56d4bc2e485ab1874041f7eca3c5: tablet copy: Starting download of 0 data blocks...
I20251029 09:10:08.587962 8733 tablet_copy_client.cc:670] T 561b0d512eef4a52be79ed4671e220f6 P c5cf56d4bc2e485ab1874041f7eca3c5: tablet copy: Starting download of 1 WAL segments...
I20251029 09:10:08.588872 8733 tablet_copy_client.cc:538] T 561b0d512eef4a52be79ed4671e220f6 P c5cf56d4bc2e485ab1874041f7eca3c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251029 09:10:08.589449 8733 tablet_bootstrap.cc:492] T 561b0d512eef4a52be79ed4671e220f6 P c5cf56d4bc2e485ab1874041f7eca3c5: Bootstrap starting.
I20251029 09:10:08.591563 8733 tablet_bootstrap.cc:492] T 561b0d512eef4a52be79ed4671e220f6 P c5cf56d4bc2e485ab1874041f7eca3c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=250 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251029 09:10:08.591753 8733 tablet_bootstrap.cc:492] T 561b0d512eef4a52be79ed4671e220f6 P c5cf56d4bc2e485ab1874041f7eca3c5: Bootstrap complete.
I20251029 09:10:08.591856 8733 ts_tablet_manager.cc:1403] T 561b0d512eef4a52be79ed4671e220f6 P c5cf56d4bc2e485ab1874041f7eca3c5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251029 09:10:08.591984 8733 raft_consensus.cc:359] T 561b0d512eef4a52be79ed4671e220f6 P c5cf56d4bc2e485ab1874041f7eca3c5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } } peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: NON_VOTER last_known_addr { host: "127.4.237.194" port: 34579 } attrs { promote: true } } peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: NON_VOTER last_known_addr { host: "127.4.237.195" port: 36319 } attrs { promote: true } }
I20251029 09:10:08.592047 8733 raft_consensus.cc:740] T 561b0d512eef4a52be79ed4671e220f6 P c5cf56d4bc2e485ab1874041f7eca3c5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: c5cf56d4bc2e485ab1874041f7eca3c5, State: Initialized, Role: LEARNER
I20251029 09:10:08.592080 8733 consensus_queue.cc:260] T 561b0d512eef4a52be79ed4671e220f6 P c5cf56d4bc2e485ab1874041f7eca3c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 2.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 37663 } } peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: NON_VOTER last_known_addr { host: "127.4.237.194" port: 34579 } attrs { promote: true } } peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: NON_VOTER last_known_addr { host: "127.4.237.195" port: 36319 } attrs { promote: true } }
I20251029 09:10:08.592196 8733 ts_tablet_manager.cc:1434] T 561b0d512eef4a52be79ed4671e220f6 P c5cf56d4bc2e485ab1874041f7eca3c5: Time spent starting tablet: real 0.000s user 0.000s sys 0.002s
I20251029 09:10:08.592502 8325 tablet_copy_service.cc:342] P 6072590c722340edbf91e0bbb516874b: Request end of tablet copy session c5cf56d4bc2e485ab1874041f7eca3c5-561b0d512eef4a52be79ed4671e220f6 received from {username='slave'} at 127.4.237.194:45619
I20251029 09:10:08.592588 8325 tablet_copy_service.cc:434] P 6072590c722340edbf91e0bbb516874b: ending tablet copy session c5cf56d4bc2e485ab1874041f7eca3c5-561b0d512eef4a52be79ed4671e220f6 on tablet 561b0d512eef4a52be79ed4671e220f6 with peer c5cf56d4bc2e485ab1874041f7eca3c5
W20251029 09:10:08.592765 8491 heartbeater.cc:646] Failed to heartbeat to 127.4.237.254:37681 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.237.254:37681: connect: Connection refused (error 111)
I20251029 09:10:08.695425 8736 ts_tablet_manager.cc:933] T 96abbea2b80d427c98792650e906467b P 97aea9f830ad47529c5515f5af6f813b: Initiating tablet copy from peer c5cf56d4bc2e485ab1874041f7eca3c5 (127.4.237.194:34579)
I20251029 09:10:08.695642 8736 tablet_copy_client.cc:323] T 96abbea2b80d427c98792650e906467b P 97aea9f830ad47529c5515f5af6f813b: tablet copy: Beginning tablet copy session from remote peer at address 127.4.237.194:34579
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tools/kudu-admin-test.cc:3916: Failure
Value of: stdout2
Expected: has substring "Rebuilt from 3 replicas, of which 0 had errors"
Actual: "Rebuild Report\nTablet Servers\n address | status\n---------------------+--------\n 127.4.237.193:37663 | OK\n 127.4.237.194:34579 | OK\n 127.4.237.195:36319 | OK\nRebuilt from 3 tablet servers, of which 0 had errors\n\nReplicas\n table | tablet | tablet server | status\n-----------+----------------------------------+---------------------+--------\n TestTable | 96abbea2b80d427c98792650e906467b | 127.4.237.194:34579 | OK\nRebuilt from 1 replicas, of which 0 had errors\n"
I20251029 09:10:08.698699 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 8204
I20251029 09:10:08.698994 8465 tablet_copy_service.cc:140] P c5cf56d4bc2e485ab1874041f7eca3c5: Received BeginTabletCopySession request for tablet 96abbea2b80d427c98792650e906467b from peer 97aea9f830ad47529c5515f5af6f813b ({username='slave'} at 127.4.237.195:40033)
I20251029 09:10:08.699070 8465 tablet_copy_service.cc:161] P c5cf56d4bc2e485ab1874041f7eca3c5: Beginning new tablet copy session on tablet 96abbea2b80d427c98792650e906467b from peer 97aea9f830ad47529c5515f5af6f813b at {username='slave'} at 127.4.237.195:40033: session id = 97aea9f830ad47529c5515f5af6f813b-96abbea2b80d427c98792650e906467b
I20251029 09:10:08.699863 8465 tablet_copy_source_session.cc:215] T 96abbea2b80d427c98792650e906467b P c5cf56d4bc2e485ab1874041f7eca3c5: Tablet Copy: opened 0 blocks and 1 log segments
I20251029 09:10:08.700489 8736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96abbea2b80d427c98792650e906467b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:08.701776 8736 tablet_copy_client.cc:806] T 96abbea2b80d427c98792650e906467b P 97aea9f830ad47529c5515f5af6f813b: tablet copy: Starting download of 0 data blocks...
I20251029 09:10:08.701907 8736 tablet_copy_client.cc:670] T 96abbea2b80d427c98792650e906467b P 97aea9f830ad47529c5515f5af6f813b: tablet copy: Starting download of 1 WAL segments...
I20251029 09:10:08.703033 8736 tablet_copy_client.cc:538] T 96abbea2b80d427c98792650e906467b P 97aea9f830ad47529c5515f5af6f813b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251029 09:10:08.703641 8736 tablet_bootstrap.cc:492] T 96abbea2b80d427c98792650e906467b P 97aea9f830ad47529c5515f5af6f813b: Bootstrap starting.
I20251029 09:10:08.705797 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 8355
I20251029 09:10:08.709568 8736 tablet_bootstrap.cc:492] T 96abbea2b80d427c98792650e906467b P 97aea9f830ad47529c5515f5af6f813b: Bootstrap replayed 1/1 log segments. Stats: ops{read=27 overwritten=0 applied=27 ignored=0} inserts{seen=1150 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251029 09:10:08.709849 8736 tablet_bootstrap.cc:492] T 96abbea2b80d427c98792650e906467b P 97aea9f830ad47529c5515f5af6f813b: Bootstrap complete.
I20251029 09:10:08.710000 8736 ts_tablet_manager.cc:1403] T 96abbea2b80d427c98792650e906467b P 97aea9f830ad47529c5515f5af6f813b: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20251029 09:10:08.710152 8736 raft_consensus.cc:359] T 96abbea2b80d427c98792650e906467b P 97aea9f830ad47529c5515f5af6f813b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 27 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } } peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: NON_VOTER last_known_addr { host: "127.4.237.193" port: 37663 } attrs { promote: true } } peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: NON_VOTER last_known_addr { host: "127.4.237.195" port: 36319 } attrs { promote: true } }
I20251029 09:10:08.710218 8736 raft_consensus.cc:740] T 96abbea2b80d427c98792650e906467b P 97aea9f830ad47529c5515f5af6f813b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 97aea9f830ad47529c5515f5af6f813b, State: Initialized, Role: LEARNER
I20251029 09:10:08.710261 8736 consensus_queue.cc:260] T 96abbea2b80d427c98792650e906467b P 97aea9f830ad47529c5515f5af6f813b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 27, Last appended: 2.27, Last appended by leader: 27, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 27 OBSOLETE_local: true peers { permanent_uuid: "c5cf56d4bc2e485ab1874041f7eca3c5" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 34579 } } peers { permanent_uuid: "6072590c722340edbf91e0bbb516874b" member_type: NON_VOTER last_known_addr { host: "127.4.237.193" port: 37663 } attrs { promote: true } } peers { permanent_uuid: "97aea9f830ad47529c5515f5af6f813b" member_type: NON_VOTER last_known_addr { host: "127.4.237.195" port: 36319 } attrs { promote: true } }
I20251029 09:10:08.710474 8736 ts_tablet_manager.cc:1434] T 96abbea2b80d427c98792650e906467b P 97aea9f830ad47529c5515f5af6f813b: Time spent starting tablet: real 0.000s user 0.000s sys 0.004s
W20251029 09:10:08.710770 8521 connection.cc:537] client connection to 127.4.237.194:34579 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251029 09:10:08.710906 8736 tablet_copy_client.cc:1130] T 96abbea2b80d427c98792650e906467b P 97aea9f830ad47529c5515f5af6f813b: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251029 09:10:08.710937 8632 heartbeater.cc:646] Failed to heartbeat to 127.4.237.254:37681 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.237.254:37681: connect: Connection refused (error 111)
I20251029 09:10:08.711133 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 8495
2025-10-29T09:10:08Z chronyd exiting
I20251029 09:10:08.727932 5047 test_util.cc:183] -----------------------------------------------
I20251029 09:10:08.728015 5047 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1761728996740924-5047-0
[ FAILED ] AdminCliTest.TestRebuildTables (2236 ms)
[----------] 5 tests from AdminCliTest (11982 ms total)
[----------] 1 test from EnableKudu1097AndDownTS/MoveTabletParamTest
[ RUN ] EnableKudu1097AndDownTS/MoveTabletParamTest.Test/4
I20251029 09:10:08.728464 5047 test_util.cc:276] Using random seed: 2143385998
I20251029 09:10:08.728988 5047 ts_itest-base.cc:115] Starting cluster with:
I20251029 09:10:08.729028 5047 ts_itest-base.cc:116] --------------
I20251029 09:10:08.729048 5047 ts_itest-base.cc:117] 5 tablet servers
I20251029 09:10:08.729066 5047 ts_itest-base.cc:118] 3 replicas per TS
I20251029 09:10:08.729092 5047 ts_itest-base.cc:119] --------------
2025-10-29T09:10:08Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-10-29T09:10:08Z Disabled control of system clock
I20251029 09:10:08.736979 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:41375
--webserver_interface=127.4.237.254
--webserver_port=0
--builtin_ntp_servers=127.4.237.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.237.254:41375
--raft_prepare_replacement_before_eviction=true with env {}
W20251029 09:10:08.818293 8748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:08.818547 8748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:08.818575 8748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:08.820050 8748 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251029 09:10:08.820094 8748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251029 09:10:08.820108 8748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:08.820122 8748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251029 09:10:08.820133 8748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251029 09:10:08.821796 8748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.237.254:41375
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:41375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.4.237.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.8748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:08.822016 8748 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:08.822225 8748 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:08.824894 8756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:08.824889 8754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:08.824894 8753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:08.825083 8748 server_base.cc:1047] running on GCE node
I20251029 09:10:08.825337 8748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:08.825565 8748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:08.826699 8748 hybrid_clock.cc:648] HybridClock initialized: now 1761729008826685 us; error 32 us; skew 500 ppm
I20251029 09:10:08.827976 8748 webserver.cc:492] Webserver started at http://127.4.237.254:43561/ using document root <none> and password file <none>
I20251029 09:10:08.828193 8748 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:08.828238 8748 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:08.828359 8748 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:08.829298 8748 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "d9723c8c82d748299b48f641fb4012e3"
format_stamp: "Formatted at 2025-10-29 09:10:08 on dist-test-slave-z9gc"
I20251029 09:10:08.829615 8748 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "d9723c8c82d748299b48f641fb4012e3"
format_stamp: "Formatted at 2025-10-29 09:10:08 on dist-test-slave-z9gc"
I20251029 09:10:08.830910 8748 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20251029 09:10:08.831750 8762 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:08.831940 8748 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251029 09:10:08.832016 8748 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
uuid: "d9723c8c82d748299b48f641fb4012e3"
format_stamp: "Formatted at 2025-10-29 09:10:08 on dist-test-slave-z9gc"
I20251029 09:10:08.832077 8748 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:08.841706 8748 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:08.842006 8748 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:08.842118 8748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:08.845855 8748 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.254:41375
I20251029 09:10:08.845896 8814 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.254:41375 every 8 connection(s)
I20251029 09:10:08.846217 8748 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251029 09:10:08.846833 8815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:08.849074 8815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3: Bootstrap starting.
I20251029 09:10:08.849663 8815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:08.849922 8815 log.cc:826] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:08.850582 8815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3: No bootstrap required, opened a new log
I20251029 09:10:08.851398 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 8748
I20251029 09:10:08.851536 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251029 09:10:08.852149 8815 raft_consensus.cc:359] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9723c8c82d748299b48f641fb4012e3" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 41375 } }
I20251029 09:10:08.852312 8815 raft_consensus.cc:385] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:08.852348 8815 raft_consensus.cc:740] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9723c8c82d748299b48f641fb4012e3, State: Initialized, Role: FOLLOWER
I20251029 09:10:08.852449 8815 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9723c8c82d748299b48f641fb4012e3" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 41375 } }
I20251029 09:10:08.852510 8815 raft_consensus.cc:399] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:08.852535 8815 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:08.852584 8815 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:08.853114 8815 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9723c8c82d748299b48f641fb4012e3" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 41375 } }
I20251029 09:10:08.853206 8815 leader_election.cc:304] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9723c8c82d748299b48f641fb4012e3; no voters:
I20251029 09:10:08.853405 8815 leader_election.cc:290] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251029 09:10:08.853470 8820 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:08.853626 8815 sys_catalog.cc:565] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [sys.catalog]: configured and running, proceeding with master startup.
I20251029 09:10:08.853662 8820 raft_consensus.cc:697] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [term 1 LEADER]: Becoming Leader. State: Replica: d9723c8c82d748299b48f641fb4012e3, State: Running, Role: LEADER
I20251029 09:10:08.853893 8820 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9723c8c82d748299b48f641fb4012e3" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 41375 } }
I20251029 09:10:08.854202 8821 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9723c8c82d748299b48f641fb4012e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9723c8c82d748299b48f641fb4012e3" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 41375 } } }
I20251029 09:10:08.854256 8821 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:08.854385 8822 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9723c8c82d748299b48f641fb4012e3. Latest consensus state: current_term: 1 leader_uuid: "d9723c8c82d748299b48f641fb4012e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9723c8c82d748299b48f641fb4012e3" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 41375 } } }
I20251029 09:10:08.854481 8822 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:08.854947 8827 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251029 09:10:08.855690 8827 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251029 09:10:08.857091 8827 catalog_manager.cc:1357] Generated new cluster ID: 7b4efa197ef147d59f1f157f4ed5df33
I20251029 09:10:08.857146 8827 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251029 09:10:08.872077 8827 catalog_manager.cc:1380] Generated new certificate authority record
I20251029 09:10:08.872639 8827 catalog_manager.cc:1514] Loading token signing keys...
I20251029 09:10:08.875582 8827 catalog_manager.cc:6022] T 00000000000000000000000000000000 P d9723c8c82d748299b48f641fb4012e3: Generated new TSK 0
I20251029 09:10:08.875756 8827 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251029 09:10:08.878005 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.193:0
--local_ip_for_outbound_sockets=127.4.237.193
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:41375
--builtin_ntp_servers=127.4.237.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20251029 09:10:08.959501 8839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:08.959709 8839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:08.959731 8839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:08.961304 8839 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251029 09:10:08.961365 8839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:08.961391 8839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.193
I20251029 09:10:08.963011 8839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:41375
--never_fsync=true
--heap_profile_path=/tmp/kudu.8839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.193
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:08.963248 8839 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:08.963524 8839 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:08.966226 8845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:08.966220 8844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:08.966217 8847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:08.966511 8839 server_base.cc:1047] running on GCE node
I20251029 09:10:08.966820 8839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:08.967032 8839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:08.968199 8839 hybrid_clock.cc:648] HybridClock initialized: now 1761729008968173 us; error 43 us; skew 500 ppm
I20251029 09:10:08.969460 8839 webserver.cc:492] Webserver started at http://127.4.237.193:44045/ using document root <none> and password file <none>
I20251029 09:10:08.969691 8839 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:08.969743 8839 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:08.969882 8839 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:08.971012 8839 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8"
format_stamp: "Formatted at 2025-10-29 09:10:08 on dist-test-slave-z9gc"
I20251029 09:10:08.971354 8839 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8"
format_stamp: "Formatted at 2025-10-29 09:10:08 on dist-test-slave-z9gc"
I20251029 09:10:08.972681 8839 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251029 09:10:08.973532 8853 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:08.973881 8839 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:08.973966 8839 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8"
format_stamp: "Formatted at 2025-10-29 09:10:08 on dist-test-slave-z9gc"
I20251029 09:10:08.974035 8839 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:08.987730 8839 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:08.988011 8839 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:08.988129 8839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:08.988345 8839 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:08.988670 8839 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:08.988703 8839 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:08.988741 8839 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:08.988772 8839 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:08.994727 8839 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.193:35205
I20251029 09:10:08.994815 8966 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.193:35205 every 8 connection(s)
I20251029 09:10:08.995123 8839 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251029 09:10:09.000092 8967 heartbeater.cc:344] Connected to a master server at 127.4.237.254:41375
I20251029 09:10:09.000233 8967 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:09.000463 8967 heartbeater.cc:507] Master 127.4.237.254:41375 requested a full tablet report, sending...
I20251029 09:10:09.001005 8779 ts_manager.cc:194] Registered new tserver with Master: 6d65cfcf68864c16b4d1d4c2aa536eb8 (127.4.237.193:35205)
I20251029 09:10:09.001654 8779 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.193:58567
I20251029 09:10:09.003366 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 8839
I20251029 09:10:09.003477 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251029 09:10:09.004714 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.194:0
--local_ip_for_outbound_sockets=127.4.237.194
--webserver_interface=127.4.237.194
--webserver_port=0
--tserver_master_addrs=127.4.237.254:41375
--builtin_ntp_servers=127.4.237.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20251029 09:10:09.087035 8970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:09.087247 8970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:09.087284 8970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:09.088887 8970 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251029 09:10:09.088963 8970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:09.089004 8970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.194
I20251029 09:10:09.090839 8970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.4.237.194
--webserver_port=0
--tserver_master_addrs=127.4.237.254:41375
--never_fsync=true
--heap_profile_path=/tmp/kudu.8970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.194
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:09.091153 8970 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:09.091410 8970 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:09.094367 8976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:09.094357 8975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:09.094362 8978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:09.094645 8970 server_base.cc:1047] running on GCE node
I20251029 09:10:09.094852 8970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:09.095095 8970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:09.096254 8970 hybrid_clock.cc:648] HybridClock initialized: now 1761729009096238 us; error 31 us; skew 500 ppm
I20251029 09:10:09.097750 8970 webserver.cc:492] Webserver started at http://127.4.237.194:41227/ using document root <none> and password file <none>
I20251029 09:10:09.098006 8970 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:09.098062 8970 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:09.098199 8970 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:09.099202 8970 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "06f97b7f69ea43438ca08be8cb1c9c65"
format_stamp: "Formatted at 2025-10-29 09:10:09 on dist-test-slave-z9gc"
I20251029 09:10:09.099540 8970 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "06f97b7f69ea43438ca08be8cb1c9c65"
format_stamp: "Formatted at 2025-10-29 09:10:09 on dist-test-slave-z9gc"
I20251029 09:10:09.100854 8970 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251029 09:10:09.101650 8984 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:09.101853 8970 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:09.101936 8970 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "06f97b7f69ea43438ca08be8cb1c9c65"
format_stamp: "Formatted at 2025-10-29 09:10:09 on dist-test-slave-z9gc"
I20251029 09:10:09.102005 8970 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:09.120929 8970 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:09.121239 8970 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:09.121392 8970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:09.121613 8970 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:09.121950 8970 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:09.121984 8970 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:09.122023 8970 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:09.122056 8970 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:09.127641 8970 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.194:41471
I20251029 09:10:09.127692 9097 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.194:41471 every 8 connection(s)
I20251029 09:10:09.128031 8970 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251029 09:10:09.130173 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 8970
I20251029 09:10:09.130298 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251029 09:10:09.131456 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.195:0
--local_ip_for_outbound_sockets=127.4.237.195
--webserver_interface=127.4.237.195
--webserver_port=0
--tserver_master_addrs=127.4.237.254:41375
--builtin_ntp_servers=127.4.237.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20251029 09:10:09.133059 9098 heartbeater.cc:344] Connected to a master server at 127.4.237.254:41375
I20251029 09:10:09.133159 9098 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:09.133368 9098 heartbeater.cc:507] Master 127.4.237.254:41375 requested a full tablet report, sending...
I20251029 09:10:09.133744 8779 ts_manager.cc:194] Registered new tserver with Master: 06f97b7f69ea43438ca08be8cb1c9c65 (127.4.237.194:41471)
I20251029 09:10:09.134119 8779 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.194:33727
W20251029 09:10:09.213994 9101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:09.214207 9101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:09.214242 9101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:09.215819 9101 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251029 09:10:09.215888 9101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:09.215929 9101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.195
I20251029 09:10:09.217509 9101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.4.237.195
--webserver_port=0
--tserver_master_addrs=127.4.237.254:41375
--never_fsync=true
--heap_profile_path=/tmp/kudu.9101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.195
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:09.217793 9101 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:09.218034 9101 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:09.220724 9106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:09.220695 9107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:09.220985 9101 server_base.cc:1047] running on GCE node
W20251029 09:10:09.220695 9109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:09.221226 9101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:09.221397 9101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:09.222525 9101 hybrid_clock.cc:648] HybridClock initialized: now 1761729009222509 us; error 32 us; skew 500 ppm
I20251029 09:10:09.223731 9101 webserver.cc:492] Webserver started at http://127.4.237.195:44337/ using document root <none> and password file <none>
I20251029 09:10:09.223977 9101 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:09.224023 9101 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:09.224145 9101 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:09.225013 9101 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "2a5ee46c50b846a3a018440d46d5490b"
format_stamp: "Formatted at 2025-10-29 09:10:09 on dist-test-slave-z9gc"
I20251029 09:10:09.225322 9101 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "2a5ee46c50b846a3a018440d46d5490b"
format_stamp: "Formatted at 2025-10-29 09:10:09 on dist-test-slave-z9gc"
I20251029 09:10:09.226583 9101 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20251029 09:10:09.227312 9115 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:09.227540 9101 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251029 09:10:09.227632 9101 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "2a5ee46c50b846a3a018440d46d5490b"
format_stamp: "Formatted at 2025-10-29 09:10:09 on dist-test-slave-z9gc"
I20251029 09:10:09.227701 9101 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:09.247547 9101 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:09.247831 9101 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:09.247948 9101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:09.248149 9101 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:09.248461 9101 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:09.248492 9101 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:09.248525 9101 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:09.248550 9101 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:09.254701 9101 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.195:33749
I20251029 09:10:09.254765 9228 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.195:33749 every 8 connection(s)
I20251029 09:10:09.255118 9101 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251029 09:10:09.256675 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 9101
I20251029 09:10:09.256768 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251029 09:10:09.257915 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.196:0
--local_ip_for_outbound_sockets=127.4.237.196
--webserver_interface=127.4.237.196
--webserver_port=0
--tserver_master_addrs=127.4.237.254:41375
--builtin_ntp_servers=127.4.237.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20251029 09:10:09.260378 9229 heartbeater.cc:344] Connected to a master server at 127.4.237.254:41375
I20251029 09:10:09.260490 9229 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:09.260730 9229 heartbeater.cc:507] Master 127.4.237.254:41375 requested a full tablet report, sending...
I20251029 09:10:09.261088 8779 ts_manager.cc:194] Registered new tserver with Master: 2a5ee46c50b846a3a018440d46d5490b (127.4.237.195:33749)
I20251029 09:10:09.261632 8779 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.195:39995
W20251029 09:10:09.337916 9232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:09.338097 9232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:09.338119 9232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:09.339568 9232 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251029 09:10:09.339629 9232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:09.339668 9232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.196
I20251029 09:10:09.341169 9232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.4.237.196
--webserver_port=0
--tserver_master_addrs=127.4.237.254:41375
--never_fsync=true
--heap_profile_path=/tmp/kudu.9232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.196
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:09.341375 9232 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:09.341588 9232 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:09.344071 9237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:09.344086 9238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:09.344144 9240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:09.344444 9232 server_base.cc:1047] running on GCE node
I20251029 09:10:09.344588 9232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:09.344754 9232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:09.345890 9232 hybrid_clock.cc:648] HybridClock initialized: now 1761729009345877 us; error 25 us; skew 500 ppm
I20251029 09:10:09.347136 9232 webserver.cc:492] Webserver started at http://127.4.237.196:43009/ using document root <none> and password file <none>
I20251029 09:10:09.347347 9232 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:09.347396 9232 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:09.347518 9232 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:09.348394 9232 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "8110898c29844f56965224f1570adbe3"
format_stamp: "Formatted at 2025-10-29 09:10:09 on dist-test-slave-z9gc"
I20251029 09:10:09.348690 9232 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "8110898c29844f56965224f1570adbe3"
format_stamp: "Formatted at 2025-10-29 09:10:09 on dist-test-slave-z9gc"
I20251029 09:10:09.349848 9232 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20251029 09:10:09.350675 9246 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:09.350862 9232 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:09.350930 9232 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "8110898c29844f56965224f1570adbe3"
format_stamp: "Formatted at 2025-10-29 09:10:09 on dist-test-slave-z9gc"
I20251029 09:10:09.351013 9232 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:09.376876 9232 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:09.377139 9232 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:09.377229 9232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:09.377445 9232 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:09.377761 9232 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:09.377792 9232 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:09.377830 9232 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:09.377847 9232 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:09.383466 9232 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.196:33589
I20251029 09:10:09.383548 9359 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.196:33589 every 8 connection(s)
I20251029 09:10:09.383857 9232 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20251029 09:10:09.388557 9360 heartbeater.cc:344] Connected to a master server at 127.4.237.254:41375
I20251029 09:10:09.388674 9360 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:09.388860 9360 heartbeater.cc:507] Master 127.4.237.254:41375 requested a full tablet report, sending...
I20251029 09:10:09.389199 8779 ts_manager.cc:194] Registered new tserver with Master: 8110898c29844f56965224f1570adbe3 (127.4.237.196:33589)
I20251029 09:10:09.389540 8779 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.196:43221
I20251029 09:10:09.393812 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 9232
I20251029 09:10:09.393908 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20251029 09:10:09.395123 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.197:0
--local_ip_for_outbound_sockets=127.4.237.197
--webserver_interface=127.4.237.197
--webserver_port=0
--tserver_master_addrs=127.4.237.254:41375
--builtin_ntp_servers=127.4.237.212:40979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20251029 09:10:09.478205 9363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:09.478488 9363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:09.478518 9363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:09.480159 9363 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251029 09:10:09.480232 9363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:09.480260 9363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.197
I20251029 09:10:09.482045 9363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:40979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.197:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.4.237.197
--webserver_port=0
--tserver_master_addrs=127.4.237.254:41375
--never_fsync=true
--heap_profile_path=/tmp/kudu.9363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.197
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:09.482345 9363 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:09.482647 9363 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:09.485538 9369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:09.485563 9368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:09.485579 9363 server_base.cc:1047] running on GCE node
W20251029 09:10:09.485586 9371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:09.485919 9363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:09.486119 9363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:09.487268 9363 hybrid_clock.cc:648] HybridClock initialized: now 1761729009487254 us; error 28 us; skew 500 ppm
I20251029 09:10:09.488473 9363 webserver.cc:492] Webserver started at http://127.4.237.197:39499/ using document root <none> and password file <none>
I20251029 09:10:09.488679 9363 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:09.488729 9363 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:09.488863 9363 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:09.489743 9363 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "e01188ca14e0483b80ac9a5f408eaef7"
format_stamp: "Formatted at 2025-10-29 09:10:09 on dist-test-slave-z9gc"
I20251029 09:10:09.490072 9363 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "e01188ca14e0483b80ac9a5f408eaef7"
format_stamp: "Formatted at 2025-10-29 09:10:09 on dist-test-slave-z9gc"
I20251029 09:10:09.491386 9363 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20251029 09:10:09.492166 9377 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:09.492348 9363 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251029 09:10:09.492425 9363 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "e01188ca14e0483b80ac9a5f408eaef7"
format_stamp: "Formatted at 2025-10-29 09:10:09 on dist-test-slave-z9gc"
I20251029 09:10:09.492491 9363 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:09.511369 9363 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:09.511679 9363 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:09.511804 9363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:09.512037 9363 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:09.512362 9363 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:09.512398 9363 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:09.512435 9363 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:09.512468 9363 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:09.518163 9363 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.197:39807
I20251029 09:10:09.518214 9490 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.197:39807 every 8 connection(s)
I20251029 09:10:09.518617 9363 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20251029 09:10:09.520107 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 9363
I20251029 09:10:09.520215 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20251029 09:10:09.523658 9491 heartbeater.cc:344] Connected to a master server at 127.4.237.254:41375
I20251029 09:10:09.523783 9491 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:09.524008 9491 heartbeater.cc:507] Master 127.4.237.254:41375 requested a full tablet report, sending...
I20251029 09:10:09.524361 8779 ts_manager.cc:194] Registered new tserver with Master: e01188ca14e0483b80ac9a5f408eaef7 (127.4.237.197:39807)
I20251029 09:10:09.524736 8779 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.197:52313
I20251029 09:10:09.532719 5047 external_mini_cluster.cc:949] 5 TS(s) registered with all masters
I20251029 09:10:09.538681 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33644:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20251029 09:10:09.546929 8901 tablet_service.cc:1505] Processing CreateTablet for tablet 3bf4872a7bc84080bfad8dbe6b9ccd29 (DEFAULT_TABLE table=TestTable [id=abcde5616baa47fe9e5b335f8660f91a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:09.547360 8901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf4872a7bc84080bfad8dbe6b9ccd29. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:09.547780 9162 tablet_service.cc:1505] Processing CreateTablet for tablet 3bf4872a7bc84080bfad8dbe6b9ccd29 (DEFAULT_TABLE table=TestTable [id=abcde5616baa47fe9e5b335f8660f91a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:09.548069 9162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf4872a7bc84080bfad8dbe6b9ccd29. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:09.550276 9508 tablet_bootstrap.cc:492] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8: Bootstrap starting.
I20251029 09:10:09.550801 9509 tablet_bootstrap.cc:492] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b: Bootstrap starting.
I20251029 09:10:09.550741 9425 tablet_service.cc:1505] Processing CreateTablet for tablet 3bf4872a7bc84080bfad8dbe6b9ccd29 (DEFAULT_TABLE table=TestTable [id=abcde5616baa47fe9e5b335f8660f91a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:09.550992 9508 tablet_bootstrap.cc:654] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:09.551054 9425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf4872a7bc84080bfad8dbe6b9ccd29. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:09.551311 9508 log.cc:826] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:09.551702 9509 tablet_bootstrap.cc:654] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:09.552001 9509 log.cc:826] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:09.552153 9508 tablet_bootstrap.cc:492] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8: No bootstrap required, opened a new log
I20251029 09:10:09.552228 9508 ts_tablet_manager.cc:1403] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251029 09:10:09.553359 9512 tablet_bootstrap.cc:492] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7: Bootstrap starting.
I20251029 09:10:09.553319 9508 raft_consensus.cc:359] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35205 } } peers { permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 } } peers { permanent_uuid: "e01188ca14e0483b80ac9a5f408eaef7" member_type: VOTER last_known_addr { host: "127.4.237.197" port: 39807 } }
I20251029 09:10:09.553469 9508 raft_consensus.cc:385] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:09.553514 9508 raft_consensus.cc:740] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d65cfcf68864c16b4d1d4c2aa536eb8, State: Initialized, Role: FOLLOWER
I20251029 09:10:09.553609 9508 consensus_queue.cc:260] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35205 } } peers { permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 } } peers { permanent_uuid: "e01188ca14e0483b80ac9a5f408eaef7" member_type: VOTER last_known_addr { host: "127.4.237.197" port: 39807 } }
I20251029 09:10:09.553882 9508 ts_tablet_manager.cc:1434] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251029 09:10:09.553910 8967 heartbeater.cc:499] Master 127.4.237.254:41375 was elected leader, sending a full tablet report...
I20251029 09:10:09.554060 9509 tablet_bootstrap.cc:492] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b: No bootstrap required, opened a new log
I20251029 09:10:09.554118 9509 ts_tablet_manager.cc:1403] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251029 09:10:09.554371 9512 tablet_bootstrap.cc:654] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:09.554729 9512 log.cc:826] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:09.555408 9512 tablet_bootstrap.cc:492] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7: No bootstrap required, opened a new log
I20251029 09:10:09.555462 9512 ts_tablet_manager.cc:1403] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251029 09:10:09.555706 9509 raft_consensus.cc:359] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35205 } } peers { permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 } } peers { permanent_uuid: "e01188ca14e0483b80ac9a5f408eaef7" member_type: VOTER last_known_addr { host: "127.4.237.197" port: 39807 } }
I20251029 09:10:09.555825 9509 raft_consensus.cc:385] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:09.555859 9509 raft_consensus.cc:740] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a5ee46c50b846a3a018440d46d5490b, State: Initialized, Role: FOLLOWER
I20251029 09:10:09.555960 9509 consensus_queue.cc:260] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35205 } } peers { permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 } } peers { permanent_uuid: "e01188ca14e0483b80ac9a5f408eaef7" member_type: VOTER last_known_addr { host: "127.4.237.197" port: 39807 } }
I20251029 09:10:09.556177 9509 ts_tablet_manager.cc:1434] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251029 09:10:09.556277 9229 heartbeater.cc:499] Master 127.4.237.254:41375 was elected leader, sending a full tablet report...
I20251029 09:10:09.556842 9512 raft_consensus.cc:359] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35205 } } peers { permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 } } peers { permanent_uuid: "e01188ca14e0483b80ac9a5f408eaef7" member_type: VOTER last_known_addr { host: "127.4.237.197" port: 39807 } }
I20251029 09:10:09.556967 9512 raft_consensus.cc:385] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:09.556995 9512 raft_consensus.cc:740] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e01188ca14e0483b80ac9a5f408eaef7, State: Initialized, Role: FOLLOWER
I20251029 09:10:09.557073 9512 consensus_queue.cc:260] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35205 } } peers { permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 } } peers { permanent_uuid: "e01188ca14e0483b80ac9a5f408eaef7" member_type: VOTER last_known_addr { host: "127.4.237.197" port: 39807 } }
I20251029 09:10:09.557272 9512 ts_tablet_manager.cc:1434] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251029 09:10:09.557344 9491 heartbeater.cc:499] Master 127.4.237.254:41375 was elected leader, sending a full tablet report...
I20251029 09:10:09.698395 9516 raft_consensus.cc:493] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251029 09:10:09.698602 9516 raft_consensus.cc:515] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35205 } } peers { permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 } } peers { permanent_uuid: "e01188ca14e0483b80ac9a5f408eaef7" member_type: VOTER last_known_addr { host: "127.4.237.197" port: 39807 } }
I20251029 09:10:09.698951 9516 leader_election.cc:290] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d65cfcf68864c16b4d1d4c2aa536eb8 (127.4.237.193:35205), 2a5ee46c50b846a3a018440d46d5490b (127.4.237.195:33749)
I20251029 09:10:09.701745 8921 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bf4872a7bc84080bfad8dbe6b9ccd29" candidate_uuid: "e01188ca14e0483b80ac9a5f408eaef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" is_pre_election: true
I20251029 09:10:09.701927 8921 raft_consensus.cc:2468] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e01188ca14e0483b80ac9a5f408eaef7 in term 0.
I20251029 09:10:09.702193 9379 leader_election.cc:304] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65cfcf68864c16b4d1d4c2aa536eb8, e01188ca14e0483b80ac9a5f408eaef7; no voters:
I20251029 09:10:09.702244 9183 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bf4872a7bc84080bfad8dbe6b9ccd29" candidate_uuid: "e01188ca14e0483b80ac9a5f408eaef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a5ee46c50b846a3a018440d46d5490b" is_pre_election: true
I20251029 09:10:09.702387 9183 raft_consensus.cc:2468] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e01188ca14e0483b80ac9a5f408eaef7 in term 0.
I20251029 09:10:09.702483 9516 raft_consensus.cc:2804] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251029 09:10:09.702560 9516 raft_consensus.cc:493] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251029 09:10:09.702615 9516 raft_consensus.cc:3060] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:09.703363 9516 raft_consensus.cc:515] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35205 } } peers { permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 } } peers { permanent_uuid: "e01188ca14e0483b80ac9a5f408eaef7" member_type: VOTER last_known_addr { host: "127.4.237.197" port: 39807 } }
I20251029 09:10:09.703514 9516 leader_election.cc:290] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [CANDIDATE]: Term 1 election: Requested vote from peers 6d65cfcf68864c16b4d1d4c2aa536eb8 (127.4.237.193:35205), 2a5ee46c50b846a3a018440d46d5490b (127.4.237.195:33749)
I20251029 09:10:09.703727 8921 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bf4872a7bc84080bfad8dbe6b9ccd29" candidate_uuid: "e01188ca14e0483b80ac9a5f408eaef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8"
I20251029 09:10:09.703743 9183 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bf4872a7bc84080bfad8dbe6b9ccd29" candidate_uuid: "e01188ca14e0483b80ac9a5f408eaef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a5ee46c50b846a3a018440d46d5490b"
I20251029 09:10:09.703819 8921 raft_consensus.cc:3060] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:09.703825 9183 raft_consensus.cc:3060] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:09.704536 9183 raft_consensus.cc:2468] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e01188ca14e0483b80ac9a5f408eaef7 in term 1.
I20251029 09:10:09.704571 8921 raft_consensus.cc:2468] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e01188ca14e0483b80ac9a5f408eaef7 in term 1.
I20251029 09:10:09.704746 9379 leader_election.cc:304] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65cfcf68864c16b4d1d4c2aa536eb8, e01188ca14e0483b80ac9a5f408eaef7; no voters:
I20251029 09:10:09.704871 9516 raft_consensus.cc:2804] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:09.705053 9516 raft_consensus.cc:697] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [term 1 LEADER]: Becoming Leader. State: Replica: e01188ca14e0483b80ac9a5f408eaef7, State: Running, Role: LEADER
I20251029 09:10:09.705169 9516 consensus_queue.cc:237] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35205 } } peers { permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 } } peers { permanent_uuid: "e01188ca14e0483b80ac9a5f408eaef7" member_type: VOTER last_known_addr { host: "127.4.237.197" port: 39807 } }
I20251029 09:10:09.706053 8778 catalog_manager.cc:5649] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P e01188ca14e0483b80ac9a5f408eaef7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e01188ca14e0483b80ac9a5f408eaef7 (127.4.237.197). New cstate: current_term: 1 leader_uuid: "e01188ca14e0483b80ac9a5f408eaef7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e01188ca14e0483b80ac9a5f408eaef7" member_type: VOTER last_known_addr { host: "127.4.237.197" port: 39807 } health_report { overall_health: HEALTHY } } }
I20251029 09:10:09.730533 5047 external_mini_cluster.cc:949] 5 TS(s) registered with all masters
I20251029 09:10:09.731055 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 6d65cfcf68864c16b4d1d4c2aa536eb8 to finish bootstrapping
I20251029 09:10:09.734740 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 2a5ee46c50b846a3a018440d46d5490b to finish bootstrapping
I20251029 09:10:09.738265 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver e01188ca14e0483b80ac9a5f408eaef7 to finish bootstrapping
I20251029 09:10:09.741668 5047 test_util.cc:276] Using random seed: 2144399201
W20251029 09:10:09.746115 8968 tablet.cc:2378] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251029 09:10:09.747503 5047 test_workload.cc:405] TestWorkload: Skipping table creation because table TestTable already exists
I20251029 09:10:09.747712 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 9363
W20251029 09:10:09.753304 9525 negotiation.cc:337] Failed RPC negotiation. Trace:
1029 09:10:09.751996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.237.197:39807 (local address 127.0.0.1:50796)
1029 09:10:09.752081 (+ 85us) negotiation.cc:107] Waiting for socket to connect
1029 09:10:09.752094 (+ 13us) client_negotiation.cc:174] Beginning negotiation
1029 09:10:09.752149 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1029 09:10:09.753110 (+ 961us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.237.197:39807: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":50}
W20251029 09:10:09.753502 9521 meta_cache.cc:302] tablet 3bf4872a7bc84080bfad8dbe6b9ccd29: replica e01188ca14e0483b80ac9a5f408eaef7 (127.4.237.197:39807) has failed: Network error: Client connection negotiation failed: client connection to 127.4.237.197:39807: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251029 09:10:09.755791 9230 tablet.cc:2378] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251029 09:10:09.762871 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:09.773204 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
W20251029 09:10:09.784178 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:09.793058 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
W20251029 09:10:09.814116 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:09.826944 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
W20251029 09:10:09.850893 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:09.864760 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
I20251029 09:10:09.874717 9294 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:09.874922 9162 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:09.874984 9032 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:09.875340 8901 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20251029 09:10:09.896443 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:09.914449 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
W20251029 09:10:09.950527 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:09.970512 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
W20251029 09:10:10.011605 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:10.035421 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
W20251029 09:10:10.085918 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:10.109685 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
I20251029 09:10:10.135056 9098 heartbeater.cc:499] Master 127.4.237.254:41375 was elected leader, sending a full tablet report...
W20251029 09:10:10.164752 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:10.192719 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
W20251029 09:10:10.252911 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:10.283887 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
W20251029 09:10:10.349273 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:10.386121 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
I20251029 09:10:10.390363 9360 heartbeater.cc:499] Master 127.4.237.254:41375 was elected leader, sending a full tablet report...
W20251029 09:10:10.458545 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:10.495455 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
W20251029 09:10:10.573781 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:10.614867 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
W20251029 09:10:10.700168 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:10.744064 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
W20251029 09:10:10.791628 9521 meta_cache.cc:302] tablet 3bf4872a7bc84080bfad8dbe6b9ccd29: replica e01188ca14e0483b80ac9a5f408eaef7 (127.4.237.197:39807) has failed: Network error: Client connection negotiation failed: client connection to 127.4.237.197:39807: connect: Connection refused (error 111)
W20251029 09:10:10.836323 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:10.881369 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
I20251029 09:10:10.914004 9032 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:10.914861 9294 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:10.915005 9162 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:10.919322 8901 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20251029 09:10:10.981609 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:11.030582 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
W20251029 09:10:11.134176 8881 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45420: Illegal state: replica 6d65cfcf68864c16b4d1d4c2aa536eb8 is not leader of this config: current role FOLLOWER
W20251029 09:10:11.186256 9143 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39050: Illegal state: replica 2a5ee46c50b846a3a018440d46d5490b is not leader of this config: current role FOLLOWER
I20251029 09:10:11.272877 9592 raft_consensus.cc:493] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251029 09:10:11.272985 9592 raft_consensus.cc:515] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35205 } } peers { permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 } } peers { permanent_uuid: "e01188ca14e0483b80ac9a5f408eaef7" member_type: VOTER last_known_addr { host: "127.4.237.197" port: 39807 } }
I20251029 09:10:11.273317 9592 leader_election.cc:290] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a5ee46c50b846a3a018440d46d5490b (127.4.237.195:33749), e01188ca14e0483b80ac9a5f408eaef7 (127.4.237.197:39807)
W20251029 09:10:11.273783 8854 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.237.197:39807: connect: Connection refused (error 111)
W20251029 09:10:11.274277 8854 leader_election.cc:336] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e01188ca14e0483b80ac9a5f408eaef7 (127.4.237.197:39807): Network error: Client connection negotiation failed: client connection to 127.4.237.197:39807: connect: Connection refused (error 111)
I20251029 09:10:11.276084 9183 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bf4872a7bc84080bfad8dbe6b9ccd29" candidate_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a5ee46c50b846a3a018440d46d5490b" is_pre_election: true
I20251029 09:10:11.276170 9183 raft_consensus.cc:2468] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d65cfcf68864c16b4d1d4c2aa536eb8 in term 1.
I20251029 09:10:11.276368 8855 leader_election.cc:304] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a5ee46c50b846a3a018440d46d5490b, 6d65cfcf68864c16b4d1d4c2aa536eb8; no voters: e01188ca14e0483b80ac9a5f408eaef7
I20251029 09:10:11.276495 9592 raft_consensus.cc:2804] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251029 09:10:11.276563 9592 raft_consensus.cc:493] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251029 09:10:11.276587 9592 raft_consensus.cc:3060] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [term 1 FOLLOWER]: Advancing to term 2
I20251029 09:10:11.277226 9592 raft_consensus.cc:515] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35205 } } peers { permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 } } peers { permanent_uuid: "e01188ca14e0483b80ac9a5f408eaef7" member_type: VOTER last_known_addr { host: "127.4.237.197" port: 39807 } }
I20251029 09:10:11.277365 9592 leader_election.cc:290] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [CANDIDATE]: Term 2 election: Requested vote from peers 2a5ee46c50b846a3a018440d46d5490b (127.4.237.195:33749), e01188ca14e0483b80ac9a5f408eaef7 (127.4.237.197:39807)
I20251029 09:10:11.277559 9183 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bf4872a7bc84080bfad8dbe6b9ccd29" candidate_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a5ee46c50b846a3a018440d46d5490b"
I20251029 09:10:11.277701 9183 raft_consensus.cc:3060] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b [term 1 FOLLOWER]: Advancing to term 2
W20251029 09:10:11.277953 8854 leader_election.cc:336] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e01188ca14e0483b80ac9a5f408eaef7 (127.4.237.197:39807): Network error: Client connection negotiation failed: client connection to 127.4.237.197:39807: connect: Connection refused (error 111)
I20251029 09:10:11.278551 9183 raft_consensus.cc:2468] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d65cfcf68864c16b4d1d4c2aa536eb8 in term 2.
I20251029 09:10:11.278766 8855 leader_election.cc:304] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a5ee46c50b846a3a018440d46d5490b, 6d65cfcf68864c16b4d1d4c2aa536eb8; no voters: e01188ca14e0483b80ac9a5f408eaef7
I20251029 09:10:11.278872 9592 raft_consensus.cc:2804] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [term 2 FOLLOWER]: Leader election won for term 2
I20251029 09:10:11.279048 9592 raft_consensus.cc:697] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [term 2 LEADER]: Becoming Leader. State: Replica: 6d65cfcf68864c16b4d1d4c2aa536eb8, State: Running, Role: LEADER
I20251029 09:10:11.279145 9592 consensus_queue.cc:237] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35205 } } peers { permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 } } peers { permanent_uuid: "e01188ca14e0483b80ac9a5f408eaef7" member_type: VOTER last_known_addr { host: "127.4.237.197" port: 39807 } }
I20251029 09:10:11.279949 8778 catalog_manager.cc:5649] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 reported cstate change: term changed from 1 to 2, leader changed from e01188ca14e0483b80ac9a5f408eaef7 (127.4.237.197) to 6d65cfcf68864c16b4d1d4c2aa536eb8 (127.4.237.193). New cstate: current_term: 2 leader_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d65cfcf68864c16b4d1d4c2aa536eb8" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 35205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e01188ca14e0483b80ac9a5f408eaef7" member_type: VOTER last_known_addr { host: "127.4.237.197" port: 39807 } health_report { overall_health: UNKNOWN } } }
I20251029 09:10:11.294494 9183 raft_consensus.cc:1275] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 2a5ee46c50b846a3a018440d46d5490b [term 2 FOLLOWER]: Refusing update from remote peer 6d65cfcf68864c16b4d1d4c2aa536eb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251029 09:10:11.294751 8854 consensus_peers.cc:597] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 -> Peer e01188ca14e0483b80ac9a5f408eaef7 (127.4.237.197:39807): Couldn't send request to peer e01188ca14e0483b80ac9a5f408eaef7. Status: Network error: Client connection negotiation failed: client connection to 127.4.237.197:39807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251029 09:10:11.294852 9596 consensus_queue.cc:1048] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a5ee46c50b846a3a018440d46d5490b" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251029 09:10:11.296648 9602 mvcc.cc:204] Tried to move back new op lower bound from 7216042030259179520 to 7216042030199930880. Current Snapshot: MvccSnapshot[applied={T|T < 7216042030259179520}]
I20251029 09:10:11.297327 9604 mvcc.cc:204] Tried to move back new op lower bound from 7216042030259179520 to 7216042030199930880. Current Snapshot: MvccSnapshot[applied={T|T < 7216042030259179520 or (T in {7216042030259179520})}]
I20251029 09:10:11.960368 9032 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:11.960305 9294 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:11.961256 9162 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:11.965121 8901 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251029 09:10:13.008343 9032 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:13.011238 8901 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251029 09:10:13.012806 9162 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:13.014784 9294 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20251029 09:10:13.858525 8854 consensus_peers.cc:597] T 3bf4872a7bc84080bfad8dbe6b9ccd29 P 6d65cfcf68864c16b4d1d4c2aa536eb8 -> Peer e01188ca14e0483b80ac9a5f408eaef7 (127.4.237.197:39807): Couldn't send request to peer e01188ca14e0483b80ac9a5f408eaef7. Status: Network error: Client connection negotiation failed: client connection to 127.4.237.197:39807: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20251029 09:10:14.058617 9032 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:14.058898 9294 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:14.059319 9162 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:14.066008 8901 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251029 09:10:15.081411 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 8839
I20251029 09:10:15.087308 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 8970
I20251029 09:10:15.092717 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 9101
I20251029 09:10:15.097965 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 9232
I20251029 09:10:15.102772 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 8748
2025-10-29T09:10:15Z chronyd exiting
[ OK ] EnableKudu1097AndDownTS/MoveTabletParamTest.Test/4 (6395 ms)
[----------] 1 test from EnableKudu1097AndDownTS/MoveTabletParamTest (6395 ms total)
[----------] 1 test from ListTableCliSimpleParamTest
[ RUN ] ListTableCliSimpleParamTest.TestListTables/2
I20251029 09:10:15.124318 5047 test_util.cc:276] Using random seed: -2145185448
I20251029 09:10:15.124863 5047 ts_itest-base.cc:115] Starting cluster with:
I20251029 09:10:15.124908 5047 ts_itest-base.cc:116] --------------
I20251029 09:10:15.124925 5047 ts_itest-base.cc:117] 1 tablet servers
I20251029 09:10:15.124941 5047 ts_itest-base.cc:118] 1 replicas per TS
I20251029 09:10:15.124966 5047 ts_itest-base.cc:119] --------------
2025-10-29T09:10:15Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-10-29T09:10:15Z Disabled control of system clock
I20251029 09:10:15.132607 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:35071
--webserver_interface=127.4.237.254
--webserver_port=0
--builtin_ntp_servers=127.4.237.212:41529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.237.254:35071 with env {}
W20251029 09:10:15.212772 9729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:15.212963 9729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:15.212996 9729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:15.214388 9729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251029 09:10:15.214483 9729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:15.214506 9729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251029 09:10:15.214547 9729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251029 09:10:15.216113 9729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:41529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.237.254:35071
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:35071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.4.237.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.9729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:15.216369 9729 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:15.216607 9729 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:15.219436 9735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:15.219548 9729 server_base.cc:1047] running on GCE node
W20251029 09:10:15.219676 9737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:15.219468 9734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:15.219996 9729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:15.220285 9729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:15.221433 9729 hybrid_clock.cc:648] HybridClock initialized: now 1761729015221416 us; error 35 us; skew 500 ppm
I20251029 09:10:15.222731 9729 webserver.cc:492] Webserver started at http://127.4.237.254:44851/ using document root <none> and password file <none>
I20251029 09:10:15.222963 9729 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:15.223011 9729 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:15.223130 9729 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:15.224032 9729 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "1b6dcc377f69477eb624f164423d59ef"
format_stamp: "Formatted at 2025-10-29 09:10:15 on dist-test-slave-z9gc"
I20251029 09:10:15.224346 9729 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "1b6dcc377f69477eb624f164423d59ef"
format_stamp: "Formatted at 2025-10-29 09:10:15 on dist-test-slave-z9gc"
I20251029 09:10:15.225647 9729 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20251029 09:10:15.226570 9743 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:15.226788 9729 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251029 09:10:15.226867 9729 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
uuid: "1b6dcc377f69477eb624f164423d59ef"
format_stamp: "Formatted at 2025-10-29 09:10:15 on dist-test-slave-z9gc"
I20251029 09:10:15.226935 9729 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:15.238868 9729 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:15.239171 9729 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:15.239288 9729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:15.243285 9729 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.254:35071
I20251029 09:10:15.243327 9795 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.254:35071 every 8 connection(s)
I20251029 09:10:15.243705 9729 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251029 09:10:15.244364 9796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:15.246997 9796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef: Bootstrap starting.
I20251029 09:10:15.247159 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 9729
I20251029 09:10:15.247262 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251029 09:10:15.247666 9796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:15.248009 9796 log.cc:826] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:15.248750 9796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef: No bootstrap required, opened a new log
I20251029 09:10:15.250141 9796 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6dcc377f69477eb624f164423d59ef" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 35071 } }
I20251029 09:10:15.250288 9796 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:15.250313 9796 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b6dcc377f69477eb624f164423d59ef, State: Initialized, Role: FOLLOWER
I20251029 09:10:15.250433 9796 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6dcc377f69477eb624f164423d59ef" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 35071 } }
I20251029 09:10:15.250506 9796 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:15.250542 9796 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:15.250587 9796 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:15.251106 9796 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6dcc377f69477eb624f164423d59ef" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 35071 } }
I20251029 09:10:15.251214 9796 leader_election.cc:304] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b6dcc377f69477eb624f164423d59ef; no voters:
I20251029 09:10:15.251770 9796 leader_election.cc:290] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20251029 09:10:15.251857 9801 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:15.252017 9801 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [term 1 LEADER]: Becoming Leader. State: Replica: 1b6dcc377f69477eb624f164423d59ef, State: Running, Role: LEADER
I20251029 09:10:15.252076 9796 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [sys.catalog]: configured and running, proceeding with master startup.
I20251029 09:10:15.252213 9801 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6dcc377f69477eb624f164423d59ef" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 35071 } }
I20251029 09:10:15.252707 9802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b6dcc377f69477eb624f164423d59ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6dcc377f69477eb624f164423d59ef" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 35071 } } }
I20251029 09:10:15.252835 9802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:15.253002 9803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b6dcc377f69477eb624f164423d59ef. Latest consensus state: current_term: 1 leader_uuid: "1b6dcc377f69477eb624f164423d59ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6dcc377f69477eb624f164423d59ef" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 35071 } } }
I20251029 09:10:15.253064 9803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:15.253750 9809 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251029 09:10:15.254276 9809 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251029 09:10:15.255682 9809 catalog_manager.cc:1357] Generated new cluster ID: 2b476c48fa4a46599aaa41fca868c89d
I20251029 09:10:15.255736 9809 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251029 09:10:15.274044 9809 catalog_manager.cc:1380] Generated new certificate authority record
I20251029 09:10:15.274655 9809 catalog_manager.cc:1514] Loading token signing keys...
I20251029 09:10:15.281888 9809 catalog_manager.cc:6022] T 00000000000000000000000000000000 P 1b6dcc377f69477eb624f164423d59ef: Generated new TSK 0
I20251029 09:10:15.282091 9809 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251029 09:10:15.290177 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.193:0
--local_ip_for_outbound_sockets=127.4.237.193
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:35071
--builtin_ntp_servers=127.4.237.212:41529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251029 09:10:15.373221 9820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:15.373431 9820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:15.373453 9820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:15.375065 9820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:15.375134 9820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.193
I20251029 09:10:15.376837 9820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:41529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:35071
--never_fsync=true
--heap_profile_path=/tmp/kudu.9820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.193
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:15.377072 9820 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:15.377328 9820 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:15.379931 9826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:15.380096 9820 server_base.cc:1047] running on GCE node
W20251029 09:10:15.379944 9828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:15.379944 9825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:15.380363 9820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:15.380592 9820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:15.381747 9820 hybrid_clock.cc:648] HybridClock initialized: now 1761729015381726 us; error 34 us; skew 500 ppm
I20251029 09:10:15.383054 9820 webserver.cc:492] Webserver started at http://127.4.237.193:45391/ using document root <none> and password file <none>
I20251029 09:10:15.383267 9820 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:15.383311 9820 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:15.383421 9820 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:15.384305 9820 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "5e495e72c7fb44c1810719973a0aacda"
format_stamp: "Formatted at 2025-10-29 09:10:15 on dist-test-slave-z9gc"
I20251029 09:10:15.384629 9820 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "5e495e72c7fb44c1810719973a0aacda"
format_stamp: "Formatted at 2025-10-29 09:10:15 on dist-test-slave-z9gc"
I20251029 09:10:15.385963 9820 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251029 09:10:15.386801 9834 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:15.386996 9820 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251029 09:10:15.387076 9820 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "5e495e72c7fb44c1810719973a0aacda"
format_stamp: "Formatted at 2025-10-29 09:10:15 on dist-test-slave-z9gc"
I20251029 09:10:15.387256 9820 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:15.411684 9820 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:15.411998 9820 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:15.412132 9820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:15.412367 9820 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:15.412729 9820 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:15.412762 9820 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:15.412787 9820 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:15.412802 9820 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:15.418828 9820 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.193:46739
I20251029 09:10:15.418876 9947 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.193:46739 every 8 connection(s)
I20251029 09:10:15.419241 9820 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251029 09:10:15.423902 9948 heartbeater.cc:344] Connected to a master server at 127.4.237.254:35071
I20251029 09:10:15.424018 9948 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:15.424228 9948 heartbeater.cc:507] Master 127.4.237.254:35071 requested a full tablet report, sending...
I20251029 09:10:15.424697 9760 ts_manager.cc:194] Registered new tserver with Master: 5e495e72c7fb44c1810719973a0aacda (127.4.237.193:46739)
I20251029 09:10:15.425403 9760 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.193:59457
I20251029 09:10:15.425436 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 9820
I20251029 09:10:15.425526 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1761728996740924-5047-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251029 09:10:15.426522 5047 external_mini_cluster.cc:949] 1 TS(s) registered with all masters
I20251029 09:10:15.432753 9760 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54228:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20251029 09:10:15.440135 9882 tablet_service.cc:1505] Processing CreateTablet for tablet 4d8d06ed33ef4e348e2fc4ecb9aa1231 (DEFAULT_TABLE table=TestTable [id=9fd2bc2f896d48d58fb094dda4a372f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:15.440429 9882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d8d06ed33ef4e348e2fc4ecb9aa1231. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:15.442765 9958 tablet_bootstrap.cc:492] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda: Bootstrap starting.
I20251029 09:10:15.443369 9958 tablet_bootstrap.cc:654] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:15.443607 9958 log.cc:826] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:15.444193 9958 tablet_bootstrap.cc:492] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda: No bootstrap required, opened a new log
I20251029 09:10:15.444247 9958 ts_tablet_manager.cc:1403] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251029 09:10:15.445482 9958 raft_consensus.cc:359] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e495e72c7fb44c1810719973a0aacda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 46739 } }
I20251029 09:10:15.445626 9958 raft_consensus.cc:385] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:15.445647 9958 raft_consensus.cc:740] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e495e72c7fb44c1810719973a0aacda, State: Initialized, Role: FOLLOWER
I20251029 09:10:15.445722 9958 consensus_queue.cc:260] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e495e72c7fb44c1810719973a0aacda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 46739 } }
I20251029 09:10:15.445787 9958 raft_consensus.cc:399] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:15.445822 9958 raft_consensus.cc:493] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:15.445858 9958 raft_consensus.cc:3060] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:15.446352 9958 raft_consensus.cc:515] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e495e72c7fb44c1810719973a0aacda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 46739 } }
I20251029 09:10:15.446492 9958 leader_election.cc:304] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e495e72c7fb44c1810719973a0aacda; no voters:
I20251029 09:10:15.446640 9958 leader_election.cc:290] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda [CANDIDATE]: Term 1 election: Requested vote from peers
I20251029 09:10:15.446724 9960 raft_consensus.cc:2804] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:15.446846 9958 ts_tablet_manager.cc:1434] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20251029 09:10:15.446873 9948 heartbeater.cc:499] Master 127.4.237.254:35071 was elected leader, sending a full tablet report...
I20251029 09:10:15.446904 9960 raft_consensus.cc:697] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda [term 1 LEADER]: Becoming Leader. State: Replica: 5e495e72c7fb44c1810719973a0aacda, State: Running, Role: LEADER
I20251029 09:10:15.446982 9960 consensus_queue.cc:237] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e495e72c7fb44c1810719973a0aacda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 46739 } }
I20251029 09:10:15.447960 9760 catalog_manager.cc:5649] T 4d8d06ed33ef4e348e2fc4ecb9aa1231 P 5e495e72c7fb44c1810719973a0aacda reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e495e72c7fb44c1810719973a0aacda (127.4.237.193). New cstate: current_term: 1 leader_uuid: "5e495e72c7fb44c1810719973a0aacda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e495e72c7fb44c1810719973a0aacda" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 46739 } health_report { overall_health: HEALTHY } } }
I20251029 09:10:15.454545 5047 external_mini_cluster.cc:949] 1 TS(s) registered with all masters
I20251029 09:10:15.455111 5047 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 5e495e72c7fb44c1810719973a0aacda to finish bootstrapping
I20251029 09:10:15.609261 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 9820
I20251029 09:10:15.614140 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 9729
2025-10-29T09:10:15Z chronyd exiting
[ OK ] ListTableCliSimpleParamTest.TestListTables/2 (508 ms)
[----------] 1 test from ListTableCliSimpleParamTest (508 ms total)
[----------] 1 test from ListTableCliParamTest
[ RUN ] ListTableCliParamTest.ListTabletWithPartitionInfo/4
I20251029 09:10:15.632968 5047 test_util.cc:276] Using random seed: -2144676797
[ OK ] ListTableCliParamTest.ListTabletWithPartitionInfo/4 (1 ms)
[----------] 1 test from ListTableCliParamTest (1 ms total)
[----------] 1 test from IsSecure/SecureClusterAdminCliParamTest
[ RUN ] IsSecure/SecureClusterAdminCliParamTest.TestRebuildMaster/0
2025-10-29T09:10:15Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-10-29T09:10:15Z Disabled control of system clock
I20251029 09:10:15.641837 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:38457
--webserver_interface=127.4.237.254
--webserver_port=0
--builtin_ntp_servers=127.4.237.212:35189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.237.254:38457 with env {}
W20251029 09:10:15.725440 9982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:15.725625 9982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:15.725641 9982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:15.727097 9982 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251029 09:10:15.727146 9982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:15.727160 9982 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251029 09:10:15.727172 9982 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251029 09:10:15.728713 9982 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:35189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.237.254:38457
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:38457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.237.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.9982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:15.729008 9982 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:15.729274 9982 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:15.732100 9987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:15.732092 9990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:15.732178 9982 server_base.cc:1047] running on GCE node
W20251029 09:10:15.732092 9988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:15.732604 9982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:15.732888 9982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:15.734045 9982 hybrid_clock.cc:648] HybridClock initialized: now 1761729015734028 us; error 33 us; skew 500 ppm
I20251029 09:10:15.735411 9982 webserver.cc:492] Webserver started at http://127.4.237.254:39897/ using document root <none> and password file <none>
I20251029 09:10:15.735647 9982 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:15.735690 9982 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:15.735790 9982 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:15.736794 9982 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/instance:
uuid: "8c47dfdbd7fa4e058979441ef3052cc9"
format_stamp: "Formatted at 2025-10-29 09:10:15 on dist-test-slave-z9gc"
I20251029 09:10:15.737110 9982 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal/instance:
uuid: "8c47dfdbd7fa4e058979441ef3052cc9"
format_stamp: "Formatted at 2025-10-29 09:10:15 on dist-test-slave-z9gc"
I20251029 09:10:15.738449 9982 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20251029 09:10:15.739286 9996 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:15.739459 9982 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251029 09:10:15.739537 9982 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal
uuid: "8c47dfdbd7fa4e058979441ef3052cc9"
format_stamp: "Formatted at 2025-10-29 09:10:15 on dist-test-slave-z9gc"
I20251029 09:10:15.739627 9982 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:15.751154 9982 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:15.751474 9982 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:15.751612 9982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:15.755934 9982 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.254:38457
I20251029 09:10:15.755992 10048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.254:38457 every 8 connection(s)
I20251029 09:10:15.756325 9982 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/info.pb
I20251029 09:10:15.757002 10049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:15.759672 10049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9: Bootstrap starting.
I20251029 09:10:15.760290 10049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:15.760586 10049 log.cc:826] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:15.761269 10049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9: No bootstrap required, opened a new log
I20251029 09:10:15.762632 10049 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c47dfdbd7fa4e058979441ef3052cc9" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 38457 } }
I20251029 09:10:15.762777 10049 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:15.762797 10049 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c47dfdbd7fa4e058979441ef3052cc9, State: Initialized, Role: FOLLOWER
I20251029 09:10:15.762948 10049 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c47dfdbd7fa4e058979441ef3052cc9" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 38457 } }
I20251029 09:10:15.763043 10049 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:15.763084 10049 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:15.763132 10049 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:15.763703 10049 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c47dfdbd7fa4e058979441ef3052cc9" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 38457 } }
I20251029 09:10:15.763818 10049 leader_election.cc:304] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c47dfdbd7fa4e058979441ef3052cc9; no voters:
I20251029 09:10:15.764006 10049 leader_election.cc:290] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251029 09:10:15.764086 10052 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:15.764245 10052 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [term 1 LEADER]: Becoming Leader. State: Replica: 8c47dfdbd7fa4e058979441ef3052cc9, State: Running, Role: LEADER
I20251029 09:10:15.764258 10049 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [sys.catalog]: configured and running, proceeding with master startup.
I20251029 09:10:15.764349 10052 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c47dfdbd7fa4e058979441ef3052cc9" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 38457 } }
I20251029 09:10:15.764739 10053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c47dfdbd7fa4e058979441ef3052cc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c47dfdbd7fa4e058979441ef3052cc9" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 38457 } } }
I20251029 09:10:15.764880 10053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:15.764758 10054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c47dfdbd7fa4e058979441ef3052cc9. Latest consensus state: current_term: 1 leader_uuid: "8c47dfdbd7fa4e058979441ef3052cc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c47dfdbd7fa4e058979441ef3052cc9" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 38457 } } }
I20251029 09:10:15.764966 10054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:15.765374 10059 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251029 09:10:15.765933 10059 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251029 09:10:15.766115 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 9982
I20251029 09:10:15.766220 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal/instance
I20251029 09:10:15.767743 10059 catalog_manager.cc:1357] Generated new cluster ID: 72666158a7f547df9a8d85c63a7ef2f5
I20251029 09:10:15.767793 10059 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251029 09:10:15.777786 10059 catalog_manager.cc:1380] Generated new certificate authority record
I20251029 09:10:15.778877 10059 catalog_manager.cc:1514] Loading token signing keys...
I20251029 09:10:15.785805 10059 catalog_manager.cc:6022] T 00000000000000000000000000000000 P 8c47dfdbd7fa4e058979441ef3052cc9: Generated new TSK 0
I20251029 09:10:15.786044 10059 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251029 09:10:15.789270 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.193:0
--local_ip_for_outbound_sockets=127.4.237.193
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:38457
--builtin_ntp_servers=127.4.237.212:35189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20251029 09:10:15.876430 10073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:15.876634 10073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:15.876657 10073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:15.878320 10073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:15.878472 10073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.193
I20251029 09:10:15.880234 10073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:35189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.237.193
--webserver_port=0
--tserver_master_addrs=127.4.237.254:38457
--never_fsync=true
--heap_profile_path=/tmp/kudu.10073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.193
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:15.880488 10073 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:15.880753 10073 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:15.883533 10078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:15.883617 10079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:15.883792 10073 server_base.cc:1047] running on GCE node
W20251029 09:10:15.883579 10081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:15.884003 10073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:15.884301 10073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:15.885501 10073 hybrid_clock.cc:648] HybridClock initialized: now 1761729015885486 us; error 30 us; skew 500 ppm
I20251029 09:10:15.887293 10073 webserver.cc:492] Webserver started at http://127.4.237.193:32785/ using document root <none> and password file <none>
I20251029 09:10:15.887590 10073 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:15.887662 10073 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:15.887800 10073 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:15.889019 10073 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data/instance:
uuid: "a01f3c95473649bda46356953d7b84a0"
format_stamp: "Formatted at 2025-10-29 09:10:15 on dist-test-slave-z9gc"
I20251029 09:10:15.889446 10073 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/wal/instance:
uuid: "a01f3c95473649bda46356953d7b84a0"
format_stamp: "Formatted at 2025-10-29 09:10:15 on dist-test-slave-z9gc"
I20251029 09:10:15.891209 10073 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20251029 09:10:15.892203 10087 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:15.892416 10073 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:15.892482 10073 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/wal
uuid: "a01f3c95473649bda46356953d7b84a0"
format_stamp: "Formatted at 2025-10-29 09:10:15 on dist-test-slave-z9gc"
I20251029 09:10:15.892555 10073 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:15.904857 10073 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:15.905143 10073 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:15.905273 10073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:15.905503 10073 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:15.905824 10073 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:15.905866 10073 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:15.905905 10073 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:15.905936 10073 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:15.911767 10073 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.193:44211
I20251029 09:10:15.911821 10200 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.193:44211 every 8 connection(s)
I20251029 09:10:15.912142 10073 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data/info.pb
I20251029 09:10:15.917717 10201 heartbeater.cc:344] Connected to a master server at 127.4.237.254:38457
I20251029 09:10:15.917763 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 10073
I20251029 09:10:15.917860 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/wal/instance
I20251029 09:10:15.917876 10201 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:15.918174 10201 heartbeater.cc:507] Master 127.4.237.254:38457 requested a full tablet report, sending...
I20251029 09:10:15.918809 10012 ts_manager.cc:194] Registered new tserver with Master: a01f3c95473649bda46356953d7b84a0 (127.4.237.193:44211)
I20251029 09:10:15.919147 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.194:0
--local_ip_for_outbound_sockets=127.4.237.194
--webserver_interface=127.4.237.194
--webserver_port=0
--tserver_master_addrs=127.4.237.254:38457
--builtin_ntp_servers=127.4.237.212:35189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251029 09:10:15.919853 10012 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.193:42717
W20251029 09:10:16.001408 10204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:16.001624 10204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:16.001646 10204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:16.003233 10204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:16.003312 10204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.194
I20251029 09:10:16.005009 10204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:35189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.237.194
--webserver_port=0
--tserver_master_addrs=127.4.237.254:38457
--never_fsync=true
--heap_profile_path=/tmp/kudu.10204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.194
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:16.005308 10204 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:16.005555 10204 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:16.008335 10212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:16.008450 10204 server_base.cc:1047] running on GCE node
W20251029 09:10:16.008335 10210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:16.008364 10209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:16.008762 10204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:16.009004 10204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:16.010246 10204 hybrid_clock.cc:648] HybridClock initialized: now 1761729016010198 us; error 63 us; skew 500 ppm
I20251029 09:10:16.011555 10204 webserver.cc:492] Webserver started at http://127.4.237.194:37695/ using document root <none> and password file <none>
I20251029 09:10:16.011777 10204 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:16.011824 10204 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:16.011955 10204 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:16.012825 10204 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data/instance:
uuid: "d608f12f4a934ef0adc7ae783cc1627c"
format_stamp: "Formatted at 2025-10-29 09:10:16 on dist-test-slave-z9gc"
I20251029 09:10:16.013128 10204 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/wal/instance:
uuid: "d608f12f4a934ef0adc7ae783cc1627c"
format_stamp: "Formatted at 2025-10-29 09:10:16 on dist-test-slave-z9gc"
I20251029 09:10:16.014344 10204 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20251029 09:10:16.015163 10218 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:16.015338 10204 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251029 09:10:16.015408 10204 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/wal
uuid: "d608f12f4a934ef0adc7ae783cc1627c"
format_stamp: "Formatted at 2025-10-29 09:10:16 on dist-test-slave-z9gc"
I20251029 09:10:16.015470 10204 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:16.038054 10204 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:16.038326 10204 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:16.038518 10204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:16.038739 10204 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:16.039067 10204 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:16.039103 10204 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:16.039139 10204 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:16.039172 10204 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:16.044991 10204 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.194:40005
I20251029 09:10:16.045043 10331 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.194:40005 every 8 connection(s)
I20251029 09:10:16.045357 10204 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data/info.pb
I20251029 09:10:16.049986 10332 heartbeater.cc:344] Connected to a master server at 127.4.237.254:38457
I20251029 09:10:16.050108 10332 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:16.050355 10332 heartbeater.cc:507] Master 127.4.237.254:38457 requested a full tablet report, sending...
I20251029 09:10:16.050788 10012 ts_manager.cc:194] Registered new tserver with Master: d608f12f4a934ef0adc7ae783cc1627c (127.4.237.194:40005)
I20251029 09:10:16.051169 10012 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.194:46051
I20251029 09:10:16.054569 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 10204
I20251029 09:10:16.054664 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/wal/instance
I20251029 09:10:16.055958 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.195:0
--local_ip_for_outbound_sockets=127.4.237.195
--webserver_interface=127.4.237.195
--webserver_port=0
--tserver_master_addrs=127.4.237.254:38457
--builtin_ntp_servers=127.4.237.212:35189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20251029 09:10:16.138047 10335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:16.138262 10335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:16.138283 10335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:16.139904 10335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:16.139984 10335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.195
I20251029 09:10:16.141633 10335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:35189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.237.195
--webserver_port=0
--tserver_master_addrs=127.4.237.254:38457
--never_fsync=true
--heap_profile_path=/tmp/kudu.10335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.195
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:16.141891 10335 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:16.142140 10335 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:16.145017 10341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:16.145058 10343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:16.145051 10335 server_base.cc:1047] running on GCE node
W20251029 09:10:16.145051 10340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:16.145409 10335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:16.145635 10335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:16.146767 10335 hybrid_clock.cc:648] HybridClock initialized: now 1761729016146755 us; error 32 us; skew 500 ppm
I20251029 09:10:16.147933 10335 webserver.cc:492] Webserver started at http://127.4.237.195:35247/ using document root <none> and password file <none>
I20251029 09:10:16.148149 10335 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:16.148196 10335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:16.148324 10335 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:16.149231 10335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data/instance:
uuid: "74d10a0262af42f287945354c52babae"
format_stamp: "Formatted at 2025-10-29 09:10:16 on dist-test-slave-z9gc"
I20251029 09:10:16.149542 10335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/wal/instance:
uuid: "74d10a0262af42f287945354c52babae"
format_stamp: "Formatted at 2025-10-29 09:10:16 on dist-test-slave-z9gc"
I20251029 09:10:16.150815 10335 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20251029 09:10:16.151576 10349 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:16.151748 10335 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251029 09:10:16.151821 10335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/wal
uuid: "74d10a0262af42f287945354c52babae"
format_stamp: "Formatted at 2025-10-29 09:10:16 on dist-test-slave-z9gc"
I20251029 09:10:16.151890 10335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:16.169695 10335 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:16.170006 10335 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:16.170130 10335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:16.170344 10335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:16.170724 10335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251029 09:10:16.170759 10335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:16.170797 10335 ts_tablet_manager.cc:616] Registered 0 tablets
I20251029 09:10:16.170830 10335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:16.176596 10335 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.195:40019
I20251029 09:10:16.176677 10462 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.195:40019 every 8 connection(s)
I20251029 09:10:16.176991 10335 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data/info.pb
I20251029 09:10:16.181187 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 10335
I20251029 09:10:16.181288 5047 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/wal/instance
I20251029 09:10:16.181547 10463 heartbeater.cc:344] Connected to a master server at 127.4.237.254:38457
I20251029 09:10:16.181649 10463 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:16.181891 10463 heartbeater.cc:507] Master 127.4.237.254:38457 requested a full tablet report, sending...
I20251029 09:10:16.182303 10013 ts_manager.cc:194] Registered new tserver with Master: 74d10a0262af42f287945354c52babae (127.4.237.195:40019)
I20251029 09:10:16.182724 10013 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.195:38053
I20251029 09:10:16.193913 5047 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251029 09:10:16.199453 5047 test_util.cc:276] Using random seed: -2144110310
I20251029 09:10:16.205463 10013 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36070:
name: "pre_rebuild"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251029 09:10:16.205765 10013 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table pre_rebuild in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251029 09:10:16.212049 10135 tablet_service.cc:1505] Processing CreateTablet for tablet 04e508584ffc4467bda2807bc0b9df2d (DEFAULT_TABLE table=pre_rebuild [id=35486de0cb934be4bc6c2a4cafe475f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:16.212388 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e508584ffc4467bda2807bc0b9df2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:16.212589 10266 tablet_service.cc:1505] Processing CreateTablet for tablet 04e508584ffc4467bda2807bc0b9df2d (DEFAULT_TABLE table=pre_rebuild [id=35486de0cb934be4bc6c2a4cafe475f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:16.212862 10266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e508584ffc4467bda2807bc0b9df2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:16.214517 10482 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: Bootstrap starting.
I20251029 09:10:16.214967 10483 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Bootstrap starting.
I20251029 09:10:16.214990 10397 tablet_service.cc:1505] Processing CreateTablet for tablet 04e508584ffc4467bda2807bc0b9df2d (DEFAULT_TABLE table=pre_rebuild [id=35486de0cb934be4bc6c2a4cafe475f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:16.215211 10482 tablet_bootstrap.cc:654] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:16.215276 10397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e508584ffc4467bda2807bc0b9df2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:16.215515 10482 log.cc:826] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:16.215579 10483 tablet_bootstrap.cc:654] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:16.215901 10483 log.cc:826] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:16.216578 10483 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: No bootstrap required, opened a new log
I20251029 09:10:16.216655 10483 ts_tablet_manager.cc:1403] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251029 09:10:16.217542 10486 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: Bootstrap starting.
I20251029 09:10:16.217788 10483 raft_consensus.cc:359] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:16.218070 10483 raft_consensus.cc:385] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:16.218155 10483 raft_consensus.cc:740] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d608f12f4a934ef0adc7ae783cc1627c, State: Initialized, Role: FOLLOWER
I20251029 09:10:16.218168 10482 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: No bootstrap required, opened a new log
I20251029 09:10:16.218175 10486 tablet_bootstrap.cc:654] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:16.218228 10482 ts_tablet_manager.cc:1403] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251029 09:10:16.218370 10483 consensus_queue.cc:260] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:16.218473 10486 log.cc:826] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:16.218672 10483 ts_tablet_manager.cc:1434] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251029 09:10:16.218803 10332 heartbeater.cc:499] Master 127.4.237.254:38457 was elected leader, sending a full tablet report...
I20251029 09:10:16.219131 10486 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: No bootstrap required, opened a new log
I20251029 09:10:16.219249 10486 ts_tablet_manager.cc:1403] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251029 09:10:16.220268 10482 raft_consensus.cc:359] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:16.220404 10482 raft_consensus.cc:385] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:16.220427 10482 raft_consensus.cc:740] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a01f3c95473649bda46356953d7b84a0, State: Initialized, Role: FOLLOWER
I20251029 09:10:16.220384 10486 raft_consensus.cc:359] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:16.220533 10486 raft_consensus.cc:385] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:16.220508 10482 consensus_queue.cc:260] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:16.220583 10486 raft_consensus.cc:740] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d10a0262af42f287945354c52babae, State: Initialized, Role: FOLLOWER
I20251029 09:10:16.220678 10486 consensus_queue.cc:260] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:16.220741 10482 ts_tablet_manager.cc:1434] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20251029 09:10:16.220863 10201 heartbeater.cc:499] Master 127.4.237.254:38457 was elected leader, sending a full tablet report...
I20251029 09:10:16.220906 10486 ts_tablet_manager.cc:1434] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251029 09:10:16.220925 10463 heartbeater.cc:499] Master 127.4.237.254:38457 was elected leader, sending a full tablet report...
W20251029 09:10:16.295892 10333 tablet.cc:2378] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251029 09:10:16.412930 10202 tablet.cc:2378] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251029 09:10:16.427552 10464 tablet.cc:2378] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251029 09:10:16.499764 10487 raft_consensus.cc:493] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251029 09:10:16.499905 10487 raft_consensus.cc:515] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:16.500221 10487 leader_election.cc:290] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a01f3c95473649bda46356953d7b84a0 (127.4.237.193:44211), 74d10a0262af42f287945354c52babae (127.4.237.195:40019)
I20251029 09:10:16.503602 10417 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "04e508584ffc4467bda2807bc0b9df2d" candidate_uuid: "d608f12f4a934ef0adc7ae783cc1627c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d10a0262af42f287945354c52babae" is_pre_election: true
I20251029 09:10:16.503782 10417 raft_consensus.cc:2468] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d608f12f4a934ef0adc7ae783cc1627c in term 0.
I20251029 09:10:16.504045 10220 leader_election.cc:304] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d10a0262af42f287945354c52babae, d608f12f4a934ef0adc7ae783cc1627c; no voters:
I20251029 09:10:16.504132 10155 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "04e508584ffc4467bda2807bc0b9df2d" candidate_uuid: "d608f12f4a934ef0adc7ae783cc1627c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a01f3c95473649bda46356953d7b84a0" is_pre_election: true
I20251029 09:10:16.504238 10487 raft_consensus.cc:2804] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251029 09:10:16.504280 10155 raft_consensus.cc:2468] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d608f12f4a934ef0adc7ae783cc1627c in term 0.
I20251029 09:10:16.504339 10487 raft_consensus.cc:493] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251029 09:10:16.504366 10487 raft_consensus.cc:3060] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:16.507309 10487 raft_consensus.cc:515] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:16.507494 10487 leader_election.cc:290] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [CANDIDATE]: Term 1 election: Requested vote from peers a01f3c95473649bda46356953d7b84a0 (127.4.237.193:44211), 74d10a0262af42f287945354c52babae (127.4.237.195:40019)
I20251029 09:10:16.507746 10417 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "04e508584ffc4467bda2807bc0b9df2d" candidate_uuid: "d608f12f4a934ef0adc7ae783cc1627c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d10a0262af42f287945354c52babae"
I20251029 09:10:16.507793 10155 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "04e508584ffc4467bda2807bc0b9df2d" candidate_uuid: "d608f12f4a934ef0adc7ae783cc1627c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a01f3c95473649bda46356953d7b84a0"
I20251029 09:10:16.507872 10417 raft_consensus.cc:3060] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:16.507871 10155 raft_consensus.cc:3060] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:16.508750 10155 raft_consensus.cc:2468] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d608f12f4a934ef0adc7ae783cc1627c in term 1.
I20251029 09:10:16.508750 10417 raft_consensus.cc:2468] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d608f12f4a934ef0adc7ae783cc1627c in term 1.
I20251029 09:10:16.508975 10220 leader_election.cc:304] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d10a0262af42f287945354c52babae, d608f12f4a934ef0adc7ae783cc1627c; no voters:
I20251029 09:10:16.509145 10487 raft_consensus.cc:2804] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:16.509311 10487 raft_consensus.cc:697] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 1 LEADER]: Becoming Leader. State: Replica: d608f12f4a934ef0adc7ae783cc1627c, State: Running, Role: LEADER
I20251029 09:10:16.509508 10487 consensus_queue.cc:237] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:16.510493 10013 catalog_manager.cc:5649] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c reported cstate change: term changed from 0 to 1, leader changed from <none> to d608f12f4a934ef0adc7ae783cc1627c (127.4.237.194). New cstate: current_term: 1 leader_uuid: "d608f12f4a934ef0adc7ae783cc1627c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } health_report { overall_health: HEALTHY } } }
I20251029 09:10:16.573864 10417 raft_consensus.cc:1275] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 1 FOLLOWER]: Refusing update from remote peer d608f12f4a934ef0adc7ae783cc1627c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251029 09:10:16.573866 10155 raft_consensus.cc:1275] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 1 FOLLOWER]: Refusing update from remote peer d608f12f4a934ef0adc7ae783cc1627c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251029 09:10:16.574247 10492 consensus_queue.cc:1048] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251029 09:10:16.574384 10487 consensus_queue.cc:1048] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251029 09:10:16.577307 10501 mvcc.cc:204] Tried to move back new op lower bound from 7216042051884388352 to 7216042051623448576. Current Snapshot: MvccSnapshot[applied={T|T < 7216042051883425792}]
I20251029 09:10:16.578275 10500 mvcc.cc:204] Tried to move back new op lower bound from 7216042051885068288 to 7216042051623448576. Current Snapshot: MvccSnapshot[applied={T|T < 7216042051883425792}]
I20251029 09:10:16.764202 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 9982
W20251029 09:10:16.855301 10521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:16.855538 10521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:16.857249 10521 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20251029 09:10:16.876987 10521 minidump.cc:252] Setting minidump size limit to 20M
I20251029 09:10:16.877343 10521 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:16.877552 10521 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:16.880129 10542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:16.880156 10543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:16.880362 10521 server_base.cc:1047] running on GCE node
W20251029 09:10:16.880129 10545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:16.880643 10521 hybrid_clock.cc:584] initializing the hybrid clock with 'system' time source
I20251029 09:10:16.880731 10521 hybrid_clock.cc:648] HybridClock initialized: now 1761729016880730 us; error 57487 us; skew 500 ppm
I20251029 09:10:16.881726 10521 webserver.cc:492] Webserver started at http://0.0.0.0:43109/ using document root <none> and password file <none>
I20251029 09:10:16.881973 10521 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:16.882047 10521 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:16.882156 10521 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251029 09:10:16.883381 10521 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/instance:
uuid: "af01f7b8c4674281aa5e9646b3c42b63"
format_stamp: "Formatted at 2025-10-29 09:10:16 on dist-test-slave-z9gc"
I20251029 09:10:16.883788 10521 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal/instance:
uuid: "af01f7b8c4674281aa5e9646b3c42b63"
format_stamp: "Formatted at 2025-10-29 09:10:16 on dist-test-slave-z9gc"
I20251029 09:10:16.885468 10521 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20251029 09:10:16.886307 10550 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:16.886550 10521 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:16.886637 10521 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal
uuid: "af01f7b8c4674281aa5e9646b3c42b63"
format_stamp: "Formatted at 2025-10-29 09:10:16 on dist-test-slave-z9gc"
I20251029 09:10:16.886718 10521 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:16.942816 10521 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:16.943178 10521 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:16.943338 10521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:16.943825 10521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:16.946213 10521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63: Bootstrap starting.
I20251029 09:10:16.946923 10521 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:16.947525 10521 log.cc:826] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:16.948278 10521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63: No bootstrap required, opened a new log
I20251029 09:10:16.949489 10521 raft_consensus.cc:359] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af01f7b8c4674281aa5e9646b3c42b63" member_type: VOTER }
I20251029 09:10:16.949628 10521 raft_consensus.cc:385] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:16.949663 10521 raft_consensus.cc:740] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af01f7b8c4674281aa5e9646b3c42b63, State: Initialized, Role: FOLLOWER
I20251029 09:10:16.949774 10521 consensus_queue.cc:260] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af01f7b8c4674281aa5e9646b3c42b63" member_type: VOTER }
I20251029 09:10:16.949846 10521 raft_consensus.cc:399] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:16.949880 10521 raft_consensus.cc:493] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:16.949935 10521 raft_consensus.cc:3060] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:16.950556 10521 raft_consensus.cc:515] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af01f7b8c4674281aa5e9646b3c42b63" member_type: VOTER }
I20251029 09:10:16.950685 10521 leader_election.cc:304] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af01f7b8c4674281aa5e9646b3c42b63; no voters:
I20251029 09:10:16.950861 10521 leader_election.cc:290] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251029 09:10:16.950945 10557 raft_consensus.cc:2804] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:16.951115 10557 raft_consensus.cc:697] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 1 LEADER]: Becoming Leader. State: Replica: af01f7b8c4674281aa5e9646b3c42b63, State: Running, Role: LEADER
I20251029 09:10:16.951267 10557 consensus_queue.cc:237] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af01f7b8c4674281aa5e9646b3c42b63" member_type: VOTER }
I20251029 09:10:16.951642 10558 sys_catalog.cc:455] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af01f7b8c4674281aa5e9646b3c42b63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af01f7b8c4674281aa5e9646b3c42b63" member_type: VOTER } }
I20251029 09:10:16.951679 10559 sys_catalog.cc:455] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af01f7b8c4674281aa5e9646b3c42b63. Latest consensus state: current_term: 1 leader_uuid: "af01f7b8c4674281aa5e9646b3c42b63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af01f7b8c4674281aa5e9646b3c42b63" member_type: VOTER } }
I20251029 09:10:16.951857 10559 sys_catalog.cc:458] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:16.951782 10558 sys_catalog.cc:458] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:16.953020 10521 tablet_replica.cc:333] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63: stopping tablet replica
I20251029 09:10:16.953109 10521 raft_consensus.cc:2243] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 1 LEADER]: Raft consensus shutting down.
I20251029 09:10:16.953171 10521 raft_consensus.cc:2272] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251029 09:10:16.953544 10521 master.cc:561] Master@0.0.0.0:7051 shutting down...
W20251029 09:10:16.953651 10521 acceptor_pool.cc:194] Could not shut down acceptor socket on 0.0.0.0:7051: Network error: shutdown error: Transport endpoint is not connected (error 107)
I20251029 09:10:16.964591 10521 master.cc:583] Master@0.0.0.0:7051 shutdown complete.
I20251029 09:10:16.971217 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 10073
I20251029 09:10:16.977995 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 10204
I20251029 09:10:16.983875 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 10335
I20251029 09:10:16.988838 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:38457
--webserver_interface=127.4.237.254
--webserver_port=39897
--builtin_ntp_servers=127.4.237.212:35189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.237.254:38457 with env {}
W20251029 09:10:17.070530 10563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:17.070729 10563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:17.070749 10563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:17.072259 10563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251029 09:10:17.072327 10563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:17.072341 10563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251029 09:10:17.072353 10563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251029 09:10:17.074019 10563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:35189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.237.254:38457
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.237.254:38457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.237.254
--webserver_port=39897
--never_fsync=true
--heap_profile_path=/tmp/kudu.10563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:17.074290 10563 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:17.074601 10563 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:17.077132 10571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:17.077153 10568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:17.077132 10569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:17.077354 10563 server_base.cc:1047] running on GCE node
I20251029 09:10:17.077569 10563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:17.077826 10563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:17.078958 10563 hybrid_clock.cc:648] HybridClock initialized: now 1761729017078947 us; error 31 us; skew 500 ppm
I20251029 09:10:17.080178 10563 webserver.cc:492] Webserver started at http://127.4.237.254:39897/ using document root <none> and password file <none>
I20251029 09:10:17.080410 10563 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:17.080469 10563 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:17.081692 10563 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:17.082331 10577 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:17.082494 10563 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251029 09:10:17.082566 10563 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal
uuid: "af01f7b8c4674281aa5e9646b3c42b63"
format_stamp: "Formatted at 2025-10-29 09:10:16 on dist-test-slave-z9gc"
I20251029 09:10:17.082849 10563 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:17.100155 10563 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:17.100482 10563 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:17.100616 10563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:17.104712 10563 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.254:38457
I20251029 09:10:17.104764 10629 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.254:38457 every 8 connection(s)
I20251029 09:10:17.105106 10563 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/info.pb
I20251029 09:10:17.106251 10630 sys_catalog.cc:263] Verifying existing consensus state
I20251029 09:10:17.108278 10630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63: Bootstrap starting.
I20251029 09:10:17.109434 10630 log.cc:826] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:17.110934 10630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251029 09:10:17.111163 10630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63: Bootstrap complete.
I20251029 09:10:17.112459 10630 raft_consensus.cc:359] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af01f7b8c4674281aa5e9646b3c42b63" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 38457 } }
I20251029 09:10:17.112588 10630 raft_consensus.cc:740] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: af01f7b8c4674281aa5e9646b3c42b63, State: Initialized, Role: FOLLOWER
I20251029 09:10:17.112695 10630 consensus_queue.cc:260] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af01f7b8c4674281aa5e9646b3c42b63" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 38457 } }
I20251029 09:10:17.112766 10630 raft_consensus.cc:399] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251029 09:10:17.112800 10630 raft_consensus.cc:493] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251029 09:10:17.112838 10630 raft_consensus.cc:3060] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 1 FOLLOWER]: Advancing to term 2
I20251029 09:10:17.113334 10630 raft_consensus.cc:515] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af01f7b8c4674281aa5e9646b3c42b63" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 38457 } }
I20251029 09:10:17.113425 10630 leader_election.cc:304] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af01f7b8c4674281aa5e9646b3c42b63; no voters:
I20251029 09:10:17.113543 10630 leader_election.cc:290] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [CANDIDATE]: Term 2 election: Requested vote from peers
I20251029 09:10:17.113656 10633 raft_consensus.cc:2804] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 2 FOLLOWER]: Leader election won for term 2
I20251029 09:10:17.113755 10630 sys_catalog.cc:565] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [sys.catalog]: configured and running, proceeding with master startup.
I20251029 09:10:17.113842 10633 raft_consensus.cc:697] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [term 2 LEADER]: Becoming Leader. State: Replica: af01f7b8c4674281aa5e9646b3c42b63, State: Running, Role: LEADER
I20251029 09:10:17.113910 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 10563
I20251029 09:10:17.113941 10633 consensus_queue.cc:237] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af01f7b8c4674281aa5e9646b3c42b63" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 38457 } }
I20251029 09:10:17.114233 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.193:44211
--local_ip_for_outbound_sockets=127.4.237.193
--tserver_master_addrs=127.4.237.254:38457
--webserver_port=32785
--webserver_interface=127.4.237.193
--builtin_ntp_servers=127.4.237.212:35189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251029 09:10:17.114202 10633 sys_catalog.cc:455] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af01f7b8c4674281aa5e9646b3c42b63. Latest consensus state: current_term: 2 leader_uuid: "af01f7b8c4674281aa5e9646b3c42b63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af01f7b8c4674281aa5e9646b3c42b63" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 38457 } } }
I20251029 09:10:17.114277 10633 sys_catalog.cc:458] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:17.114468 10637 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251029 09:10:17.114450 10634 sys_catalog.cc:455] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "af01f7b8c4674281aa5e9646b3c42b63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af01f7b8c4674281aa5e9646b3c42b63" member_type: VOTER last_known_addr { host: "127.4.237.254" port: 38457 } } }
I20251029 09:10:17.114514 10634 sys_catalog.cc:458] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63 [sys.catalog]: This master's current role is: LEADER
I20251029 09:10:17.115351 10637 catalog_manager.cc:679] Loaded metadata for table pre_rebuild [id=2db19c7a9b094a2bb14029293a8122f2]
I20251029 09:10:17.115584 10637 tablet_loader.cc:96] loaded metadata for tablet 04e508584ffc4467bda2807bc0b9df2d (table pre_rebuild [id=2db19c7a9b094a2bb14029293a8122f2])
I20251029 09:10:17.115670 10637 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251029 09:10:17.118492 10637 catalog_manager.cc:1357] Generated new cluster ID: 5a8b9d409acd4ae38fa4271ff231d2c9
I20251029 09:10:17.118553 10637 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251029 09:10:17.136797 10637 catalog_manager.cc:1380] Generated new certificate authority record
I20251029 09:10:17.137359 10637 catalog_manager.cc:1514] Loading token signing keys...
I20251029 09:10:17.142614 10637 catalog_manager.cc:6022] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63: Generated new TSK 0
I20251029 09:10:17.142823 10637 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20251029 09:10:17.232164 10651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:17.232434 10651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:17.232479 10651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:17.235080 10651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:17.235190 10651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.193
I20251029 09:10:17.237919 10651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:35189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.193:44211
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.237.193
--webserver_port=32785
--tserver_master_addrs=127.4.237.254:38457
--never_fsync=true
--heap_profile_path=/tmp/kudu.10651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.193
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:17.238241 10651 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:17.238639 10651 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:17.241832 10658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:17.241849 10657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:17.241852 10660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:17.242053 10651 server_base.cc:1047] running on GCE node
I20251029 09:10:17.242247 10651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:17.242494 10651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:17.243635 10651 hybrid_clock.cc:648] HybridClock initialized: now 1761729017243618 us; error 37 us; skew 500 ppm
I20251029 09:10:17.244855 10651 webserver.cc:492] Webserver started at http://127.4.237.193:32785/ using document root <none> and password file <none>
I20251029 09:10:17.245075 10651 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:17.245143 10651 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:17.246587 10651 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:17.247442 10666 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:17.247637 10651 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:17.247715 10651 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/wal
uuid: "a01f3c95473649bda46356953d7b84a0"
format_stamp: "Formatted at 2025-10-29 09:10:15 on dist-test-slave-z9gc"
I20251029 09:10:17.247997 10651 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:17.261327 10651 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:17.261611 10651 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:17.261732 10651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:17.261955 10651 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:17.262458 10673 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251029 09:10:17.263707 10651 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251029 09:10:17.263770 10651 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251029 09:10:17.263818 10651 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251029 09:10:17.264515 10651 ts_tablet_manager.cc:616] Registered 1 tablets
I20251029 09:10:17.264561 10651 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20251029 09:10:17.264669 10673 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: Bootstrap starting.
I20251029 09:10:17.272046 10651 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.193:44211
I20251029 09:10:17.272137 10780 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.193:44211 every 8 connection(s)
I20251029 09:10:17.272573 10651 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data/info.pb
I20251029 09:10:17.279487 10781 heartbeater.cc:344] Connected to a master server at 127.4.237.254:38457
I20251029 09:10:17.279608 10781 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:17.279832 10781 heartbeater.cc:507] Master 127.4.237.254:38457 requested a full tablet report, sending...
I20251029 09:10:17.280529 10594 ts_manager.cc:194] Registered new tserver with Master: a01f3c95473649bda46356953d7b84a0 (127.4.237.193:44211)
I20251029 09:10:17.280576 10673 log.cc:826] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:17.281435 10594 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.193:51283
I20251029 09:10:17.281677 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 10651
I20251029 09:10:17.281980 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.194:40005
--local_ip_for_outbound_sockets=127.4.237.194
--tserver_master_addrs=127.4.237.254:38457
--webserver_port=37695
--webserver_interface=127.4.237.194
--builtin_ntp_servers=127.4.237.212:35189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251029 09:10:17.312605 10673 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=10550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251029 09:10:17.312995 10673 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: Bootstrap complete.
I20251029 09:10:17.313933 10673 ts_tablet_manager.cc:1403] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: Time spent bootstrapping tablet: real 0.049s user 0.029s sys 0.015s
I20251029 09:10:17.314981 10673 raft_consensus.cc:359] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:17.315333 10673 raft_consensus.cc:740] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a01f3c95473649bda46356953d7b84a0, State: Initialized, Role: FOLLOWER
I20251029 09:10:17.315461 10673 consensus_queue.cc:260] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 1.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:17.315778 10673 ts_tablet_manager.cc:1434] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
I20251029 09:10:17.315780 10781 heartbeater.cc:499] Master 127.4.237.254:38457 was elected leader, sending a full tablet report...
W20251029 09:10:17.385552 10786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:17.385758 10786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:17.385789 10786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:17.387388 10786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:17.387454 10786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.194
I20251029 09:10:17.389003 10786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:35189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.194:40005
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.237.194
--webserver_port=37695
--tserver_master_addrs=127.4.237.254:38457
--never_fsync=true
--heap_profile_path=/tmp/kudu.10786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.194
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:17.389235 10786 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:17.389462 10786 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251029 09:10:17.392059 10786 server_base.cc:1047] running on GCE node
W20251029 09:10:17.392045 10795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:17.392045 10792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:17.392033 10793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:17.392431 10786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:17.392648 10786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:17.393787 10786 hybrid_clock.cc:648] HybridClock initialized: now 1761729017393770 us; error 31 us; skew 500 ppm
I20251029 09:10:17.394946 10786 webserver.cc:492] Webserver started at http://127.4.237.194:37695/ using document root <none> and password file <none>
I20251029 09:10:17.395150 10786 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:17.395215 10786 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:17.396466 10786 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:17.397178 10801 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:17.397372 10786 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251029 09:10:17.397444 10786 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/wal
uuid: "d608f12f4a934ef0adc7ae783cc1627c"
format_stamp: "Formatted at 2025-10-29 09:10:16 on dist-test-slave-z9gc"
I20251029 09:10:17.397733 10786 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:17.415673 10786 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:17.415952 10786 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:17.416082 10786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:17.416301 10786 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:17.416724 10808 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251029 09:10:17.417660 10786 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251029 09:10:17.417706 10786 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251029 09:10:17.417733 10786 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251029 09:10:17.418296 10786 ts_tablet_manager.cc:616] Registered 1 tablets
I20251029 09:10:17.418330 10786 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20251029 09:10:17.418467 10808 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Bootstrap starting.
I20251029 09:10:17.425045 10786 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.194:40005
I20251029 09:10:17.425129 10915 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.194:40005 every 8 connection(s)
I20251029 09:10:17.425444 10786 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data/info.pb
I20251029 09:10:17.428205 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 10786
I20251029 09:10:17.428529 5047 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskeGWyaM/build/release/bin/kudu
/tmp/dist-test-taskeGWyaM/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.237.195:40019
--local_ip_for_outbound_sockets=127.4.237.195
--tserver_master_addrs=127.4.237.254:38457
--webserver_port=35247
--webserver_interface=127.4.237.195
--builtin_ntp_servers=127.4.237.212:35189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251029 09:10:17.431648 10916 heartbeater.cc:344] Connected to a master server at 127.4.237.254:38457
I20251029 09:10:17.431759 10916 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:17.431962 10916 heartbeater.cc:507] Master 127.4.237.254:38457 requested a full tablet report, sending...
I20251029 09:10:17.432473 10594 ts_manager.cc:194] Registered new tserver with Master: d608f12f4a934ef0adc7ae783cc1627c (127.4.237.194:40005)
I20251029 09:10:17.432883 10594 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.194:50673
I20251029 09:10:17.435132 10808 log.cc:826] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:17.485955 10808 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=10550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251029 09:10:17.486346 10808 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Bootstrap complete.
I20251029 09:10:17.487373 10808 ts_tablet_manager.cc:1403] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Time spent bootstrapping tablet: real 0.069s user 0.037s sys 0.030s
I20251029 09:10:17.488281 10808 raft_consensus.cc:359] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:17.488482 10808 raft_consensus.cc:740] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d608f12f4a934ef0adc7ae783cc1627c, State: Initialized, Role: FOLLOWER
I20251029 09:10:17.488612 10808 consensus_queue.cc:260] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 1.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:17.488930 10808 ts_tablet_manager.cc:1434] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20251029 09:10:17.488987 10916 heartbeater.cc:499] Master 127.4.237.254:38457 was elected leader, sending a full tablet report...
W20251029 09:10:17.533917 10919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251029 09:10:17.534123 10919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251029 09:10:17.534145 10919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251029 09:10:17.535779 10919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251029 09:10:17.535868 10919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.237.195
I20251029 09:10:17.537572 10919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.237.212:35189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.237.195:40019
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.237.195
--webserver_port=35247
--tserver_master_addrs=127.4.237.254:38457
--never_fsync=true
--heap_profile_path=/tmp/kudu.10919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.237.195
--log_dir=/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 60f5e5267b92c39485a66121d3ce3cc7ef57b0e0
build type RELEASE
built by None at 29 Oct 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 8771
I20251029 09:10:17.537834 10919 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251029 09:10:17.538090 10919 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251029 09:10:17.541025 10926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:17.541028 10929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251029 09:10:17.541024 10927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251029 09:10:17.541227 10919 server_base.cc:1047] running on GCE node
I20251029 09:10:17.541445 10919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251029 09:10:17.541710 10919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251029 09:10:17.542855 10919 hybrid_clock.cc:648] HybridClock initialized: now 1761729017542842 us; error 25 us; skew 500 ppm
I20251029 09:10:17.544148 10919 webserver.cc:492] Webserver started at http://127.4.237.195:35247/ using document root <none> and password file <none>
I20251029 09:10:17.544379 10919 fs_manager.cc:362] Metadata directory not provided
I20251029 09:10:17.544457 10919 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251029 09:10:17.545866 10919 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:17.546749 10935 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:17.547012 10919 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:17.547097 10919 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data,/tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/wal
uuid: "74d10a0262af42f287945354c52babae"
format_stamp: "Formatted at 2025-10-29 09:10:16 on dist-test-slave-z9gc"
I20251029 09:10:17.547390 10919 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251029 09:10:17.555919 10919 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251029 09:10:17.556213 10919 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251029 09:10:17.556330 10919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251029 09:10:17.556535 10919 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251029 09:10:17.557027 10942 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251029 09:10:17.557919 10919 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251029 09:10:17.557968 10919 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251029 09:10:17.558005 10919 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251029 09:10:17.558714 10919 ts_tablet_manager.cc:616] Registered 1 tablets
I20251029 09:10:17.558751 10919 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:17.558794 10942 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: Bootstrap starting.
I20251029 09:10:17.564677 10919 rpc_server.cc:307] RPC server started. Bound to: 127.4.237.195:40019
I20251029 09:10:17.564740 11049 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.237.195:40019 every 8 connection(s)
I20251029 09:10:17.565074 10919 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data/info.pb
I20251029 09:10:17.568542 5047 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskeGWyaM/build/release/bin/kudu as pid 10919
I20251029 09:10:17.570945 11050 heartbeater.cc:344] Connected to a master server at 127.4.237.254:38457
I20251029 09:10:17.571092 11050 heartbeater.cc:461] Registering TS with master...
I20251029 09:10:17.571403 11050 heartbeater.cc:507] Master 127.4.237.254:38457 requested a full tablet report, sending...
I20251029 09:10:17.572081 10594 ts_manager.cc:194] Registered new tserver with Master: 74d10a0262af42f287945354c52babae (127.4.237.195:40019)
I20251029 09:10:17.573166 10594 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.237.195:46491
I20251029 09:10:17.573570 10942 log.cc:826] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: Log is configured to *not* fsync() on all Append() calls
I20251029 09:10:17.573999 5047 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251029 09:10:17.607404 10942 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=10550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251029 09:10:17.607775 10942 tablet_bootstrap.cc:492] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: Bootstrap complete.
I20251029 09:10:17.608623 10942 ts_tablet_manager.cc:1403] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: Time spent bootstrapping tablet: real 0.050s user 0.037s sys 0.011s
I20251029 09:10:17.609500 10942 raft_consensus.cc:359] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:17.609738 10942 raft_consensus.cc:740] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d10a0262af42f287945354c52babae, State: Initialized, Role: FOLLOWER
I20251029 09:10:17.609824 10942 consensus_queue.cc:260] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 1.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:17.610121 10942 ts_tablet_manager.cc:1434] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20251029 09:10:17.610178 11050 heartbeater.cc:499] Master 127.4.237.254:38457 was elected leader, sending a full tablet report...
I20251029 09:10:18.791111 11062 raft_consensus.cc:493] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251029 09:10:18.791249 11062 raft_consensus.cc:515] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:18.791586 11062 leader_election.cc:290] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a01f3c95473649bda46356953d7b84a0 (127.4.237.193:44211), 74d10a0262af42f287945354c52babae (127.4.237.195:40019)
I20251029 09:10:18.795223 11004 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "04e508584ffc4467bda2807bc0b9df2d" candidate_uuid: "d608f12f4a934ef0adc7ae783cc1627c" candidate_term: 2 candidate_status { last_received { term: 1 index: 212 } } ignore_live_leader: false dest_uuid: "74d10a0262af42f287945354c52babae" is_pre_election: true
I20251029 09:10:18.795223 10735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "04e508584ffc4467bda2807bc0b9df2d" candidate_uuid: "d608f12f4a934ef0adc7ae783cc1627c" candidate_term: 2 candidate_status { last_received { term: 1 index: 212 } } ignore_live_leader: false dest_uuid: "a01f3c95473649bda46356953d7b84a0" is_pre_election: true
I20251029 09:10:18.795390 10735 raft_consensus.cc:2468] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d608f12f4a934ef0adc7ae783cc1627c in term 1.
I20251029 09:10:18.795390 11004 raft_consensus.cc:2468] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d608f12f4a934ef0adc7ae783cc1627c in term 1.
I20251029 09:10:18.795678 10802 leader_election.cc:304] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a01f3c95473649bda46356953d7b84a0, d608f12f4a934ef0adc7ae783cc1627c; no voters:
I20251029 09:10:18.795818 11062 raft_consensus.cc:2804] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251029 09:10:18.795881 11062 raft_consensus.cc:493] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251029 09:10:18.795897 11062 raft_consensus.cc:3060] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 1 FOLLOWER]: Advancing to term 2
I20251029 09:10:18.796913 11062 raft_consensus.cc:515] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:18.797061 11062 leader_election.cc:290] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [CANDIDATE]: Term 2 election: Requested vote from peers a01f3c95473649bda46356953d7b84a0 (127.4.237.193:44211), 74d10a0262af42f287945354c52babae (127.4.237.195:40019)
I20251029 09:10:18.797286 10735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "04e508584ffc4467bda2807bc0b9df2d" candidate_uuid: "d608f12f4a934ef0adc7ae783cc1627c" candidate_term: 2 candidate_status { last_received { term: 1 index: 212 } } ignore_live_leader: false dest_uuid: "a01f3c95473649bda46356953d7b84a0"
I20251029 09:10:18.797286 11004 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "04e508584ffc4467bda2807bc0b9df2d" candidate_uuid: "d608f12f4a934ef0adc7ae783cc1627c" candidate_term: 2 candidate_status { last_received { term: 1 index: 212 } } ignore_live_leader: false dest_uuid: "74d10a0262af42f287945354c52babae"
I20251029 09:10:18.797386 11004 raft_consensus.cc:3060] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 1 FOLLOWER]: Advancing to term 2
I20251029 09:10:18.797386 10735 raft_consensus.cc:3060] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 1 FOLLOWER]: Advancing to term 2
I20251029 09:10:18.798807 10735 raft_consensus.cc:2468] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d608f12f4a934ef0adc7ae783cc1627c in term 2.
I20251029 09:10:18.799091 11004 raft_consensus.cc:2468] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d608f12f4a934ef0adc7ae783cc1627c in term 2.
I20251029 09:10:18.799177 10802 leader_election.cc:304] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a01f3c95473649bda46356953d7b84a0, d608f12f4a934ef0adc7ae783cc1627c; no voters:
I20251029 09:10:18.799326 11062 raft_consensus.cc:2804] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 2 FOLLOWER]: Leader election won for term 2
I20251029 09:10:18.799451 11062 raft_consensus.cc:697] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 2 LEADER]: Becoming Leader. State: Replica: d608f12f4a934ef0adc7ae783cc1627c, State: Running, Role: LEADER
I20251029 09:10:18.799546 11062 consensus_queue.cc:237] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 212, Committed index: 212, Last appended: 1.212, Last appended by leader: 212, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:18.800328 10594 catalog_manager.cc:5649] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c reported cstate change: term changed from 0 to 2, leader changed from <none> to d608f12f4a934ef0adc7ae783cc1627c (127.4.237.194), VOTER 74d10a0262af42f287945354c52babae (127.4.237.195) added, VOTER a01f3c95473649bda46356953d7b84a0 (127.4.237.193) added, VOTER d608f12f4a934ef0adc7ae783cc1627c (127.4.237.194) added. New cstate: current_term: 2 leader_uuid: "d608f12f4a934ef0adc7ae783cc1627c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } health_report { overall_health: HEALTHY } } }
W20251029 09:10:19.094707 5047 scanner-internal.cc:458] Time spent opening tablet: real 1.511s user 0.001s sys 0.001s
I20251029 09:10:19.135612 10715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:19.135679 10984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:19.135787 10850 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
af01f7b8c4674281aa5e9646b3c42b63 | 127.4.237.254:38457 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.4.237.212:35189 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
74d10a0262af42f287945354c52babae | 127.4.237.195:40019 | HEALTHY | <none> | 0 | 0
a01f3c95473649bda46356953d7b84a0 | 127.4.237.193:44211 | HEALTHY | <none> | 0 | 0
d608f12f4a934ef0adc7ae783cc1627c | 127.4.237.194:40005 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.4.237.193 | experimental | 127.4.237.193:44211
local_ip_for_outbound_sockets | 127.4.237.194 | experimental | 127.4.237.194:40005
local_ip_for_outbound_sockets | 127.4.237.195 | experimental | 127.4.237.195:40019
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data/info.pb | hidden | 127.4.237.193:44211
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data/info.pb | hidden | 127.4.237.194:40005
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data/info.pb | hidden | 127.4.237.195:40019
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.4.237.212:35189 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 04e508584ffc4467bda2807bc0b9df2d of table 'pre_rebuild' is conflicted: 2 replicas' active configs disagree with the leader master's
a01f3c95473649bda46356953d7b84a0 (127.4.237.193:44211): RUNNING
74d10a0262af42f287945354c52babae (127.4.237.195:40019): RUNNING
d608f12f4a934ef0adc7ae783cc1627c (127.4.237.194:40005): RUNNING [LEADER]
All reported replicas are:
A = a01f3c95473649bda46356953d7b84a0
B = 74d10a0262af42f287945354c52babae
C = d608f12f4a934ef0adc7ae783cc1627c
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A B C* | | | Yes
A | A B C | 2 | -1 | Yes
B | A B C | 2 | -1 | Yes
C | A B C* | 2 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-------------+----+--------------------+---------------+---------+------------+------------------+-------------
pre_rebuild | 1 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20251029 09:10:19.149119 5047 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20251029 09:10:19.324131 10984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:19.324415 10715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:19.328868 11004 raft_consensus.cc:1275] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 2 FOLLOWER]: Refusing update from remote peer d608f12f4a934ef0adc7ae783cc1627c: Log matching property violated. Preceding OpId in replica: term: 1 index: 212. Preceding OpId from leader: term: 2 index: 213. (index mismatch)
I20251029 09:10:19.329046 10850 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251029 09:10:19.330488 11124 consensus_queue.cc:1048] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 213, Last known committed idx: 212, Time since last communication: 0.000s
I20251029 09:10:19.332613 10735 raft_consensus.cc:1275] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 2 FOLLOWER]: Refusing update from remote peer d608f12f4a934ef0adc7ae783cc1627c: Log matching property violated. Preceding OpId in replica: term: 1 index: 212. Preceding OpId from leader: term: 2 index: 213. (index mismatch)
I20251029 09:10:19.333110 11124 consensus_queue.cc:1048] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 213, Last known committed idx: 212, Time since last communication: 0.000s
I20251029 09:10:19.336464 10870 consensus_queue.cc:237] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 213, Committed index: 213, Last appended: 2.213, Last appended by leader: 212, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 214 OBSOLETE_local: false peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
af01f7b8c4674281aa5e9646b3c42b63 | 127.4.237.254:38457 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.4.237.212:35189 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
I20251029 09:10:19.337040 11004 raft_consensus.cc:1275] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 2 FOLLOWER]: Refusing update from remote peer d608f12f4a934ef0adc7ae783cc1627c: Log matching property violated. Preceding OpId in replica: term: 2 index: 213. Preceding OpId from leader: term: 2 index: 214. (index mismatch)
----------------------------------+---------------------+---------+----------+----------------+-----------------
74d10a0262af42f287945354c52babae | 127.4.237.195:40019 | HEALTHY | <none> | 0 | 0
a01f3c95473649bda46356953d7b84a0 | 127.4.237.193:44211 | HEALTHY | <none> | 0 | 0
d608f12f4a934ef0adc7ae783cc1627c | 127.4.237.194:40005 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.4.237.193 | experimental | 127.4.237.193:44211
local_ip_for_outbound_sockets | 127.4.237.194 | experimental | 127.4.237.194:40005
local_ip_for_outbound_sockets | 127.4.237.195 | experimental | 127.4.237.195:40019
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data/info.pb | hidden | 127.4.237.193:44211
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data/info.pb | hidden | 127.4.237.194:40005
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data/info.pb | hidden | 127.4.237.195:40019
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.4.237.212:35189 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 04e508584ffc4467bda2807bc0b9df2d of table 'pre_rebuild' is conflicted: 2 replicas' active configs disagree with the leader master's
a01f3c95473649bda46356953d7b84a0 (127.4.237.193:44211): RUNNING
74d10a0262af42f287945354c52babae (127.4.237.195:40019): RUNNING
d608f12f4a934ef0adc7ae783cc1627c (127.4.237.194:40005): RUNNING [LEADER]
All reported replicas are:
A = a01f3c95473649bda46356953d7b84a0
I20251029 09:10:19.337316 11127 consensus_queue.cc:1048] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 214, Last known committed idx: 213, Time since last communication: 0.000s
B = 74d10a0262af42f287945354c52babae
C = d608f12f4a934ef0adc7ae783cc1627c
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A B C* | | | Yes
A | A B C | 2 | -1 | Yes
B | A B C | 2 | -1 | Yes
C | A B C* | 2 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-------------+----+--------------------+---------------+---------+------------+------------------+-------------
pre_rebuild | 1 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20251029 09:10:19.338481 5047 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20251029 09:10:19.338783 11124 raft_consensus.cc:2955] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 2 LEADER]: Committing config change with OpId 2.214: config changed from index -1 to 214, VOTER a01f3c95473649bda46356953d7b84a0 (127.4.237.193) evicted. New config: { opid_index: 214 OBSOLETE_local: false peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } } }
I20251029 09:10:19.338935 11004 raft_consensus.cc:2955] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 2 FOLLOWER]: Committing config change with OpId 2.214: config changed from index -1 to 214, VOTER a01f3c95473649bda46356953d7b84a0 (127.4.237.193) evicted. New config: { opid_index: 214 OBSOLETE_local: false peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } } }
I20251029 09:10:19.339846 10580 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 04e508584ffc4467bda2807bc0b9df2d with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251029 09:10:19.340067 10594 catalog_manager.cc:5649] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae reported cstate change: config changed from index -1 to 214, VOTER a01f3c95473649bda46356953d7b84a0 (127.4.237.193) evicted. New cstate: current_term: 2 leader_uuid: "d608f12f4a934ef0adc7ae783cc1627c" committed_config { opid_index: 214 OBSOLETE_local: false peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } } peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } } }
I20251029 09:10:19.341205 10870 consensus_queue.cc:237] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 214, Committed index: 214, Last appended: 2.214, Last appended by leader: 212, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 215 OBSOLETE_local: false peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } }
I20251029 09:10:19.341421 11131 raft_consensus.cc:2955] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 2 LEADER]: Committing config change with OpId 2.215: config changed from index 214 to 215, VOTER 74d10a0262af42f287945354c52babae (127.4.237.195) evicted. New config: { opid_index: 215 OBSOLETE_local: false peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } } }
I20251029 09:10:19.342275 10580 catalog_manager.cc:5162] ChangeConfig:REMOVE_PEER RPC for tablet 04e508584ffc4467bda2807bc0b9df2d with cas_config_opid_index 214: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251029 09:10:19.342468 10594 catalog_manager.cc:5649] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c reported cstate change: config changed from index 214 to 215, VOTER 74d10a0262af42f287945354c52babae (127.4.237.195) evicted. New cstate: current_term: 2 leader_uuid: "d608f12f4a934ef0adc7ae783cc1627c" committed_config { opid_index: 215 OBSOLETE_local: false peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } health_report { overall_health: HEALTHY } } }
I20251029 09:10:19.343693 10715 tablet_service.cc:1552] Processing DeleteTablet for tablet 04e508584ffc4467bda2807bc0b9df2d with delete_type TABLET_DATA_TOMBSTONED (TS a01f3c95473649bda46356953d7b84a0 not found in new config with opid_index 214) from {username='slave'} at 127.0.0.1:36168
I20251029 09:10:19.343914 11140 tablet_replica.cc:333] stopping tablet replica
I20251029 09:10:19.344004 11140 raft_consensus.cc:2243] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251029 09:10:19.344064 11140 raft_consensus.cc:2272] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251029 09:10:19.344388 11140 ts_tablet_manager.cc:1916] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251029 09:10:19.345595 10984 tablet_service.cc:1552] Processing DeleteTablet for tablet 04e508584ffc4467bda2807bc0b9df2d with delete_type TABLET_DATA_TOMBSTONED (TS 74d10a0262af42f287945354c52babae not found in new config with opid_index 215) from {username='slave'} at 127.0.0.1:57458
I20251029 09:10:19.345712 11140 ts_tablet_manager.cc:1929] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.213
I20251029 09:10:19.345790 11140 log.cc:1199] T 04e508584ffc4467bda2807bc0b9df2d P a01f3c95473649bda46356953d7b84a0: Deleting WAL directory at /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/wal/wals/04e508584ffc4467bda2807bc0b9df2d
I20251029 09:10:19.345935 11141 tablet_replica.cc:333] stopping tablet replica
I20251029 09:10:19.346033 11141 raft_consensus.cc:2243] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 2 FOLLOWER]: Raft consensus shutting down.
I20251029 09:10:19.346109 11141 raft_consensus.cc:2272] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae [term 2 FOLLOWER]: Raft consensus is shut down!
I20251029 09:10:19.346218 10578 catalog_manager.cc:4985] TS a01f3c95473649bda46356953d7b84a0 (127.4.237.193:44211): tablet 04e508584ffc4467bda2807bc0b9df2d (table pre_rebuild [id=2db19c7a9b094a2bb14029293a8122f2]) successfully deleted
I20251029 09:10:19.346463 11141 ts_tablet_manager.cc:1916] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251029 09:10:19.347785 11141 ts_tablet_manager.cc:1929] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.214
I20251029 09:10:19.347860 11141 log.cc:1199] T 04e508584ffc4467bda2807bc0b9df2d P 74d10a0262af42f287945354c52babae: Deleting WAL directory at /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/wal/wals/04e508584ffc4467bda2807bc0b9df2d
I20251029 09:10:19.348387 10579 catalog_manager.cc:4985] TS 74d10a0262af42f287945354c52babae (127.4.237.195:40019): tablet 04e508584ffc4467bda2807bc0b9df2d (table pre_rebuild [id=2db19c7a9b094a2bb14029293a8122f2]) successfully deleted
I20251029 09:10:19.589018 10984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:19.590242 10850 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251029 09:10:19.590775 10715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
af01f7b8c4674281aa5e9646b3c42b63 | 127.4.237.254:38457 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.4.237.212:35189 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
74d10a0262af42f287945354c52babae | 127.4.237.195:40019 | HEALTHY | <none> | 0 | 0
a01f3c95473649bda46356953d7b84a0 | 127.4.237.193:44211 | HEALTHY | <none> | 0 | 0
d608f12f4a934ef0adc7ae783cc1627c | 127.4.237.194:40005 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.4.237.193 | experimental | 127.4.237.193:44211
local_ip_for_outbound_sockets | 127.4.237.194 | experimental | 127.4.237.194:40005
local_ip_for_outbound_sockets | 127.4.237.195 | experimental | 127.4.237.195:40019
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data/info.pb | hidden | 127.4.237.193:44211
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data/info.pb | hidden | 127.4.237.194:40005
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data/info.pb | hidden | 127.4.237.195:40019
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.4.237.212:35189 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-------------+----+---------+---------------+---------+------------+------------------+-------------
pre_rebuild | 1 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 0
Median | 0
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 1
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20251029 09:10:19.598366 5047 log_verifier.cc:126] Checking tablet 04e508584ffc4467bda2807bc0b9df2d
I20251029 09:10:19.612636 5047 log_verifier.cc:177] Verified matching terms for 215 ops in tablet 04e508584ffc4467bda2807bc0b9df2d
I20251029 09:10:19.613160 10594 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36092:
table { table_name: "pre_rebuild" } modify_external_catalogs: true
I20251029 09:10:19.613268 10594 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36092:
table { table_name: "pre_rebuild" } modify_external_catalogs: true
I20251029 09:10:19.614002 10594 catalog_manager.cc:5936] T 00000000000000000000000000000000 P af01f7b8c4674281aa5e9646b3c42b63: Sending DeleteTablet for 1 replicas of tablet 04e508584ffc4467bda2807bc0b9df2d
I20251029 09:10:19.614365 5047 test_util.cc:276] Using random seed: -2140695397
I20251029 09:10:19.614341 10850 tablet_service.cc:1552] Processing DeleteTablet for tablet 04e508584ffc4467bda2807bc0b9df2d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-29 09:10:19 UTC) from {username='slave'} at 127.0.0.1:52220
I20251029 09:10:19.614673 11165 tablet_replica.cc:333] stopping tablet replica
I20251029 09:10:19.614785 11165 raft_consensus.cc:2243] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 2 LEADER]: Raft consensus shutting down.
I20251029 09:10:19.614871 11165 raft_consensus.cc:2272] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c [term 2 FOLLOWER]: Raft consensus is shut down!
I20251029 09:10:19.616012 11165 ts_tablet_manager.cc:1916] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251029 09:10:19.617913 11165 ts_tablet_manager.cc:1929] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.215
I20251029 09:10:19.617987 11165 log.cc:1199] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Deleting WAL directory at /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/wal/wals/04e508584ffc4467bda2807bc0b9df2d
I20251029 09:10:19.618288 11165 ts_tablet_manager.cc:1950] T 04e508584ffc4467bda2807bc0b9df2d P d608f12f4a934ef0adc7ae783cc1627c: Deleting consensus metadata
I20251029 09:10:19.618777 10580 catalog_manager.cc:4985] TS d608f12f4a934ef0adc7ae783cc1627c (127.4.237.194:40005): tablet 04e508584ffc4467bda2807bc0b9df2d (table pre_rebuild [id=2db19c7a9b094a2bb14029293a8122f2]) successfully deleted
I20251029 09:10:19.619727 10594 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36182:
name: "post_rebuild"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251029 09:10:19.620009 10594 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table post_rebuild in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251029 09:10:19.621436 10850 tablet_service.cc:1505] Processing CreateTablet for tablet 4783871a899148fc85245d01f636c858 (DEFAULT_TABLE table=post_rebuild [id=804f36187aff4173a6151cd51dc67452]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:19.621518 10984 tablet_service.cc:1505] Processing CreateTablet for tablet 4783871a899148fc85245d01f636c858 (DEFAULT_TABLE table=post_rebuild [id=804f36187aff4173a6151cd51dc67452]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:19.621519 10715 tablet_service.cc:1505] Processing CreateTablet for tablet 4783871a899148fc85245d01f636c858 (DEFAULT_TABLE table=post_rebuild [id=804f36187aff4173a6151cd51dc67452]), partition=RANGE (key) PARTITION UNBOUNDED
I20251029 09:10:19.621587 10850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4783871a899148fc85245d01f636c858. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:19.621704 10984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4783871a899148fc85245d01f636c858. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:19.621706 10715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4783871a899148fc85245d01f636c858. 1 dirs total, 0 dirs full, 0 dirs failed
I20251029 09:10:19.622797 11171 tablet_bootstrap.cc:492] T 4783871a899148fc85245d01f636c858 P d608f12f4a934ef0adc7ae783cc1627c: Bootstrap starting.
I20251029 09:10:19.623158 11172 tablet_bootstrap.cc:492] T 4783871a899148fc85245d01f636c858 P 74d10a0262af42f287945354c52babae: Bootstrap starting.
I20251029 09:10:19.623288 11171 tablet_bootstrap.cc:654] T 4783871a899148fc85245d01f636c858 P d608f12f4a934ef0adc7ae783cc1627c: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:19.623626 11172 tablet_bootstrap.cc:654] T 4783871a899148fc85245d01f636c858 P 74d10a0262af42f287945354c52babae: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:19.623872 11171 tablet_bootstrap.cc:492] T 4783871a899148fc85245d01f636c858 P d608f12f4a934ef0adc7ae783cc1627c: No bootstrap required, opened a new log
I20251029 09:10:19.623931 11171 ts_tablet_manager.cc:1403] T 4783871a899148fc85245d01f636c858 P d608f12f4a934ef0adc7ae783cc1627c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:19.624013 11173 tablet_bootstrap.cc:492] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0: Bootstrap starting.
I20251029 09:10:19.624058 11171 raft_consensus.cc:359] T 4783871a899148fc85245d01f636c858 P d608f12f4a934ef0adc7ae783cc1627c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } } peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } }
I20251029 09:10:19.624131 11171 raft_consensus.cc:385] T 4783871a899148fc85245d01f636c858 P d608f12f4a934ef0adc7ae783cc1627c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:19.624163 11171 raft_consensus.cc:740] T 4783871a899148fc85245d01f636c858 P d608f12f4a934ef0adc7ae783cc1627c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d608f12f4a934ef0adc7ae783cc1627c, State: Initialized, Role: FOLLOWER
I20251029 09:10:19.624245 11171 consensus_queue.cc:260] T 4783871a899148fc85245d01f636c858 P d608f12f4a934ef0adc7ae783cc1627c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } } peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } }
I20251029 09:10:19.624312 11172 tablet_bootstrap.cc:492] T 4783871a899148fc85245d01f636c858 P 74d10a0262af42f287945354c52babae: No bootstrap required, opened a new log
I20251029 09:10:19.624369 11172 ts_tablet_manager.cc:1403] T 4783871a899148fc85245d01f636c858 P 74d10a0262af42f287945354c52babae: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:19.624444 11173 tablet_bootstrap.cc:654] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0: Neither blocks nor log segments found. Creating new log.
I20251029 09:10:19.624518 11172 raft_consensus.cc:359] T 4783871a899148fc85245d01f636c858 P 74d10a0262af42f287945354c52babae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } } peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } }
I20251029 09:10:19.624581 11172 raft_consensus.cc:385] T 4783871a899148fc85245d01f636c858 P 74d10a0262af42f287945354c52babae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:19.624612 11172 raft_consensus.cc:740] T 4783871a899148fc85245d01f636c858 P 74d10a0262af42f287945354c52babae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d10a0262af42f287945354c52babae, State: Initialized, Role: FOLLOWER
I20251029 09:10:19.624652 11172 consensus_queue.cc:260] T 4783871a899148fc85245d01f636c858 P 74d10a0262af42f287945354c52babae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } } peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } }
I20251029 09:10:19.624737 11172 ts_tablet_manager.cc:1434] T 4783871a899148fc85245d01f636c858 P 74d10a0262af42f287945354c52babae: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251029 09:10:19.624738 11171 ts_tablet_manager.cc:1434] T 4783871a899148fc85245d01f636c858 P d608f12f4a934ef0adc7ae783cc1627c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:19.625139 11173 tablet_bootstrap.cc:492] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0: No bootstrap required, opened a new log
I20251029 09:10:19.625195 11173 ts_tablet_manager.cc:1403] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251029 09:10:19.625368 11173 raft_consensus.cc:359] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } } peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } }
I20251029 09:10:19.625456 11173 raft_consensus.cc:385] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251029 09:10:19.625492 11173 raft_consensus.cc:740] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a01f3c95473649bda46356953d7b84a0, State: Initialized, Role: FOLLOWER
I20251029 09:10:19.625545 11173 consensus_queue.cc:260] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } } peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } }
I20251029 09:10:19.625677 11173 ts_tablet_manager.cc:1434] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20251029 09:10:19.677879 10917 tablet.cc:2378] T 4783871a899148fc85245d01f636c858 P d608f12f4a934ef0adc7ae783cc1627c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251029 09:10:19.685974 11133 raft_consensus.cc:493] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251029 09:10:19.686096 11133 raft_consensus.cc:515] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } } peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } }
I20251029 09:10:19.686574 11133 leader_election.cc:290] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d608f12f4a934ef0adc7ae783cc1627c (127.4.237.194:40005), 74d10a0262af42f287945354c52babae (127.4.237.195:40019)
I20251029 09:10:19.690647 11004 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4783871a899148fc85245d01f636c858" candidate_uuid: "a01f3c95473649bda46356953d7b84a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d10a0262af42f287945354c52babae" is_pre_election: true
I20251029 09:10:19.690788 11004 raft_consensus.cc:2468] T 4783871a899148fc85245d01f636c858 P 74d10a0262af42f287945354c52babae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a01f3c95473649bda46356953d7b84a0 in term 0.
I20251029 09:10:19.690995 10668 leader_election.cc:304] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d10a0262af42f287945354c52babae, a01f3c95473649bda46356953d7b84a0; no voters:
I20251029 09:10:19.691066 10870 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4783871a899148fc85245d01f636c858" candidate_uuid: "a01f3c95473649bda46356953d7b84a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d608f12f4a934ef0adc7ae783cc1627c" is_pre_election: true
I20251029 09:10:19.691200 10870 raft_consensus.cc:2468] T 4783871a899148fc85245d01f636c858 P d608f12f4a934ef0adc7ae783cc1627c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a01f3c95473649bda46356953d7b84a0 in term 0.
I20251029 09:10:19.691174 11133 raft_consensus.cc:2804] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251029 09:10:19.691262 11133 raft_consensus.cc:493] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251029 09:10:19.691294 11133 raft_consensus.cc:3060] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:19.692224 11133 raft_consensus.cc:515] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } } peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } }
I20251029 09:10:19.692410 11133 leader_election.cc:290] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [CANDIDATE]: Term 1 election: Requested vote from peers d608f12f4a934ef0adc7ae783cc1627c (127.4.237.194:40005), 74d10a0262af42f287945354c52babae (127.4.237.195:40019)
I20251029 09:10:19.692761 11004 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4783871a899148fc85245d01f636c858" candidate_uuid: "a01f3c95473649bda46356953d7b84a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d10a0262af42f287945354c52babae"
I20251029 09:10:19.692765 10870 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4783871a899148fc85245d01f636c858" candidate_uuid: "a01f3c95473649bda46356953d7b84a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d608f12f4a934ef0adc7ae783cc1627c"
I20251029 09:10:19.692857 11004 raft_consensus.cc:3060] T 4783871a899148fc85245d01f636c858 P 74d10a0262af42f287945354c52babae [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:19.692879 10870 raft_consensus.cc:3060] T 4783871a899148fc85245d01f636c858 P d608f12f4a934ef0adc7ae783cc1627c [term 0 FOLLOWER]: Advancing to term 1
I20251029 09:10:19.693642 11004 raft_consensus.cc:2468] T 4783871a899148fc85245d01f636c858 P 74d10a0262af42f287945354c52babae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a01f3c95473649bda46356953d7b84a0 in term 1.
I20251029 09:10:19.693799 10870 raft_consensus.cc:2468] T 4783871a899148fc85245d01f636c858 P d608f12f4a934ef0adc7ae783cc1627c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a01f3c95473649bda46356953d7b84a0 in term 1.
I20251029 09:10:19.693886 10668 leader_election.cc:304] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d10a0262af42f287945354c52babae, a01f3c95473649bda46356953d7b84a0; no voters:
I20251029 09:10:19.693991 11133 raft_consensus.cc:2804] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [term 1 FOLLOWER]: Leader election won for term 1
I20251029 09:10:19.694144 11133 raft_consensus.cc:697] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [term 1 LEADER]: Becoming Leader. State: Replica: a01f3c95473649bda46356953d7b84a0, State: Running, Role: LEADER
I20251029 09:10:19.694249 11133 consensus_queue.cc:237] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } } peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } }
I20251029 09:10:19.695086 10594 catalog_manager.cc:5649] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a01f3c95473649bda46356953d7b84a0 (127.4.237.193). New cstate: current_term: 1 leader_uuid: "a01f3c95473649bda46356953d7b84a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a01f3c95473649bda46356953d7b84a0" member_type: VOTER last_known_addr { host: "127.4.237.193" port: 44211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 } health_report { overall_health: UNKNOWN } } }
I20251029 09:10:19.710238 11004 raft_consensus.cc:1275] T 4783871a899148fc85245d01f636c858 P 74d10a0262af42f287945354c52babae [term 1 FOLLOWER]: Refusing update from remote peer a01f3c95473649bda46356953d7b84a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251029 09:10:19.710251 10870 raft_consensus.cc:1275] T 4783871a899148fc85245d01f636c858 P d608f12f4a934ef0adc7ae783cc1627c [term 1 FOLLOWER]: Refusing update from remote peer a01f3c95473649bda46356953d7b84a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251029 09:10:19.710570 11133 consensus_queue.cc:1048] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d10a0262af42f287945354c52babae" member_type: VOTER last_known_addr { host: "127.4.237.195" port: 40019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251029 09:10:19.710696 11179 consensus_queue.cc:1048] T 4783871a899148fc85245d01f636c858 P a01f3c95473649bda46356953d7b84a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d608f12f4a934ef0adc7ae783cc1627c" member_type: VOTER last_known_addr { host: "127.4.237.194" port: 40005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251029 09:10:19.713693 11135 mvcc.cc:204] Tried to move back new op lower bound from 7216042064731885568 to 7216042064668352512. Current Snapshot: MvccSnapshot[applied={T|T < 7216042064730611712}]
I20251029 09:10:19.885509 10984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:19.886125 10850 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251029 09:10:19.889322 10715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
af01f7b8c4674281aa5e9646b3c42b63 | 127.4.237.254:38457 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.4.237.212:35189 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
74d10a0262af42f287945354c52babae | 127.4.237.195:40019 | HEALTHY | <none> | 0 | 0
a01f3c95473649bda46356953d7b84a0 | 127.4.237.193:44211 | HEALTHY | <none> | 1 | 0
d608f12f4a934ef0adc7ae783cc1627c | 127.4.237.194:40005 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.4.237.193 | experimental | 127.4.237.193:44211
local_ip_for_outbound_sockets | 127.4.237.194 | experimental | 127.4.237.194:40005
local_ip_for_outbound_sockets | 127.4.237.195 | experimental | 127.4.237.195:40019
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-0/data/info.pb | hidden | 127.4.237.193:44211
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-1/data/info.pb | hidden | 127.4.237.194:40005
server_dump_info_path | /tmp/dist-test-taskeGWyaM/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1761728996740924-5047-0/minicluster-data/ts-2/data/info.pb | hidden | 127.4.237.195:40019
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.4.237.212:35189 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
--------------+----+---------+---------------+---------+------------+------------------+-------------
post_rebuild | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20251029 09:10:19.896875 5047 log_verifier.cc:126] Checking tablet 04e508584ffc4467bda2807bc0b9df2d
I20251029 09:10:19.896971 5047 log_verifier.cc:177] Verified matching terms for 0 ops in tablet 04e508584ffc4467bda2807bc0b9df2d
I20251029 09:10:19.896998 5047 log_verifier.cc:126] Checking tablet 4783871a899148fc85245d01f636c858
I20251029 09:10:19.933501 5047 log_verifier.cc:177] Verified matching terms for 205 ops in tablet 4783871a899148fc85245d01f636c858
I20251029 09:10:19.935247 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 10651
I20251029 09:10:19.941119 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 10786
I20251029 09:10:19.946929 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 10919
I20251029 09:10:19.952062 5047 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskeGWyaM/build/release/bin/kudu with pid 10563
2025-10-29T09:10:19Z chronyd exiting
[ OK ] IsSecure/SecureClusterAdminCliParamTest.TestRebuildMaster/0 (4340 ms)
[----------] 1 test from IsSecure/SecureClusterAdminCliParamTest (4340 ms total)
[----------] Global test environment tear-down
[==========] 9 tests from 5 test suites ran. (23229 ms total)
[ PASSED ] 8 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] AdminCliTest.TestRebuildTables
1 FAILED TEST
I20251029 09:10:19.975649 5047 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/client/meta_cache.cc:302: suppressed but not reported on 3 messages since previous log ~9 seconds ago