Note: This is test shard 6 of 8.
[==========] Running 9 tests from 5 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from AdminCliTest
[ RUN ] AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20251214 21:04:46.183182 16864 test_util.cc:276] Using random seed: -668548359
I20251214 21:04:46.190443 16864 ts_itest-base.cc:115] Starting cluster with:
I20251214 21:04:46.190498 16864 ts_itest-base.cc:116] --------------
I20251214 21:04:46.190513 16864 ts_itest-base.cc:117] 4 tablet servers
I20251214 21:04:46.190529 16864 ts_itest-base.cc:118] 3 replicas per TS
I20251214 21:04:46.190541 16864 ts_itest-base.cc:119] --------------
2025-12-14T21:04:46Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-14T21:04:46Z Disabled control of system clock
I20251214 21:04:46.199290 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:39327
--webserver_interface=127.16.120.62
--webserver_port=0
--builtin_ntp_servers=127.16.120.20:35783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.120.62:39327 with env {}
W20251214 21:04:46.304608 16876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:46.304829 16876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:46.304872 16876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:46.308158 16876 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251214 21:04:46.308228 16876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:46.308248 16876 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251214 21:04:46.308265 16876 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251214 21:04:46.312042 16876 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:35783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.120.62:39327
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:39327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.16.120.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.16876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:46.313148 16876 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:46.314299 16876 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:46.320048 16884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:46.320046 16881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:46.320194 16882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:46.320281 16876 server_base.cc:1047] running on GCE node
I20251214 21:04:46.320956 16876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:46.321892 16876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:46.323062 16876 hybrid_clock.cc:648] HybridClock initialized: now 1765746286323043 us; error 32 us; skew 500 ppm
I20251214 21:04:46.324915 16876 webserver.cc:492] Webserver started at http://127.16.120.62:35883/ using document root <none> and password file <none>
I20251214 21:04:46.325493 16876 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:46.325562 16876 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:46.325753 16876 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:46.327323 16876 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "09cb32200d724aebb898b48b779cc1c7"
format_stamp: "Formatted at 2025-12-14 21:04:46 on dist-test-slave-8rzr"
I20251214 21:04:46.327801 16876 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "09cb32200d724aebb898b48b779cc1c7"
format_stamp: "Formatted at 2025-12-14 21:04:46 on dist-test-slave-8rzr"
I20251214 21:04:46.331149 16876 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251214 21:04:46.333201 16890 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:46.334187 16876 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251214 21:04:46.334297 16876 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
uuid: "09cb32200d724aebb898b48b779cc1c7"
format_stamp: "Formatted at 2025-12-14 21:04:46 on dist-test-slave-8rzr"
I20251214 21:04:46.334373 16876 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:46.353519 16876 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:46.354297 16876 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:46.354477 16876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:46.361693 16942 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.62:39327 every 8 connection(s)
I20251214 21:04:46.361694 16876 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.62:39327
I20251214 21:04:46.362792 16876 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251214 21:04:46.364313 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 16876
I20251214 21:04:46.364513 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251214 21:04:46.366302 16943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:46.372426 16943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7: Bootstrap starting.
I20251214 21:04:46.375029 16943 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:46.375897 16943 log.cc:826] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:46.377615 16943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7: No bootstrap required, opened a new log
I20251214 21:04:46.380224 16943 raft_consensus.cc:359] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cb32200d724aebb898b48b779cc1c7" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39327 } }
I20251214 21:04:46.380450 16943 raft_consensus.cc:385] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:46.380496 16943 raft_consensus.cc:740] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09cb32200d724aebb898b48b779cc1c7, State: Initialized, Role: FOLLOWER
I20251214 21:04:46.380975 16943 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cb32200d724aebb898b48b779cc1c7" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39327 } }
I20251214 21:04:46.381139 16943 raft_consensus.cc:399] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:46.381209 16943 raft_consensus.cc:493] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:46.381300 16943 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:46.382318 16943 raft_consensus.cc:515] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cb32200d724aebb898b48b779cc1c7" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39327 } }
I20251214 21:04:46.382716 16943 leader_election.cc:304] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09cb32200d724aebb898b48b779cc1c7; no voters:
I20251214 21:04:46.382995 16943 leader_election.cc:290] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:04:46.383091 16948 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:46.383267 16948 raft_consensus.cc:697] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 1 LEADER]: Becoming Leader. State: Replica: 09cb32200d724aebb898b48b779cc1c7, State: Running, Role: LEADER
I20251214 21:04:46.383623 16948 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cb32200d724aebb898b48b779cc1c7" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39327 } }
I20251214 21:04:46.384207 16943 sys_catalog.cc:565] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:04:46.385185 16950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09cb32200d724aebb898b48b779cc1c7. Latest consensus state: current_term: 1 leader_uuid: "09cb32200d724aebb898b48b779cc1c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cb32200d724aebb898b48b779cc1c7" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39327 } } }
I20251214 21:04:46.385314 16950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:46.385655 16949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09cb32200d724aebb898b48b779cc1c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cb32200d724aebb898b48b779cc1c7" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39327 } } }
I20251214 21:04:46.385742 16949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:46.386526 16957 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:04:46.389115 16957 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:04:46.394115 16957 catalog_manager.cc:1357] Generated new cluster ID: d3061a6f9e54463d9f52862f26a961f8
I20251214 21:04:46.394182 16957 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:04:46.419397 16957 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:04:46.420424 16957 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:04:46.426699 16957 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7: Generated new TSK 0
I20251214 21:04:46.427439 16957 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:04:46.441184 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.1:0
--local_ip_for_outbound_sockets=127.16.120.1
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:39327
--builtin_ntp_servers=127.16.120.20:35783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251214 21:04:46.547019 16967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:46.547240 16967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:46.547287 16967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:46.551044 16967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:46.551158 16967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.1
I20251214 21:04:46.555032 16967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:35783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:39327
--never_fsync=true
--heap_profile_path=/tmp/kudu.16967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.1
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:46.556159 16967 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:46.557264 16967 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:46.563755 16973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:46.563741 16972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:46.563920 16967 server_base.cc:1047] running on GCE node
W20251214 21:04:46.563745 16975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:46.564417 16967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:46.564980 16967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:46.566126 16967 hybrid_clock.cc:648] HybridClock initialized: now 1765746286566113 us; error 27 us; skew 500 ppm
I20251214 21:04:46.567950 16967 webserver.cc:492] Webserver started at http://127.16.120.1:46275/ using document root <none> and password file <none>
I20251214 21:04:46.568511 16967 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:46.568570 16967 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:46.568747 16967 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:46.570323 16967 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a"
format_stamp: "Formatted at 2025-12-14 21:04:46 on dist-test-slave-8rzr"
I20251214 21:04:46.570832 16967 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a"
format_stamp: "Formatted at 2025-12-14 21:04:46 on dist-test-slave-8rzr"
I20251214 21:04:46.574111 16967 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251214 21:04:46.576216 16981 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:46.577195 16967 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:46.577296 16967 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a"
format_stamp: "Formatted at 2025-12-14 21:04:46 on dist-test-slave-8rzr"
I20251214 21:04:46.577376 16967 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:46.591794 16967 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:46.592482 16967 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:46.592645 16967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:46.593214 16967 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:46.594272 16967 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:46.594319 16967 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:46.594398 16967 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:46.594424 16967 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:46.602900 16967 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.1:39339
I20251214 21:04:46.602932 17094 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.1:39339 every 8 connection(s)
I20251214 21:04:46.603886 16967 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251214 21:04:46.606845 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 16967
I20251214 21:04:46.606956 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251214 21:04:46.609169 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.2:0
--local_ip_for_outbound_sockets=127.16.120.2
--webserver_interface=127.16.120.2
--webserver_port=0
--tserver_master_addrs=127.16.120.62:39327
--builtin_ntp_servers=127.16.120.20:35783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251214 21:04:46.613972 17095 heartbeater.cc:344] Connected to a master server at 127.16.120.62:39327
I20251214 21:04:46.614221 17095 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:46.614795 17095 heartbeater.cc:507] Master 127.16.120.62:39327 requested a full tablet report, sending...
I20251214 21:04:46.616351 16907 ts_manager.cc:194] Registered new tserver with Master: e4d4ed3c5a7c4bb7b45302529d15a17a (127.16.120.1:39339)
I20251214 21:04:46.618054 16907 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.1:51647
W20251214 21:04:46.714430 17098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:46.714668 17098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:46.714715 17098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:46.718019 17098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:46.718133 17098 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.2
I20251214 21:04:46.722101 17098 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:35783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.16.120.2
--webserver_port=0
--tserver_master_addrs=127.16.120.62:39327
--never_fsync=true
--heap_profile_path=/tmp/kudu.17098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.2
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:46.723181 17098 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:46.724258 17098 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:46.730737 17103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:46.730804 17106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:46.730921 17098 server_base.cc:1047] running on GCE node
W20251214 21:04:46.730746 17104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:46.731364 17098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:46.731911 17098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:46.733073 17098 hybrid_clock.cc:648] HybridClock initialized: now 1765746286733057 us; error 33 us; skew 500 ppm
I20251214 21:04:46.734813 17098 webserver.cc:492] Webserver started at http://127.16.120.2:34923/ using document root <none> and password file <none>
I20251214 21:04:46.735339 17098 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:46.735396 17098 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:46.735559 17098 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:46.737104 17098 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "ff1f09e6d9c14d7eb0403c3d103907a5"
format_stamp: "Formatted at 2025-12-14 21:04:46 on dist-test-slave-8rzr"
I20251214 21:04:46.737550 17098 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "ff1f09e6d9c14d7eb0403c3d103907a5"
format_stamp: "Formatted at 2025-12-14 21:04:46 on dist-test-slave-8rzr"
I20251214 21:04:46.740836 17098 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20251214 21:04:46.743023 17112 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:46.744006 17098 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:46.744109 17098 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "ff1f09e6d9c14d7eb0403c3d103907a5"
format_stamp: "Formatted at 2025-12-14 21:04:46 on dist-test-slave-8rzr"
I20251214 21:04:46.744194 17098 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:46.764530 17098 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:46.765188 17098 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:46.765344 17098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:46.765920 17098 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:46.766886 17098 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:46.766935 17098 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:46.766989 17098 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:46.767015 17098 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:46.775803 17098 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.2:46439
I20251214 21:04:46.775823 17225 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.2:46439 every 8 connection(s)
I20251214 21:04:46.776741 17098 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251214 21:04:46.784569 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 17098
I20251214 21:04:46.784699 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251214 21:04:46.785944 17226 heartbeater.cc:344] Connected to a master server at 127.16.120.62:39327
I20251214 21:04:46.786230 17226 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:46.786983 17226 heartbeater.cc:507] Master 127.16.120.62:39327 requested a full tablet report, sending...
I20251214 21:04:46.787181 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.3:0
--local_ip_for_outbound_sockets=127.16.120.3
--webserver_interface=127.16.120.3
--webserver_port=0
--tserver_master_addrs=127.16.120.62:39327
--builtin_ntp_servers=127.16.120.20:35783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251214 21:04:46.788141 16907 ts_manager.cc:194] Registered new tserver with Master: ff1f09e6d9c14d7eb0403c3d103907a5 (127.16.120.2:46439)
I20251214 21:04:46.788815 16907 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.2:47147
W20251214 21:04:46.895182 17229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:46.895406 17229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:46.895473 17229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:46.898777 17229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:46.898914 17229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.3
I20251214 21:04:46.902833 17229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:35783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.16.120.3
--webserver_port=0
--tserver_master_addrs=127.16.120.62:39327
--never_fsync=true
--heap_profile_path=/tmp/kudu.17229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.3
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:46.903986 17229 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:46.905155 17229 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:46.912047 17234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:46.912062 17235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:46.912253 17229 server_base.cc:1047] running on GCE node
W20251214 21:04:46.912125 17237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:46.912762 17229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:46.913342 17229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:46.914510 17229 hybrid_clock.cc:648] HybridClock initialized: now 1765746286914484 us; error 41 us; skew 500 ppm
I20251214 21:04:46.916368 17229 webserver.cc:492] Webserver started at http://127.16.120.3:35323/ using document root <none> and password file <none>
I20251214 21:04:46.916966 17229 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:46.917025 17229 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:46.917218 17229 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:46.918844 17229 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "b2cf3093c68543db9f20d2eb92e22b5f"
format_stamp: "Formatted at 2025-12-14 21:04:46 on dist-test-slave-8rzr"
I20251214 21:04:46.919297 17229 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "b2cf3093c68543db9f20d2eb92e22b5f"
format_stamp: "Formatted at 2025-12-14 21:04:46 on dist-test-slave-8rzr"
I20251214 21:04:46.922688 17229 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251214 21:04:46.924834 17243 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:46.925856 17229 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251214 21:04:46.925964 17229 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "b2cf3093c68543db9f20d2eb92e22b5f"
format_stamp: "Formatted at 2025-12-14 21:04:46 on dist-test-slave-8rzr"
I20251214 21:04:46.926059 17229 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:46.941859 17229 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:46.942489 17229 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:46.942631 17229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:46.943166 17229 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:46.944097 17229 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:46.944144 17229 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:46.944181 17229 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:46.944201 17229 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:46.953203 17229 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.3:42409
I20251214 21:04:46.953235 17356 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.3:42409 every 8 connection(s)
I20251214 21:04:46.954186 17229 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251214 21:04:46.962672 17357 heartbeater.cc:344] Connected to a master server at 127.16.120.62:39327
I20251214 21:04:46.962915 17357 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:46.963280 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 17229
I20251214 21:04:46.963354 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251214 21:04:46.963478 17357 heartbeater.cc:507] Master 127.16.120.62:39327 requested a full tablet report, sending...
I20251214 21:04:46.964373 16906 ts_manager.cc:194] Registered new tserver with Master: b2cf3093c68543db9f20d2eb92e22b5f (127.16.120.3:42409)
I20251214 21:04:46.965003 16906 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.3:34605
I20251214 21:04:46.965428 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.4:0
--local_ip_for_outbound_sockets=127.16.120.4
--webserver_interface=127.16.120.4
--webserver_port=0
--tserver_master_addrs=127.16.120.62:39327
--builtin_ntp_servers=127.16.120.20:35783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251214 21:04:47.068939 17360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:47.069147 17360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:47.069190 17360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:47.072409 17360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:47.072521 17360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.4
I20251214 21:04:47.076143 17360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:35783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.16.120.4
--webserver_port=0
--tserver_master_addrs=127.16.120.62:39327
--never_fsync=true
--heap_profile_path=/tmp/kudu.17360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.4
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:47.077185 17360 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:47.078267 17360 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:47.084473 17365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:47.084537 17360 server_base.cc:1047] running on GCE node
W20251214 21:04:47.084539 17366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:47.084808 17368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:47.085168 17360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:47.085747 17360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:47.086891 17360 hybrid_clock.cc:648] HybridClock initialized: now 1765746287086872 us; error 34 us; skew 500 ppm
I20251214 21:04:47.088521 17360 webserver.cc:492] Webserver started at http://127.16.120.4:43129/ using document root <none> and password file <none>
I20251214 21:04:47.089082 17360 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:47.089141 17360 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:47.089322 17360 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:47.090828 17360 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "a0ae39181bd74f8e9f9be0a89d005c8d"
format_stamp: "Formatted at 2025-12-14 21:04:47 on dist-test-slave-8rzr"
I20251214 21:04:47.091259 17360 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "a0ae39181bd74f8e9f9be0a89d005c8d"
format_stamp: "Formatted at 2025-12-14 21:04:47 on dist-test-slave-8rzr"
I20251214 21:04:47.094328 17360 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20251214 21:04:47.096379 17374 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:47.097311 17360 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:47.097407 17360 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "a0ae39181bd74f8e9f9be0a89d005c8d"
format_stamp: "Formatted at 2025-12-14 21:04:47 on dist-test-slave-8rzr"
I20251214 21:04:47.097488 17360 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:47.111099 17360 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:47.111686 17360 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:47.111837 17360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:47.112321 17360 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:47.113236 17360 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:47.113283 17360 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:47.113332 17360 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:47.113360 17360 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:47.121737 17360 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.4:40217
I20251214 21:04:47.121770 17487 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.4:40217 every 8 connection(s)
I20251214 21:04:47.122653 17360 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20251214 21:04:47.130429 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 17360
I20251214 21:04:47.130535 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20251214 21:04:47.130976 17488 heartbeater.cc:344] Connected to a master server at 127.16.120.62:39327
I20251214 21:04:47.131206 17488 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:47.131716 17488 heartbeater.cc:507] Master 127.16.120.62:39327 requested a full tablet report, sending...
I20251214 21:04:47.132581 16907 ts_manager.cc:194] Registered new tserver with Master: a0ae39181bd74f8e9f9be0a89d005c8d (127.16.120.4:40217)
I20251214 21:04:47.133101 16907 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.4:38031
I20251214 21:04:47.144769 16864 external_mini_cluster.cc:949] 4 TS(s) registered with all masters
I20251214 21:04:47.156267 16907 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42110:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20251214 21:04:47.174943 17029 tablet_service.cc:1505] Processing CreateTablet for tablet 098541a71786462794b57216542f789b (DEFAULT_TABLE table=TestTable [id=816afd4633ec49dfb0c567429933364c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:47.174943 17160 tablet_service.cc:1505] Processing CreateTablet for tablet 098541a71786462794b57216542f789b (DEFAULT_TABLE table=TestTable [id=816afd4633ec49dfb0c567429933364c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:47.174943 17422 tablet_service.cc:1505] Processing CreateTablet for tablet 098541a71786462794b57216542f789b (DEFAULT_TABLE table=TestTable [id=816afd4633ec49dfb0c567429933364c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:47.175918 17422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098541a71786462794b57216542f789b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:47.175927 17160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098541a71786462794b57216542f789b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:47.175927 17029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098541a71786462794b57216542f789b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:47.180821 17505 tablet_bootstrap.cc:492] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d: Bootstrap starting.
I20251214 21:04:47.182161 17506 tablet_bootstrap.cc:492] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a: Bootstrap starting.
I20251214 21:04:47.182335 17507 tablet_bootstrap.cc:492] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5: Bootstrap starting.
I20251214 21:04:47.183305 17505 tablet_bootstrap.cc:654] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:47.184084 17505 log.cc:826] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:47.184232 17506 tablet_bootstrap.cc:654] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:47.184232 17507 tablet_bootstrap.cc:654] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:47.185020 17506 log.cc:826] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:47.185020 17507 log.cc:826] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:47.185685 17505 tablet_bootstrap.cc:492] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d: No bootstrap required, opened a new log
I20251214 21:04:47.185912 17505 ts_tablet_manager.cc:1403] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.004s
I20251214 21:04:47.186939 17507 tablet_bootstrap.cc:492] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5: No bootstrap required, opened a new log
I20251214 21:04:47.186949 17506 tablet_bootstrap.cc:492] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a: No bootstrap required, opened a new log
I20251214 21:04:47.187124 17506 ts_tablet_manager.cc:1403] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20251214 21:04:47.187124 17507 ts_tablet_manager.cc:1403] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20251214 21:04:47.188298 17505 raft_consensus.cc:359] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46439 } } peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } }
I20251214 21:04:47.188479 17505 raft_consensus.cc:385] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:47.188532 17505 raft_consensus.cc:740] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0ae39181bd74f8e9f9be0a89d005c8d, State: Initialized, Role: FOLLOWER
I20251214 21:04:47.189038 17505 consensus_queue.cc:260] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46439 } } peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } }
I20251214 21:04:47.189913 17505 ts_tablet_manager.cc:1434] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20251214 21:04:47.190062 17507 raft_consensus.cc:359] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46439 } } peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } }
I20251214 21:04:47.190062 17506 raft_consensus.cc:359] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46439 } } peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } }
I20251214 21:04:47.190261 17506 raft_consensus.cc:385] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:47.190258 17488 heartbeater.cc:499] Master 127.16.120.62:39327 was elected leader, sending a full tablet report...
I20251214 21:04:47.190331 17507 raft_consensus.cc:385] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:47.190346 17506 raft_consensus.cc:740] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d4ed3c5a7c4bb7b45302529d15a17a, State: Initialized, Role: FOLLOWER
I20251214 21:04:47.190416 17507 raft_consensus.cc:740] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff1f09e6d9c14d7eb0403c3d103907a5, State: Initialized, Role: FOLLOWER
I20251214 21:04:47.190830 17507 consensus_queue.cc:260] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46439 } } peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } }
I20251214 21:04:47.190830 17506 consensus_queue.cc:260] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46439 } } peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } }
I20251214 21:04:47.191650 17507 ts_tablet_manager.cc:1434] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20251214 21:04:47.191644 17506 ts_tablet_manager.cc:1434] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20251214 21:04:47.191701 17095 heartbeater.cc:499] Master 127.16.120.62:39327 was elected leader, sending a full tablet report...
I20251214 21:04:47.192131 17226 heartbeater.cc:499] Master 127.16.120.62:39327 was elected leader, sending a full tablet report...
W20251214 21:04:47.277931 17227 tablet.cc:2378] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:04:47.350178 17513 raft_consensus.cc:493] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:47.350396 17513 raft_consensus.cc:515] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46439 } } peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } }
I20251214 21:04:47.351536 17513 leader_election.cc:290] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0ae39181bd74f8e9f9be0a89d005c8d (127.16.120.4:40217), e4d4ed3c5a7c4bb7b45302529d15a17a (127.16.120.1:39339)
W20251214 21:04:47.355342 17096 tablet.cc:2378] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:04:47.355861 17442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "098541a71786462794b57216542f789b" candidate_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" is_pre_election: true
I20251214 21:04:47.356082 17049 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "098541a71786462794b57216542f789b" candidate_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" is_pre_election: true
I20251214 21:04:47.356137 17442 raft_consensus.cc:2468] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff1f09e6d9c14d7eb0403c3d103907a5 in term 0.
I20251214 21:04:47.356330 17049 raft_consensus.cc:2468] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff1f09e6d9c14d7eb0403c3d103907a5 in term 0.
I20251214 21:04:47.356665 17115 leader_election.cc:304] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0ae39181bd74f8e9f9be0a89d005c8d, ff1f09e6d9c14d7eb0403c3d103907a5; no voters:
I20251214 21:04:47.356997 17513 raft_consensus.cc:2804] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:47.357071 17513 raft_consensus.cc:493] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:47.357136 17513 raft_consensus.cc:3060] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:47.358021 17513 raft_consensus.cc:515] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46439 } } peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } }
I20251214 21:04:47.358337 17513 leader_election.cc:290] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [CANDIDATE]: Term 1 election: Requested vote from peers a0ae39181bd74f8e9f9be0a89d005c8d (127.16.120.4:40217), e4d4ed3c5a7c4bb7b45302529d15a17a (127.16.120.1:39339)
I20251214 21:04:47.358780 17049 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "098541a71786462794b57216542f789b" candidate_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a"
I20251214 21:04:47.358913 17049 raft_consensus.cc:3060] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:47.359828 17049 raft_consensus.cc:2468] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1f09e6d9c14d7eb0403c3d103907a5 in term 1.
I20251214 21:04:47.360123 17442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "098541a71786462794b57216542f789b" candidate_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d"
I20251214 21:04:47.360162 17114 leader_election.cc:304] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4d4ed3c5a7c4bb7b45302529d15a17a, ff1f09e6d9c14d7eb0403c3d103907a5; no voters:
I20251214 21:04:47.360281 17442 raft_consensus.cc:3060] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:47.360342 17513 raft_consensus.cc:2804] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:47.360642 17513 raft_consensus.cc:697] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [term 1 LEADER]: Becoming Leader. State: Replica: ff1f09e6d9c14d7eb0403c3d103907a5, State: Running, Role: LEADER
I20251214 21:04:47.360975 17513 consensus_queue.cc:237] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46439 } } peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } }
I20251214 21:04:47.361718 17442 raft_consensus.cc:2468] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1f09e6d9c14d7eb0403c3d103907a5 in term 1.
I20251214 21:04:47.364492 16906 catalog_manager.cc:5654] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff1f09e6d9c14d7eb0403c3d103907a5 (127.16.120.2). New cstate: current_term: 1 leader_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } health_report { overall_health: UNKNOWN } } }
W20251214 21:04:47.373466 17489 tablet.cc:2378] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:04:47.404887 16864 external_mini_cluster.cc:949] 4 TS(s) registered with all masters
I20251214 21:04:47.406580 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver e4d4ed3c5a7c4bb7b45302529d15a17a to finish bootstrapping
I20251214 21:04:47.411902 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver ff1f09e6d9c14d7eb0403c3d103907a5 to finish bootstrapping
I20251214 21:04:47.416405 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver a0ae39181bd74f8e9f9be0a89d005c8d to finish bootstrapping
I20251214 21:04:47.420890 16864 kudu-admin-test.cc:709] Waiting for Master to see the current replicas...
I20251214 21:04:47.422153 16864 kudu-admin-test.cc:716] Tablet locations:
tablet_locations {
tablet_id: "098541a71786462794b57216542f789b"
DEPRECATED_stale: false
partition {
partition_key_start: ""
partition_key_end: ""
}
interned_replicas {
ts_info_idx: 0
role: LEADER
}
interned_replicas {
ts_info_idx: 1
role: FOLLOWER
}
interned_replicas {
ts_info_idx: 2
role: FOLLOWER
}
}
ts_infos {
permanent_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5"
rpc_addresses {
host: "127.16.120.2"
port: 46439
}
}
ts_infos {
permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d"
rpc_addresses {
host: "127.16.120.4"
port: 40217
}
}
ts_infos {
permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a"
rpc_addresses {
host: "127.16.120.1"
port: 39339
}
}
I20251214 21:04:47.933382 17520 consensus_queue.cc:1048] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:47.939061 17523 consensus_queue.cc:1048] T 098541a71786462794b57216542f789b P ff1f09e6d9c14d7eb0403c3d103907a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:47.947671 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 17098
I20251214 21:04:47.953401 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 16876
I20251214 21:04:47.960549 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:39327
--webserver_interface=127.16.120.62
--webserver_port=35883
--builtin_ntp_servers=127.16.120.20:35783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.120.62:39327 with env {}
I20251214 21:04:47.967195 17357 heartbeater.cc:499] Master 127.16.120.62:39327 was elected leader, sending a full tablet report...
W20251214 21:04:47.968155 17357 heartbeater.cc:646] Failed to heartbeat to 127.16.120.62:39327 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.120.62:39327: connect: Connection refused (error 111)
W20251214 21:04:48.066843 17530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:48.067070 17530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:48.067126 17530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:48.070356 17530 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251214 21:04:48.070418 17530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:48.070446 17530 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251214 21:04:48.070468 17530 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251214 21:04:48.074229 17530 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:35783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.120.62:39327
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:39327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.16.120.62
--webserver_port=35883
--never_fsync=true
--heap_profile_path=/tmp/kudu.17530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:48.075249 17530 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:48.076330 17530 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:48.081941 17537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:48.082008 17536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:48.081962 17539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:48.082166 17530 server_base.cc:1047] running on GCE node
I20251214 21:04:48.082638 17530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:48.083529 17530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:48.084676 17530 hybrid_clock.cc:648] HybridClock initialized: now 1765746288084664 us; error 26 us; skew 500 ppm
I20251214 21:04:48.086423 17530 webserver.cc:492] Webserver started at http://127.16.120.62:35883/ using document root <none> and password file <none>
I20251214 21:04:48.086995 17530 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:48.087072 17530 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:48.090663 17530 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20251214 21:04:48.092674 17545 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:48.093704 17530 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:48.093856 17530 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
uuid: "09cb32200d724aebb898b48b779cc1c7"
format_stamp: "Formatted at 2025-12-14 21:04:46 on dist-test-slave-8rzr"
I20251214 21:04:48.094250 17530 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:48.128871 17530 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:48.129534 17530 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:48.129703 17530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:48.136664 17597 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.62:39327 every 8 connection(s)
I20251214 21:04:48.136672 17530 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.62:39327
I20251214 21:04:48.137753 17530 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251214 21:04:48.141664 17598 sys_catalog.cc:263] Verifying existing consensus state
I20251214 21:04:48.143088 17598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7: Bootstrap starting.
I20251214 21:04:48.146226 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 17530
I20251214 21:04:48.146370 16864 kudu-admin-test.cc:735] Forcing unsafe config change on tserver e4d4ed3c5a7c4bb7b45302529d15a17a
I20251214 21:04:48.157629 17598 log.cc:826] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:48.164816 17598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:48.165145 17598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7: Bootstrap complete.
I20251214 21:04:48.168529 17598 raft_consensus.cc:359] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cb32200d724aebb898b48b779cc1c7" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39327 } }
I20251214 21:04:48.168846 17598 raft_consensus.cc:740] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09cb32200d724aebb898b48b779cc1c7, State: Initialized, Role: FOLLOWER
I20251214 21:04:48.169324 17598 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cb32200d724aebb898b48b779cc1c7" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39327 } }
I20251214 21:04:48.169448 17598 raft_consensus.cc:399] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:48.169508 17598 raft_consensus.cc:493] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:48.169595 17598 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:48.171046 17598 raft_consensus.cc:515] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cb32200d724aebb898b48b779cc1c7" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39327 } }
I20251214 21:04:48.171352 17598 leader_election.cc:304] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09cb32200d724aebb898b48b779cc1c7; no voters:
I20251214 21:04:48.171622 17598 leader_election.cc:290] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20251214 21:04:48.171736 17602 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:48.171939 17602 raft_consensus.cc:697] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [term 2 LEADER]: Becoming Leader. State: Replica: 09cb32200d724aebb898b48b779cc1c7, State: Running, Role: LEADER
I20251214 21:04:48.172212 17602 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cb32200d724aebb898b48b779cc1c7" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39327 } }
I20251214 21:04:48.172725 17598 sys_catalog.cc:565] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:04:48.173094 17602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09cb32200d724aebb898b48b779cc1c7. Latest consensus state: current_term: 2 leader_uuid: "09cb32200d724aebb898b48b779cc1c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cb32200d724aebb898b48b779cc1c7" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39327 } } }
I20251214 21:04:48.173197 17602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:48.173558 17603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "09cb32200d724aebb898b48b779cc1c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cb32200d724aebb898b48b779cc1c7" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39327 } } }
I20251214 21:04:48.173734 17606 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:04:48.173743 17603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:48.177606 17606 catalog_manager.cc:679] Loaded metadata for table TestTable [id=816afd4633ec49dfb0c567429933364c]
I20251214 21:04:48.178893 17606 tablet_loader.cc:96] loaded metadata for tablet 098541a71786462794b57216542f789b (table TestTable [id=816afd4633ec49dfb0c567429933364c])
I20251214 21:04:48.179040 17606 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:04:48.179721 17606 catalog_manager.cc:1269] Loaded cluster ID: d3061a6f9e54463d9f52862f26a961f8
I20251214 21:04:48.179780 17606 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:04:48.182183 17606 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:04:48.182874 17606 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 09cb32200d724aebb898b48b779cc1c7: Loaded TSK: 0
I20251214 21:04:48.184062 17606 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20251214 21:04:48.256705 17600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:48.256940 17600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:48.260131 17600 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20251214 21:04:48.281512 17049 tablet_service.cc:2003] Received UnsafeChangeConfig RPC: dest_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a"
tablet_id: "098541a71786462794b57216542f789b"
caller_id: "kudu-tools"
new_config {
peers {
permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d"
}
peers {
permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a"
}
}
from {username='slave'} at 127.0.0.1:60616
W20251214 21:04:48.281967 17049 raft_consensus.cc:2218] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 1 FOLLOWER]: PROCEEDING WITH UNSAFE CONFIG CHANGE ON THIS SERVER, COMMITTED CONFIG: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46439 } } peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } }NEW CONFIG: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } unsafe_config_change: true
I20251214 21:04:48.282158 17049 raft_consensus.cc:3060] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:48.290498 17562 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" instance_seqno: 1765746286600492) as {username='slave'} at 127.16.120.1:42585; Asking this server to re-register.
I20251214 21:04:48.291589 17095 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:48.291800 17095 heartbeater.cc:507] Master 127.16.120.62:39327 requested a full tablet report, sending...
I20251214 21:04:48.293022 17562 ts_manager.cc:194] Registered new tserver with Master: e4d4ed3c5a7c4bb7b45302529d15a17a (127.16.120.1:39339)
I20251214 21:04:48.943348 17562 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" instance_seqno: 1765746287119434) as {username='slave'} at 127.16.120.4:46513; Asking this server to re-register.
I20251214 21:04:48.943795 17488 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:48.943955 17488 heartbeater.cc:507] Master 127.16.120.62:39327 requested a full tablet report, sending...
I20251214 21:04:48.944729 17562 ts_manager.cc:194] Registered new tserver with Master: a0ae39181bd74f8e9f9be0a89d005c8d (127.16.120.4:40217)
I20251214 21:04:48.972647 17357 heartbeater.cc:344] Connected to a master server at 127.16.120.62:39327
I20251214 21:04:48.972810 17357 heartbeater.cc:499] Master 127.16.120.62:39327 was elected leader, sending a full tablet report...
I20251214 21:04:48.973421 17562 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b2cf3093c68543db9f20d2eb92e22b5f" instance_seqno: 1765746286950832) as {username='slave'} at 127.16.120.3:48831; Asking this server to re-register.
I20251214 21:04:48.973884 17357 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:48.974035 17357 heartbeater.cc:507] Master 127.16.120.62:39327 requested a full tablet report, sending...
I20251214 21:04:48.974634 17562 ts_manager.cc:194] Registered new tserver with Master: b2cf3093c68543db9f20d2eb92e22b5f (127.16.120.3:42409)
I20251214 21:04:49.438938 17642 raft_consensus.cc:493] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff1f09e6d9c14d7eb0403c3d103907a5)
I20251214 21:04:49.439086 17642 raft_consensus.cc:515] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46439 } } peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } }
I20251214 21:04:49.440176 17642 leader_election.cc:290] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff1f09e6d9c14d7eb0403c3d103907a5 (127.16.120.2:46439), e4d4ed3c5a7c4bb7b45302529d15a17a (127.16.120.1:39339)
W20251214 21:04:49.440726 17377 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.120.2:46439: connect: Connection refused (error 111)
W20251214 21:04:49.441545 17377 leader_election.cc:336] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff1f09e6d9c14d7eb0403c3d103907a5 (127.16.120.2:46439): Network error: Client connection negotiation failed: client connection to 127.16.120.2:46439: connect: Connection refused (error 111)
I20251214 21:04:49.444911 17049 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "098541a71786462794b57216542f789b" candidate_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" is_pre_election: true
I20251214 21:04:49.445456 17376 leader_election.cc:304] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0ae39181bd74f8e9f9be0a89d005c8d; no voters: e4d4ed3c5a7c4bb7b45302529d15a17a, ff1f09e6d9c14d7eb0403c3d103907a5
I20251214 21:04:49.445695 17642 raft_consensus.cc:2749] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251214 21:04:49.783782 17646 raft_consensus.cc:493] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader kudu-tools)
I20251214 21:04:49.783914 17646 raft_consensus.cc:515] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } unsafe_config_change: true
I20251214 21:04:49.784890 17646 leader_election.cc:290] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0ae39181bd74f8e9f9be0a89d005c8d (127.16.120.4:40217)
I20251214 21:04:49.788679 17442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "098541a71786462794b57216542f789b" candidate_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" is_pre_election: true
I20251214 21:04:49.788825 17442 raft_consensus.cc:2468] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4d4ed3c5a7c4bb7b45302529d15a17a in term 1.
I20251214 21:04:49.789247 16984 leader_election.cc:304] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: a0ae39181bd74f8e9f9be0a89d005c8d, e4d4ed3c5a7c4bb7b45302529d15a17a; no voters:
I20251214 21:04:49.789508 17646 raft_consensus.cc:2804] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251214 21:04:49.789578 17646 raft_consensus.cc:493] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 2 FOLLOWER]: Starting leader election (detected failure of leader kudu-tools)
I20251214 21:04:49.789606 17646 raft_consensus.cc:3060] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:04:49.790519 17646 raft_consensus.cc:515] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } unsafe_config_change: true
I20251214 21:04:49.790820 17646 leader_election.cc:290] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [CANDIDATE]: Term 3 election: Requested vote from peers a0ae39181bd74f8e9f9be0a89d005c8d (127.16.120.4:40217)
I20251214 21:04:49.791201 17442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "098541a71786462794b57216542f789b" candidate_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d"
I20251214 21:04:49.791309 17442 raft_consensus.cc:3060] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 1 FOLLOWER]: Advancing to term 3
I20251214 21:04:49.792053 17442 raft_consensus.cc:2468] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4d4ed3c5a7c4bb7b45302529d15a17a in term 3.
I20251214 21:04:49.792363 16984 leader_election.cc:304] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: a0ae39181bd74f8e9f9be0a89d005c8d, e4d4ed3c5a7c4bb7b45302529d15a17a; no voters:
I20251214 21:04:49.792562 17646 raft_consensus.cc:2804] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:04:49.792794 17646 raft_consensus.cc:697] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 3 LEADER]: Becoming Leader. State: Replica: e4d4ed3c5a7c4bb7b45302529d15a17a, State: Running, Role: LEADER
I20251214 21:04:49.793085 17646 consensus_queue.cc:237] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } unsafe_config_change: true
I20251214 21:04:49.795552 17562 catalog_manager.cc:5654] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a reported cstate change: term changed from 1 to 3, leader changed from ff1f09e6d9c14d7eb0403c3d103907a5 (127.16.120.2) to e4d4ed3c5a7c4bb7b45302529d15a17a (127.16.120.1), now has a pending config: VOTER a0ae39181bd74f8e9f9be0a89d005c8d (127.16.120.4), VOTER e4d4ed3c5a7c4bb7b45302529d15a17a (127.16.120.1). New cstate: current_term: 3 leader_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1f09e6d9c14d7eb0403c3d103907a5" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46439 } } peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } unsafe_config_change: true }
I20251214 21:04:50.282720 17442 raft_consensus.cc:1275] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 3 FOLLOWER]: Refusing update from remote peer e4d4ed3c5a7c4bb7b45302529d15a17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251214 21:04:50.283294 17646 consensus_queue.cc:1048] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20251214 21:04:50.285991 17649 raft_consensus.cc:2955] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 3 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, VOTER ff1f09e6d9c14d7eb0403c3d103907a5 (127.16.120.2) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } unsafe_config_change: true }
I20251214 21:04:50.286520 17442 raft_consensus.cc:2955] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 3 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, VOTER ff1f09e6d9c14d7eb0403c3d103907a5 (127.16.120.2) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } unsafe_config_change: true }
I20251214 21:04:50.288573 17562 catalog_manager.cc:5654] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a reported cstate change: config changed from index -1 to 2, VOTER ff1f09e6d9c14d7eb0403c3d103907a5 (127.16.120.2) evicted, no longer has a pending config: VOTER a0ae39181bd74f8e9f9be0a89d005c8d (127.16.120.4), VOTER e4d4ed3c5a7c4bb7b45302529d15a17a (127.16.120.1). New cstate: current_term: 3 leader_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } health_report { overall_health: HEALTHY } } unsafe_config_change: true }
W20251214 21:04:50.290983 17562 catalog_manager.cc:5846] Failed to send DeleteTablet RPC for tablet 098541a71786462794b57216542f789b on TS ff1f09e6d9c14d7eb0403c3d103907a5: Not found: failed to reset TS proxy: Could not find TS for UUID ff1f09e6d9c14d7eb0403c3d103907a5
I20251214 21:04:50.297084 17049 consensus_queue.cc:237] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } peers { permanent_uuid: "b2cf3093c68543db9f20d2eb92e22b5f" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 42409 } attrs { promote: true } } unsafe_config_change: true
I20251214 21:04:50.298349 17442 raft_consensus.cc:1275] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 3 FOLLOWER]: Refusing update from remote peer e4d4ed3c5a7c4bb7b45302529d15a17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251214 21:04:50.298753 17658 consensus_queue.cc:1048] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251214 21:04:50.300338 17646 raft_consensus.cc:2955] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, NON_VOTER b2cf3093c68543db9f20d2eb92e22b5f (127.16.120.3) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } peers { permanent_uuid: "b2cf3093c68543db9f20d2eb92e22b5f" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 42409 } attrs { promote: true } } unsafe_config_change: true }
I20251214 21:04:50.301877 17547 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 098541a71786462794b57216542f789b with cas_config_opid_index 2: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
W20251214 21:04:50.302312 16984 consensus_peers.cc:597] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a -> Peer b2cf3093c68543db9f20d2eb92e22b5f (127.16.120.3:42409): Couldn't send request to peer b2cf3093c68543db9f20d2eb92e22b5f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 098541a71786462794b57216542f789b. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:50.302500 17562 catalog_manager.cc:5654] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a reported cstate change: config changed from index 2 to 4, NON_VOTER b2cf3093c68543db9f20d2eb92e22b5f (127.16.120.3) added. New cstate: current_term: 3 leader_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2cf3093c68543db9f20d2eb92e22b5f" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 42409 } attrs { promote: true } health_report { overall_health: UNKNOWN } } unsafe_config_change: true }
I20251214 21:04:50.303243 17442 raft_consensus.cc:2955] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, NON_VOTER b2cf3093c68543db9f20d2eb92e22b5f (127.16.120.3) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } peers { permanent_uuid: "b2cf3093c68543db9f20d2eb92e22b5f" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 42409 } attrs { promote: true } } unsafe_config_change: true }
W20251214 21:04:50.343379 17547 catalog_manager.cc:4767] Async tablet task DeleteTablet RPC for tablet 098541a71786462794b57216542f789b on TS ff1f09e6d9c14d7eb0403c3d103907a5 failed: Not found: failed to reset TS proxy: Could not find TS for UUID ff1f09e6d9c14d7eb0403c3d103907a5
I20251214 21:04:50.791060 17665 ts_tablet_manager.cc:933] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f: Initiating tablet copy from peer e4d4ed3c5a7c4bb7b45302529d15a17a (127.16.120.1:39339)
I20251214 21:04:50.791644 17665 tablet_copy_client.cc:323] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f: tablet copy: Beginning tablet copy session from remote peer at address 127.16.120.1:39339
I20251214 21:04:50.795903 17069 tablet_copy_service.cc:140] P e4d4ed3c5a7c4bb7b45302529d15a17a: Received BeginTabletCopySession request for tablet 098541a71786462794b57216542f789b from peer b2cf3093c68543db9f20d2eb92e22b5f ({username='slave'} at 127.16.120.3:34473)
I20251214 21:04:50.796047 17069 tablet_copy_service.cc:161] P e4d4ed3c5a7c4bb7b45302529d15a17a: Beginning new tablet copy session on tablet 098541a71786462794b57216542f789b from peer b2cf3093c68543db9f20d2eb92e22b5f at {username='slave'} at 127.16.120.3:34473: session id = b2cf3093c68543db9f20d2eb92e22b5f-098541a71786462794b57216542f789b
I20251214 21:04:50.797303 17069 tablet_copy_source_session.cc:215] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:50.800662 17665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098541a71786462794b57216542f789b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:50.805569 17665 tablet_copy_client.cc:806] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:50.805743 17665 tablet_copy_client.cc:670] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:50.807574 17665 tablet_copy_client.cc:538] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:50.809484 17665 tablet_bootstrap.cc:492] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f: Bootstrap starting.
I20251214 21:04:50.814280 17665 log.cc:826] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:50.817088 17665 tablet_bootstrap.cc:492] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:50.817394 17665 tablet_bootstrap.cc:492] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f: Bootstrap complete.
I20251214 21:04:50.817653 17665 ts_tablet_manager.cc:1403] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20251214 21:04:50.820500 17665 raft_consensus.cc:359] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } peers { permanent_uuid: "b2cf3093c68543db9f20d2eb92e22b5f" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 42409 } attrs { promote: true } } unsafe_config_change: true
I20251214 21:04:50.820722 17665 raft_consensus.cc:740] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: b2cf3093c68543db9f20d2eb92e22b5f, State: Initialized, Role: LEARNER
I20251214 21:04:50.821031 17665 consensus_queue.cc:260] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } peers { permanent_uuid: "b2cf3093c68543db9f20d2eb92e22b5f" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 42409 } attrs { promote: true } } unsafe_config_change: true
I20251214 21:04:50.821791 17665 ts_tablet_manager.cc:1434] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f: Time spent starting tablet: real 0.004s user 0.000s sys 0.006s
I20251214 21:04:50.822739 17069 tablet_copy_service.cc:342] P e4d4ed3c5a7c4bb7b45302529d15a17a: Request end of tablet copy session b2cf3093c68543db9f20d2eb92e22b5f-098541a71786462794b57216542f789b received from {username='slave'} at 127.16.120.3:34473
I20251214 21:04:50.822857 17069 tablet_copy_service.cc:434] P e4d4ed3c5a7c4bb7b45302529d15a17a: ending tablet copy session b2cf3093c68543db9f20d2eb92e22b5f-098541a71786462794b57216542f789b on tablet 098541a71786462794b57216542f789b with peer b2cf3093c68543db9f20d2eb92e22b5f
I20251214 21:04:51.329159 17311 raft_consensus.cc:1217] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4] Dedup: 3.4->[]
W20251214 21:04:51.509246 17547 catalog_manager.cc:4767] Async tablet task DeleteTablet RPC for tablet 098541a71786462794b57216542f789b on TS ff1f09e6d9c14d7eb0403c3d103907a5 failed: Not found: failed to reset TS proxy: Could not find TS for UUID ff1f09e6d9c14d7eb0403c3d103907a5
I20251214 21:04:51.775571 17670 raft_consensus.cc:1064] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a: attempting to promote NON_VOTER b2cf3093c68543db9f20d2eb92e22b5f to VOTER
I20251214 21:04:51.776024 17670 consensus_queue.cc:237] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } peers { permanent_uuid: "b2cf3093c68543db9f20d2eb92e22b5f" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 42409 } attrs { promote: false } } unsafe_config_change: true
I20251214 21:04:51.777323 17311 raft_consensus.cc:1275] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f [term 3 LEARNER]: Refusing update from remote peer e4d4ed3c5a7c4bb7b45302529d15a17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251214 21:04:51.777366 17442 raft_consensus.cc:1275] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 3 FOLLOWER]: Refusing update from remote peer e4d4ed3c5a7c4bb7b45302529d15a17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251214 21:04:51.777765 17674 consensus_queue.cc:1048] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cf3093c68543db9f20d2eb92e22b5f" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 42409 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251214 21:04:51.778012 17671 consensus_queue.cc:1048] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251214 21:04:51.779764 17674 raft_consensus.cc:2955] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b2cf3093c68543db9f20d2eb92e22b5f (127.16.120.3) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } peers { permanent_uuid: "b2cf3093c68543db9f20d2eb92e22b5f" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 42409 } attrs { promote: false } } unsafe_config_change: true }
I20251214 21:04:51.780347 17442 raft_consensus.cc:2955] T 098541a71786462794b57216542f789b P a0ae39181bd74f8e9f9be0a89d005c8d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b2cf3093c68543db9f20d2eb92e22b5f (127.16.120.3) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } peers { permanent_uuid: "b2cf3093c68543db9f20d2eb92e22b5f" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 42409 } attrs { promote: false } } unsafe_config_change: true }
I20251214 21:04:51.781337 17311 raft_consensus.cc:2955] T 098541a71786462794b57216542f789b P b2cf3093c68543db9f20d2eb92e22b5f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b2cf3093c68543db9f20d2eb92e22b5f (127.16.120.3) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } } peers { permanent_uuid: "b2cf3093c68543db9f20d2eb92e22b5f" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 42409 } attrs { promote: false } } unsafe_config_change: true }
I20251214 21:04:51.782852 17562 catalog_manager.cc:5654] T 098541a71786462794b57216542f789b P e4d4ed3c5a7c4bb7b45302529d15a17a reported cstate change: config changed from index 4 to 5, b2cf3093c68543db9f20d2eb92e22b5f (127.16.120.3) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 40217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2cf3093c68543db9f20d2eb92e22b5f" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 42409 } attrs { promote: false } health_report { overall_health: HEALTHY } } unsafe_config_change: true }
I20251214 21:04:51.843343 16864 kudu-admin-test.cc:751] Waiting for Master to see new config...
I20251214 21:04:51.852941 16864 kudu-admin-test.cc:756] Tablet locations:
tablet_locations {
tablet_id: "098541a71786462794b57216542f789b"
DEPRECATED_stale: false
partition {
partition_key_start: ""
partition_key_end: ""
}
interned_replicas {
ts_info_idx: 0
role: FOLLOWER
}
interned_replicas {
ts_info_idx: 1
role: LEADER
}
interned_replicas {
ts_info_idx: 2
role: FOLLOWER
}
}
ts_infos {
permanent_uuid: "a0ae39181bd74f8e9f9be0a89d005c8d"
rpc_addresses {
host: "127.16.120.4"
port: 40217
}
}
ts_infos {
permanent_uuid: "e4d4ed3c5a7c4bb7b45302529d15a17a"
rpc_addresses {
host: "127.16.120.1"
port: 39339
}
}
ts_infos {
permanent_uuid: "b2cf3093c68543db9f20d2eb92e22b5f"
rpc_addresses {
host: "127.16.120.3"
port: 42409
}
}
I20251214 21:04:51.854173 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 16967
I20251214 21:04:51.859944 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 17229
I20251214 21:04:51.864691 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 17360
I20251214 21:04:51.869233 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 17530
2025-12-14T21:04:51Z chronyd exiting
[ OK ] AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes (5709 ms)
[ RUN ] AdminCliTest.TestGracefulSpecificLeaderStepDown
I20251214 21:04:51.891062 16864 test_util.cc:276] Using random seed: -662840464
I20251214 21:04:51.891768 16864 ts_itest-base.cc:115] Starting cluster with:
I20251214 21:04:51.891808 16864 ts_itest-base.cc:116] --------------
I20251214 21:04:51.891819 16864 ts_itest-base.cc:117] 3 tablet servers
I20251214 21:04:51.891827 16864 ts_itest-base.cc:118] 3 replicas per TS
I20251214 21:04:51.891836 16864 ts_itest-base.cc:119] --------------
2025-12-14T21:04:51Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-14T21:04:51Z Disabled control of system clock
I20251214 21:04:51.899541 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:43791
--webserver_interface=127.16.120.62
--webserver_port=0
--builtin_ntp_servers=127.16.120.20:34441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.120.62:43791
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20251214 21:04:52.002866 17691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:52.003101 17691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:52.003159 17691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:52.006564 17691 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251214 21:04:52.006635 17691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:52.006655 17691 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251214 21:04:52.006672 17691 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251214 21:04:52.010586 17691 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:34441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.16.120.62:43791
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:43791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.16.120.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.17691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:52.011636 17691 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:52.012749 17691 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:52.018244 17699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:52.018273 17696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:52.018244 17697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:52.018532 17691 server_base.cc:1047] running on GCE node
I20251214 21:04:52.018993 17691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:52.019865 17691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:52.021026 17691 hybrid_clock.cc:648] HybridClock initialized: now 1765746292021014 us; error 29 us; skew 500 ppm
I20251214 21:04:52.022840 17691 webserver.cc:492] Webserver started at http://127.16.120.62:33833/ using document root <none> and password file <none>
I20251214 21:04:52.023428 17691 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:52.023489 17691 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:52.023676 17691 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:52.025216 17691 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "85e49cc75d074a3f86676b8c9c58dcc2"
format_stamp: "Formatted at 2025-12-14 21:04:52 on dist-test-slave-8rzr"
I20251214 21:04:52.025681 17691 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "85e49cc75d074a3f86676b8c9c58dcc2"
format_stamp: "Formatted at 2025-12-14 21:04:52 on dist-test-slave-8rzr"
I20251214 21:04:52.028908 17691 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20251214 21:04:52.031064 17705 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:52.032110 17691 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:52.032234 17691 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
uuid: "85e49cc75d074a3f86676b8c9c58dcc2"
format_stamp: "Formatted at 2025-12-14 21:04:52 on dist-test-slave-8rzr"
I20251214 21:04:52.032320 17691 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:52.051785 17691 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:52.052520 17691 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:52.052711 17691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:52.060345 17691 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.62:43791
I20251214 21:04:52.060344 17757 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.62:43791 every 8 connection(s)
I20251214 21:04:52.061455 17691 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251214 21:04:52.064230 17758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:52.064271 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 17691
I20251214 21:04:52.064360 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251214 21:04:52.069339 17758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2: Bootstrap starting.
I20251214 21:04:52.071523 17758 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:52.072337 17758 log.cc:826] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:52.074074 17758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2: No bootstrap required, opened a new log
I20251214 21:04:52.076366 17758 raft_consensus.cc:359] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e49cc75d074a3f86676b8c9c58dcc2" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 43791 } }
I20251214 21:04:52.076552 17758 raft_consensus.cc:385] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:52.076609 17758 raft_consensus.cc:740] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e49cc75d074a3f86676b8c9c58dcc2, State: Initialized, Role: FOLLOWER
I20251214 21:04:52.077025 17758 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e49cc75d074a3f86676b8c9c58dcc2" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 43791 } }
I20251214 21:04:52.077163 17758 raft_consensus.cc:399] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:52.077226 17758 raft_consensus.cc:493] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:52.077325 17758 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:52.078078 17758 raft_consensus.cc:515] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e49cc75d074a3f86676b8c9c58dcc2" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 43791 } }
I20251214 21:04:52.078387 17758 leader_election.cc:304] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85e49cc75d074a3f86676b8c9c58dcc2; no voters:
I20251214 21:04:52.078640 17758 leader_election.cc:290] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:04:52.078780 17763 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:52.078999 17763 raft_consensus.cc:697] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [term 1 LEADER]: Becoming Leader. State: Replica: 85e49cc75d074a3f86676b8c9c58dcc2, State: Running, Role: LEADER
I20251214 21:04:52.079269 17763 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e49cc75d074a3f86676b8c9c58dcc2" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 43791 } }
I20251214 21:04:52.079648 17758 sys_catalog.cc:565] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:04:52.080732 17764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "85e49cc75d074a3f86676b8c9c58dcc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e49cc75d074a3f86676b8c9c58dcc2" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 43791 } } }
I20251214 21:04:52.080833 17764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:52.081188 17772 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:04:52.081281 17765 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85e49cc75d074a3f86676b8c9c58dcc2. Latest consensus state: current_term: 1 leader_uuid: "85e49cc75d074a3f86676b8c9c58dcc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e49cc75d074a3f86676b8c9c58dcc2" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 43791 } } }
I20251214 21:04:52.081350 17765 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:52.084242 17772 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:04:52.089282 17772 catalog_manager.cc:1357] Generated new cluster ID: badab2f53edb4f579208a1bd26a80c58
I20251214 21:04:52.089357 17772 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:04:52.095551 17772 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:04:52.096446 17772 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:04:52.105752 17772 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 85e49cc75d074a3f86676b8c9c58dcc2: Generated new TSK 0
I20251214 21:04:52.106637 17772 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:04:52.118335 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.1:0
--local_ip_for_outbound_sockets=127.16.120.1
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:43791
--builtin_ntp_servers=127.16.120.20:34441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20251214 21:04:52.225265 17782 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20251214 21:04:52.225521 17782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:52.225544 17782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:52.225597 17782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:52.229022 17782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:52.229144 17782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.1
I20251214 21:04:52.233232 17782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:34441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:43791
--never_fsync=true
--heap_profile_path=/tmp/kudu.17782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.1
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:52.234421 17782 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:52.235601 17782 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:52.242283 17790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:52.242576 17788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:52.242583 17787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:52.242985 17782 server_base.cc:1047] running on GCE node
I20251214 21:04:52.243431 17782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:52.243995 17782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:52.245157 17782 hybrid_clock.cc:648] HybridClock initialized: now 1765746292245135 us; error 42 us; skew 500 ppm
I20251214 21:04:52.247002 17782 webserver.cc:492] Webserver started at http://127.16.120.1:43493/ using document root <none> and password file <none>
I20251214 21:04:52.247567 17782 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:52.247625 17782 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:52.247803 17782 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:52.249364 17782 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "92921471ad4148819d9dd0b98929ad05"
format_stamp: "Formatted at 2025-12-14 21:04:52 on dist-test-slave-8rzr"
I20251214 21:04:52.249812 17782 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "92921471ad4148819d9dd0b98929ad05"
format_stamp: "Formatted at 2025-12-14 21:04:52 on dist-test-slave-8rzr"
I20251214 21:04:52.253026 17782 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20251214 21:04:52.255228 17796 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:52.256158 17782 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:52.256269 17782 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "92921471ad4148819d9dd0b98929ad05"
format_stamp: "Formatted at 2025-12-14 21:04:52 on dist-test-slave-8rzr"
I20251214 21:04:52.256350 17782 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:52.272629 17782 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:52.273276 17782 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:52.273445 17782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:52.274048 17782 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:52.275029 17782 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:52.275079 17782 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:52.275130 17782 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:52.275159 17782 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:52.284017 17782 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.1:34893
I20251214 21:04:52.284067 17909 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.1:34893 every 8 connection(s)
I20251214 21:04:52.284940 17782 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251214 21:04:52.293885 17910 heartbeater.cc:344] Connected to a master server at 127.16.120.62:43791
I20251214 21:04:52.294122 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 17782
I20251214 21:04:52.294147 17910 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:52.294221 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251214 21:04:52.294788 17910 heartbeater.cc:507] Master 127.16.120.62:43791 requested a full tablet report, sending...
I20251214 21:04:52.296219 17722 ts_manager.cc:194] Registered new tserver with Master: 92921471ad4148819d9dd0b98929ad05 (127.16.120.1:34893)
I20251214 21:04:52.296271 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.2:0
--local_ip_for_outbound_sockets=127.16.120.2
--webserver_interface=127.16.120.2
--webserver_port=0
--tserver_master_addrs=127.16.120.62:43791
--builtin_ntp_servers=127.16.120.20:34441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20251214 21:04:52.297458 17722 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.1:51501
W20251214 21:04:52.402930 17913 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20251214 21:04:52.403168 17913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:52.403189 17913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:52.403230 17913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:52.406562 17913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:52.406684 17913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.2
I20251214 21:04:52.410579 17913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:34441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.16.120.2
--webserver_port=0
--tserver_master_addrs=127.16.120.62:43791
--never_fsync=true
--heap_profile_path=/tmp/kudu.17913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.2
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:52.411626 17913 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:52.412699 17913 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:52.419335 17921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:52.419413 17919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:52.419345 17918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:52.419691 17913 server_base.cc:1047] running on GCE node
I20251214 21:04:52.420038 17913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:52.420584 17913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:52.421742 17913 hybrid_clock.cc:648] HybridClock initialized: now 1765746292421712 us; error 33 us; skew 500 ppm
I20251214 21:04:52.423418 17913 webserver.cc:492] Webserver started at http://127.16.120.2:44887/ using document root <none> and password file <none>
I20251214 21:04:52.423955 17913 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:52.424011 17913 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:52.424177 17913 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:52.425664 17913 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "6b358abca33c4cb5bc148a7b2e2c8a53"
format_stamp: "Formatted at 2025-12-14 21:04:52 on dist-test-slave-8rzr"
I20251214 21:04:52.426144 17913 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "6b358abca33c4cb5bc148a7b2e2c8a53"
format_stamp: "Formatted at 2025-12-14 21:04:52 on dist-test-slave-8rzr"
I20251214 21:04:52.429275 17913 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20251214 21:04:52.431334 17927 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:52.432291 17913 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:52.432390 17913 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "6b358abca33c4cb5bc148a7b2e2c8a53"
format_stamp: "Formatted at 2025-12-14 21:04:52 on dist-test-slave-8rzr"
I20251214 21:04:52.432469 17913 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:52.444227 17913 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:52.444886 17913 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:52.445047 17913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:52.445600 17913 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:52.446620 17913 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:52.446679 17913 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:52.446732 17913 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:52.446758 17913 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:52.455767 17913 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.2:32919
I20251214 21:04:52.455821 18040 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.2:32919 every 8 connection(s)
I20251214 21:04:52.456720 17913 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251214 21:04:52.462067 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 17913
I20251214 21:04:52.462160 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251214 21:04:52.464346 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.3:0
--local_ip_for_outbound_sockets=127.16.120.3
--webserver_interface=127.16.120.3
--webserver_port=0
--tserver_master_addrs=127.16.120.62:43791
--builtin_ntp_servers=127.16.120.20:34441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20251214 21:04:52.466010 18041 heartbeater.cc:344] Connected to a master server at 127.16.120.62:43791
I20251214 21:04:52.466243 18041 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:52.466813 18041 heartbeater.cc:507] Master 127.16.120.62:43791 requested a full tablet report, sending...
I20251214 21:04:52.467782 17722 ts_manager.cc:194] Registered new tserver with Master: 6b358abca33c4cb5bc148a7b2e2c8a53 (127.16.120.2:32919)
I20251214 21:04:52.468333 17722 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.2:55327
W20251214 21:04:52.572178 18044 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20251214 21:04:52.572433 18044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:52.572464 18044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:52.572521 18044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:52.575870 18044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:52.575999 18044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.3
I20251214 21:04:52.579841 18044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:34441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.16.120.3
--webserver_port=0
--tserver_master_addrs=127.16.120.62:43791
--never_fsync=true
--heap_profile_path=/tmp/kudu.18044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.3
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:52.581058 18044 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:52.582263 18044 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:52.588876 18049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:52.588882 18050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:52.588884 18052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:52.589102 18044 server_base.cc:1047] running on GCE node
I20251214 21:04:52.589507 18044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:52.590147 18044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:52.591296 18044 hybrid_clock.cc:648] HybridClock initialized: now 1765746292591283 us; error 27 us; skew 500 ppm
I20251214 21:04:52.593014 18044 webserver.cc:492] Webserver started at http://127.16.120.3:42053/ using document root <none> and password file <none>
I20251214 21:04:52.593572 18044 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:52.593629 18044 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:52.593812 18044 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:52.595312 18044 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "4b04aeac53b045c69a1c2c150f72b1b3"
format_stamp: "Formatted at 2025-12-14 21:04:52 on dist-test-slave-8rzr"
I20251214 21:04:52.595759 18044 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "4b04aeac53b045c69a1c2c150f72b1b3"
format_stamp: "Formatted at 2025-12-14 21:04:52 on dist-test-slave-8rzr"
I20251214 21:04:52.599100 18044 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251214 21:04:52.601305 18058 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:52.602365 18044 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251214 21:04:52.602468 18044 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "4b04aeac53b045c69a1c2c150f72b1b3"
format_stamp: "Formatted at 2025-12-14 21:04:52 on dist-test-slave-8rzr"
I20251214 21:04:52.602555 18044 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:52.616127 18044 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:52.616794 18044 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:52.616963 18044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:52.617520 18044 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:52.618538 18044 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:52.618587 18044 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:52.618639 18044 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:52.618665 18044 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:52.627763 18044 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.3:46101
I20251214 21:04:52.627820 18171 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.3:46101 every 8 connection(s)
I20251214 21:04:52.628762 18044 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251214 21:04:52.630790 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 18044
I20251214 21:04:52.630870 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251214 21:04:52.637612 18172 heartbeater.cc:344] Connected to a master server at 127.16.120.62:43791
I20251214 21:04:52.637920 18172 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:52.638513 18172 heartbeater.cc:507] Master 127.16.120.62:43791 requested a full tablet report, sending...
I20251214 21:04:52.639475 17722 ts_manager.cc:194] Registered new tserver with Master: 4b04aeac53b045c69a1c2c150f72b1b3 (127.16.120.3:46101)
I20251214 21:04:52.640030 17722 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.3:47097
I20251214 21:04:52.644582 16864 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251214 21:04:52.652916 17722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38050:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20251214 21:04:52.655308 17722 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:04:52.671794 17844 tablet_service.cc:1505] Processing CreateTablet for tablet d9cf9ec688514b43b0a133d7eaaf0dad (DEFAULT_TABLE table=TestTable [id=bed88abbd8fa436f89a5f29a851d5116]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:52.671794 17975 tablet_service.cc:1505] Processing CreateTablet for tablet d9cf9ec688514b43b0a133d7eaaf0dad (DEFAULT_TABLE table=TestTable [id=bed88abbd8fa436f89a5f29a851d5116]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:52.671990 18106 tablet_service.cc:1505] Processing CreateTablet for tablet d9cf9ec688514b43b0a133d7eaaf0dad (DEFAULT_TABLE table=TestTable [id=bed88abbd8fa436f89a5f29a851d5116]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:52.672758 18106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cf9ec688514b43b0a133d7eaaf0dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:52.672766 17975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cf9ec688514b43b0a133d7eaaf0dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:52.672766 17844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cf9ec688514b43b0a133d7eaaf0dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:52.677579 18189 tablet_bootstrap.cc:492] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3: Bootstrap starting.
I20251214 21:04:52.679000 18190 tablet_bootstrap.cc:492] T d9cf9ec688514b43b0a133d7eaaf0dad P 92921471ad4148819d9dd0b98929ad05: Bootstrap starting.
I20251214 21:04:52.680047 18189 tablet_bootstrap.cc:654] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:52.680758 18190 tablet_bootstrap.cc:654] T d9cf9ec688514b43b0a133d7eaaf0dad P 92921471ad4148819d9dd0b98929ad05: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:52.680784 18189 log.cc:826] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:52.681373 18190 log.cc:826] T d9cf9ec688514b43b0a133d7eaaf0dad P 92921471ad4148819d9dd0b98929ad05: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:52.682021 18191 tablet_bootstrap.cc:492] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53: Bootstrap starting.
I20251214 21:04:52.682366 18189 tablet_bootstrap.cc:492] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3: No bootstrap required, opened a new log
I20251214 21:04:52.682541 18189 ts_tablet_manager.cc:1403] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20251214 21:04:52.683050 18190 tablet_bootstrap.cc:492] T d9cf9ec688514b43b0a133d7eaaf0dad P 92921471ad4148819d9dd0b98929ad05: No bootstrap required, opened a new log
I20251214 21:04:52.683221 18190 ts_tablet_manager.cc:1403] T d9cf9ec688514b43b0a133d7eaaf0dad P 92921471ad4148819d9dd0b98929ad05: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20251214 21:04:52.684190 18191 tablet_bootstrap.cc:654] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:52.685027 18191 log.cc:826] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:52.685135 18189 raft_consensus.cc:359] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 46101 } } peers { permanent_uuid: "92921471ad4148819d9dd0b98929ad05" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 34893 } } peers { permanent_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 32919 } }
I20251214 21:04:52.685338 18189 raft_consensus.cc:740] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b04aeac53b045c69a1c2c150f72b1b3, State: Initialized, Role: FOLLOWER
I20251214 21:04:52.685645 18189 consensus_queue.cc:260] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 46101 } } peers { permanent_uuid: "92921471ad4148819d9dd0b98929ad05" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 34893 } } peers { permanent_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 32919 } }
I20251214 21:04:52.686489 18189 ts_tablet_manager.cc:1434] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20251214 21:04:52.686435 18190 raft_consensus.cc:359] T d9cf9ec688514b43b0a133d7eaaf0dad P 92921471ad4148819d9dd0b98929ad05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 46101 } } peers { permanent_uuid: "92921471ad4148819d9dd0b98929ad05" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 34893 } } peers { permanent_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 32919 } }
I20251214 21:04:52.686605 18190 raft_consensus.cc:740] T d9cf9ec688514b43b0a133d7eaaf0dad P 92921471ad4148819d9dd0b98929ad05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92921471ad4148819d9dd0b98929ad05, State: Initialized, Role: FOLLOWER
I20251214 21:04:52.686748 18191 tablet_bootstrap.cc:492] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53: No bootstrap required, opened a new log
I20251214 21:04:52.686888 18172 heartbeater.cc:499] Master 127.16.120.62:43791 was elected leader, sending a full tablet report...
I20251214 21:04:52.686923 18191 ts_tablet_manager.cc:1403] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20251214 21:04:52.686940 18190 consensus_queue.cc:260] T d9cf9ec688514b43b0a133d7eaaf0dad P 92921471ad4148819d9dd0b98929ad05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 46101 } } peers { permanent_uuid: "92921471ad4148819d9dd0b98929ad05" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 34893 } } peers { permanent_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 32919 } }
I20251214 21:04:52.687611 17910 heartbeater.cc:499] Master 127.16.120.62:43791 was elected leader, sending a full tablet report...
I20251214 21:04:52.687753 18190 ts_tablet_manager.cc:1434] T d9cf9ec688514b43b0a133d7eaaf0dad P 92921471ad4148819d9dd0b98929ad05: Time spent starting tablet: real 0.004s user 0.000s sys 0.005s
I20251214 21:04:52.689567 18191 raft_consensus.cc:359] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 46101 } } peers { permanent_uuid: "92921471ad4148819d9dd0b98929ad05" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 34893 } } peers { permanent_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 32919 } }
I20251214 21:04:52.689741 18191 raft_consensus.cc:740] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b358abca33c4cb5bc148a7b2e2c8a53, State: Initialized, Role: FOLLOWER
I20251214 21:04:52.690032 18191 consensus_queue.cc:260] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 46101 } } peers { permanent_uuid: "92921471ad4148819d9dd0b98929ad05" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 34893 } } peers { permanent_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 32919 } }
I20251214 21:04:52.690778 18191 ts_tablet_manager.cc:1434] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251214 21:04:52.690785 18041 heartbeater.cc:499] Master 127.16.120.62:43791 was elected leader, sending a full tablet report...
I20251214 21:04:52.696270 16864 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251214 21:04:52.697710 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 92921471ad4148819d9dd0b98929ad05 to finish bootstrapping
I20251214 21:04:52.702886 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 6b358abca33c4cb5bc148a7b2e2c8a53 to finish bootstrapping
W20251214 21:04:52.707741 18042 tablet.cc:2378] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:04:52.708166 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 4b04aeac53b045c69a1c2c150f72b1b3 to finish bootstrapping
I20251214 21:04:52.727463 17995 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d9cf9ec688514b43b0a133d7eaaf0dad"
dest_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53"
from {username='slave'} at 127.0.0.1:55300
I20251214 21:04:52.727707 17995 raft_consensus.cc:493] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:04:52.727828 17995 raft_consensus.cc:3060] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:52.728746 17995 raft_consensus.cc:515] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 46101 } } peers { permanent_uuid: "92921471ad4148819d9dd0b98929ad05" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 34893 } } peers { permanent_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 32919 } }
I20251214 21:04:52.729854 17995 leader_election.cc:290] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [CANDIDATE]: Term 1 election: Requested vote from peers 4b04aeac53b045c69a1c2c150f72b1b3 (127.16.120.3:46101), 92921471ad4148819d9dd0b98929ad05 (127.16.120.1:34893)
I20251214 21:04:52.733481 16864 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20251214 21:04:52.733649 17864 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9cf9ec688514b43b0a133d7eaaf0dad" candidate_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "92921471ad4148819d9dd0b98929ad05"
I20251214 21:04:52.733881 17864 raft_consensus.cc:3060] T d9cf9ec688514b43b0a133d7eaaf0dad P 92921471ad4148819d9dd0b98929ad05 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:52.734799 17864 raft_consensus.cc:2468] T d9cf9ec688514b43b0a133d7eaaf0dad P 92921471ad4148819d9dd0b98929ad05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b358abca33c4cb5bc148a7b2e2c8a53 in term 1.
I20251214 21:04:52.735144 18126 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9cf9ec688514b43b0a133d7eaaf0dad" candidate_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4b04aeac53b045c69a1c2c150f72b1b3"
I20251214 21:04:52.735189 17928 leader_election.cc:304] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b358abca33c4cb5bc148a7b2e2c8a53, 92921471ad4148819d9dd0b98929ad05; no voters:
I20251214 21:04:52.735301 18126 raft_consensus.cc:3060] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:52.735482 18197 raft_consensus.cc:2804] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:52.735719 18197 raft_consensus.cc:697] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 1 LEADER]: Becoming Leader. State: Replica: 6b358abca33c4cb5bc148a7b2e2c8a53, State: Running, Role: LEADER
I20251214 21:04:52.736071 18197 consensus_queue.cc:237] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 46101 } } peers { permanent_uuid: "92921471ad4148819d9dd0b98929ad05" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 34893 } } peers { permanent_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 32919 } }
I20251214 21:04:52.736361 18126 raft_consensus.cc:2468] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b358abca33c4cb5bc148a7b2e2c8a53 in term 1.
I20251214 21:04:52.739519 17719 catalog_manager.cc:5654] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b358abca33c4cb5bc148a7b2e2c8a53 (127.16.120.2). New cstate: current_term: 1 leader_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 46101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92921471ad4148819d9dd0b98929ad05" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 34893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 32919 } health_report { overall_health: HEALTHY } } }
W20251214 21:04:52.786079 17911 tablet.cc:2378] T d9cf9ec688514b43b0a133d7eaaf0dad P 92921471ad4148819d9dd0b98929ad05: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:04:52.836606 16864 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0 0.0
W20251214 21:04:52.879658 18173 tablet.cc:2378] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:04:53.039162 16864 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0 0.0
I20251214 21:04:53.146131 18197 consensus_queue.cc:1048] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 46101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:53.152215 18205 consensus_queue.cc:1048] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92921471ad4148819d9dd0b98929ad05" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:53.478695 17995 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d9cf9ec688514b43b0a133d7eaaf0dad"
dest_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:55312
I20251214 21:04:53.478859 17995 raft_consensus.cc:606] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 1 LEADER]: Received request to transfer leadership
I20251214 21:04:53.643777 18197 raft_consensus.cc:993] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53: : Instructing follower 4b04aeac53b045c69a1c2c150f72b1b3 to start an election
I20251214 21:04:53.643893 18197 raft_consensus.cc:1081] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 1 LEADER]: Signalling peer 4b04aeac53b045c69a1c2c150f72b1b3 to start an election
I20251214 21:04:53.644457 18126 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d9cf9ec688514b43b0a133d7eaaf0dad"
dest_uuid: "4b04aeac53b045c69a1c2c150f72b1b3"
from {username='slave'} at 127.16.120.2:36157
I20251214 21:04:53.644641 18126 raft_consensus.cc:493] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251214 21:04:53.644716 18126 raft_consensus.cc:3060] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:53.645479 18126 raft_consensus.cc:515] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 46101 } } peers { permanent_uuid: "92921471ad4148819d9dd0b98929ad05" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 34893 } } peers { permanent_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 32919 } }
I20251214 21:04:53.646473 18126 leader_election.cc:290] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3 [CANDIDATE]: Term 2 election: Requested vote from peers 92921471ad4148819d9dd0b98929ad05 (127.16.120.1:34893), 6b358abca33c4cb5bc148a7b2e2c8a53 (127.16.120.2:32919)
I20251214 21:04:53.649935 17995 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9cf9ec688514b43b0a133d7eaaf0dad" candidate_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53"
I20251214 21:04:53.649971 17864 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d9cf9ec688514b43b0a133d7eaaf0dad" candidate_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92921471ad4148819d9dd0b98929ad05"
I20251214 21:04:53.650084 17864 raft_consensus.cc:3060] T d9cf9ec688514b43b0a133d7eaaf0dad P 92921471ad4148819d9dd0b98929ad05 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:53.650082 17995 raft_consensus.cc:3055] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 1 LEADER]: Stepping down as leader of term 1
I20251214 21:04:53.650132 17995 raft_consensus.cc:740] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b358abca33c4cb5bc148a7b2e2c8a53, State: Running, Role: LEADER
I20251214 21:04:53.650238 17995 consensus_queue.cc:260] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 46101 } } peers { permanent_uuid: "92921471ad4148819d9dd0b98929ad05" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 34893 } } peers { permanent_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 32919 } }
I20251214 21:04:53.650511 17995 raft_consensus.cc:3060] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:53.650871 17864 raft_consensus.cc:2468] T d9cf9ec688514b43b0a133d7eaaf0dad P 92921471ad4148819d9dd0b98929ad05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b04aeac53b045c69a1c2c150f72b1b3 in term 2.
I20251214 21:04:53.651221 18059 leader_election.cc:304] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b04aeac53b045c69a1c2c150f72b1b3, 92921471ad4148819d9dd0b98929ad05; no voters:
I20251214 21:04:53.651265 17995 raft_consensus.cc:2468] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b04aeac53b045c69a1c2c150f72b1b3 in term 2.
I20251214 21:04:53.651533 18229 raft_consensus.cc:2804] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:53.651713 18229 raft_consensus.cc:697] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3 [term 2 LEADER]: Becoming Leader. State: Replica: 4b04aeac53b045c69a1c2c150f72b1b3, State: Running, Role: LEADER
I20251214 21:04:53.652005 18229 consensus_queue.cc:237] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 46101 } } peers { permanent_uuid: "92921471ad4148819d9dd0b98929ad05" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 34893 } } peers { permanent_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 32919 } }
I20251214 21:04:53.654361 17720 catalog_manager.cc:5654] T d9cf9ec688514b43b0a133d7eaaf0dad P 4b04aeac53b045c69a1c2c150f72b1b3 reported cstate change: term changed from 1 to 2, leader changed from 6b358abca33c4cb5bc148a7b2e2c8a53 (127.16.120.2) to 4b04aeac53b045c69a1c2c150f72b1b3 (127.16.120.3). New cstate: current_term: 2 leader_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b04aeac53b045c69a1c2c150f72b1b3" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 46101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92921471ad4148819d9dd0b98929ad05" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 34893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 32919 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:53.893067 17995 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d9cf9ec688514b43b0a133d7eaaf0dad"
dest_uuid: "6b358abca33c4cb5bc148a7b2e2c8a53"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:55328
I20251214 21:04:53.893231 17995 raft_consensus.cc:606] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 2 FOLLOWER]: Received request to transfer leadership
I20251214 21:04:53.893298 17995 raft_consensus.cc:614] T d9cf9ec688514b43b0a133d7eaaf0dad P 6b358abca33c4cb5bc148a7b2e2c8a53 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20251214 21:04:53.952170 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 17782
I20251214 21:04:53.957809 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 17913
I20251214 21:04:53.962797 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 18044
I20251214 21:04:53.967519 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 17691
2025-12-14T21:04:53Z chronyd exiting
[ OK ] AdminCliTest.TestGracefulSpecificLeaderStepDown (2096 ms)
[ RUN ] AdminCliTest.TestDescribeTableColumnFlags
I20251214 21:04:53.987609 16864 test_util.cc:276] Using random seed: -660743918
I20251214 21:04:53.988327 16864 ts_itest-base.cc:115] Starting cluster with:
I20251214 21:04:53.988361 16864 ts_itest-base.cc:116] --------------
I20251214 21:04:53.988371 16864 ts_itest-base.cc:117] 3 tablet servers
I20251214 21:04:53.988380 16864 ts_itest-base.cc:118] 3 replicas per TS
I20251214 21:04:53.988389 16864 ts_itest-base.cc:119] --------------
2025-12-14T21:04:53Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-14T21:04:53Z Disabled control of system clock
I20251214 21:04:53.996119 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:41291
--webserver_interface=127.16.120.62
--webserver_port=0
--builtin_ntp_servers=127.16.120.20:41823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.120.62:41291 with env {}
W20251214 21:04:54.097342 18256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:54.097544 18256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:54.097581 18256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:54.100687 18256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251214 21:04:54.100733 18256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:54.100750 18256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251214 21:04:54.100766 18256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251214 21:04:54.104336 18256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.120.62:41291
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:41291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.16.120.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.18256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:54.105248 18256 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:54.106287 18256 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:54.111562 18262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:54.111560 18264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:54.111802 18256 server_base.cc:1047] running on GCE node
W20251214 21:04:54.111583 18261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:54.112308 18256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:54.113133 18256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:54.114277 18256 hybrid_clock.cc:648] HybridClock initialized: now 1765746294114266 us; error 24 us; skew 500 ppm
I20251214 21:04:54.115926 18256 webserver.cc:492] Webserver started at http://127.16.120.62:42745/ using document root <none> and password file <none>
I20251214 21:04:54.116443 18256 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:54.116498 18256 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:54.116670 18256 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:54.118176 18256 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "f9cd6368908542408d110837998dc700"
format_stamp: "Formatted at 2025-12-14 21:04:54 on dist-test-slave-8rzr"
I20251214 21:04:54.118606 18256 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "f9cd6368908542408d110837998dc700"
format_stamp: "Formatted at 2025-12-14 21:04:54 on dist-test-slave-8rzr"
I20251214 21:04:54.121626 18256 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20251214 21:04:54.123601 18270 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:54.124517 18256 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:54.124614 18256 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
uuid: "f9cd6368908542408d110837998dc700"
format_stamp: "Formatted at 2025-12-14 21:04:54 on dist-test-slave-8rzr"
I20251214 21:04:54.124693 18256 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:54.143128 18256 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:54.143715 18256 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:54.143867 18256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:54.150334 18256 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.62:41291
I20251214 21:04:54.150342 18322 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.62:41291 every 8 connection(s)
I20251214 21:04:54.151237 18256 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251214 21:04:54.153894 18323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:54.158634 18323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700: Bootstrap starting.
I20251214 21:04:54.160840 18323 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:54.160845 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 18256
I20251214 21:04:54.160938 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251214 21:04:54.161610 18323 log.cc:826] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:54.163435 18323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700: No bootstrap required, opened a new log
I20251214 21:04:54.166471 18323 raft_consensus.cc:359] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9cd6368908542408d110837998dc700" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 41291 } }
I20251214 21:04:54.166673 18323 raft_consensus.cc:385] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:54.166751 18323 raft_consensus.cc:740] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9cd6368908542408d110837998dc700, State: Initialized, Role: FOLLOWER
I20251214 21:04:54.167200 18323 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9cd6368908542408d110837998dc700" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 41291 } }
I20251214 21:04:54.167361 18323 raft_consensus.cc:399] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:54.167451 18323 raft_consensus.cc:493] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:54.167560 18323 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:54.168602 18323 raft_consensus.cc:515] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9cd6368908542408d110837998dc700" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 41291 } }
I20251214 21:04:54.168999 18323 leader_election.cc:304] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9cd6368908542408d110837998dc700; no voters:
I20251214 21:04:54.169318 18323 leader_election.cc:290] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:04:54.169405 18328 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:54.169590 18328 raft_consensus.cc:697] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [term 1 LEADER]: Becoming Leader. State: Replica: f9cd6368908542408d110837998dc700, State: Running, Role: LEADER
I20251214 21:04:54.169893 18328 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9cd6368908542408d110837998dc700" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 41291 } }
I20251214 21:04:54.170490 18323 sys_catalog.cc:565] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:04:54.171005 18330 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9cd6368908542408d110837998dc700. Latest consensus state: current_term: 1 leader_uuid: "f9cd6368908542408d110837998dc700" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9cd6368908542408d110837998dc700" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 41291 } } }
I20251214 21:04:54.171178 18330 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:54.171360 18329 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9cd6368908542408d110837998dc700" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9cd6368908542408d110837998dc700" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 41291 } } }
I20251214 21:04:54.171494 18329 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:54.171916 18334 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:04:54.174774 18334 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:04:54.179791 18334 catalog_manager.cc:1357] Generated new cluster ID: a74108a8cfb8434dae36095e7936f947
I20251214 21:04:54.179848 18334 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:04:54.199595 18334 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:04:54.200842 18334 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:04:54.217384 18334 catalog_manager.cc:6027] T 00000000000000000000000000000000 P f9cd6368908542408d110837998dc700: Generated new TSK 0
I20251214 21:04:54.218169 18334 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:04:54.222460 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.1:0
--local_ip_for_outbound_sockets=127.16.120.1
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:41291
--builtin_ntp_servers=127.16.120.20:41823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251214 21:04:54.339363 18347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:54.339570 18347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:54.339612 18347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:54.342871 18347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:54.342969 18347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.1
I20251214 21:04:54.346700 18347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:41291
--never_fsync=true
--heap_profile_path=/tmp/kudu.18347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.1
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:54.347709 18347 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:54.348757 18347 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:54.354941 18355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:54.354957 18353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:54.354972 18352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:54.355453 18347 server_base.cc:1047] running on GCE node
I20251214 21:04:54.355803 18347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:54.356297 18347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:54.357441 18347 hybrid_clock.cc:648] HybridClock initialized: now 1765746294357425 us; error 37 us; skew 500 ppm
I20251214 21:04:54.359174 18347 webserver.cc:492] Webserver started at http://127.16.120.1:40683/ using document root <none> and password file <none>
I20251214 21:04:54.359694 18347 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:54.359756 18347 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:54.359920 18347 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:54.361374 18347 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "7acd14314e364b148849b983ef5ae307"
format_stamp: "Formatted at 2025-12-14 21:04:54 on dist-test-slave-8rzr"
I20251214 21:04:54.361815 18347 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "7acd14314e364b148849b983ef5ae307"
format_stamp: "Formatted at 2025-12-14 21:04:54 on dist-test-slave-8rzr"
I20251214 21:04:54.364990 18347 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20251214 21:04:54.367277 18361 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:54.368368 18347 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:54.368474 18347 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "7acd14314e364b148849b983ef5ae307"
format_stamp: "Formatted at 2025-12-14 21:04:54 on dist-test-slave-8rzr"
I20251214 21:04:54.368566 18347 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:54.384150 18347 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:54.384693 18347 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:54.384851 18347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:54.385367 18347 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:54.386329 18347 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:54.386376 18347 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:54.386430 18347 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:54.386454 18347 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:54.394987 18347 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.1:42627
I20251214 21:04:54.395009 18474 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.1:42627 every 8 connection(s)
I20251214 21:04:54.395974 18347 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251214 21:04:54.398317 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 18347
I20251214 21:04:54.398442 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251214 21:04:54.400600 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.2:0
--local_ip_for_outbound_sockets=127.16.120.2
--webserver_interface=127.16.120.2
--webserver_port=0
--tserver_master_addrs=127.16.120.62:41291
--builtin_ntp_servers=127.16.120.20:41823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251214 21:04:54.405248 18475 heartbeater.cc:344] Connected to a master server at 127.16.120.62:41291
I20251214 21:04:54.405551 18475 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:54.406320 18475 heartbeater.cc:507] Master 127.16.120.62:41291 requested a full tablet report, sending...
I20251214 21:04:54.407866 18287 ts_manager.cc:194] Registered new tserver with Master: 7acd14314e364b148849b983ef5ae307 (127.16.120.1:42627)
I20251214 21:04:54.408998 18287 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.1:44195
W20251214 21:04:54.505851 18478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:54.506047 18478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:54.506095 18478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:54.509296 18478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:54.509414 18478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.2
I20251214 21:04:54.513208 18478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.16.120.2
--webserver_port=0
--tserver_master_addrs=127.16.120.62:41291
--never_fsync=true
--heap_profile_path=/tmp/kudu.18478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.2
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:54.514257 18478 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:54.515339 18478 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:54.521571 18486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:54.521600 18483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:54.521597 18484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:54.521910 18478 server_base.cc:1047] running on GCE node
I20251214 21:04:54.522260 18478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:54.522817 18478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:54.523977 18478 hybrid_clock.cc:648] HybridClock initialized: now 1765746294523955 us; error 33 us; skew 500 ppm
I20251214 21:04:54.525774 18478 webserver.cc:492] Webserver started at http://127.16.120.2:41739/ using document root <none> and password file <none>
I20251214 21:04:54.526320 18478 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:54.526382 18478 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:54.526571 18478 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:54.529608 18478 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "fc6098ce4fc24c37b94359549ca01e61"
format_stamp: "Formatted at 2025-12-14 21:04:54 on dist-test-slave-8rzr"
I20251214 21:04:54.530094 18478 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "fc6098ce4fc24c37b94359549ca01e61"
format_stamp: "Formatted at 2025-12-14 21:04:54 on dist-test-slave-8rzr"
I20251214 21:04:54.533347 18478 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20251214 21:04:54.535534 18492 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:54.536535 18478 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20251214 21:04:54.536623 18478 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "fc6098ce4fc24c37b94359549ca01e61"
format_stamp: "Formatted at 2025-12-14 21:04:54 on dist-test-slave-8rzr"
I20251214 21:04:54.536695 18478 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:54.547646 18478 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:54.548126 18478 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:54.548246 18478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:54.548677 18478 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:54.549551 18478 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:54.549595 18478 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:54.549631 18478 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:54.549652 18478 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:54.557956 18478 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.2:41915
I20251214 21:04:54.557991 18606 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.2:41915 every 8 connection(s)
I20251214 21:04:54.558830 18478 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251214 21:04:54.566165 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 18478
I20251214 21:04:54.566272 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251214 21:04:54.567266 18607 heartbeater.cc:344] Connected to a master server at 127.16.120.62:41291
I20251214 21:04:54.567507 18607 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:54.568074 18607 heartbeater.cc:507] Master 127.16.120.62:41291 requested a full tablet report, sending...
I20251214 21:04:54.568466 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.3:0
--local_ip_for_outbound_sockets=127.16.120.3
--webserver_interface=127.16.120.3
--webserver_port=0
--tserver_master_addrs=127.16.120.62:41291
--builtin_ntp_servers=127.16.120.20:41823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251214 21:04:54.569144 18287 ts_manager.cc:194] Registered new tserver with Master: fc6098ce4fc24c37b94359549ca01e61 (127.16.120.2:41915)
I20251214 21:04:54.569876 18287 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.2:33173
W20251214 21:04:54.674165 18610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:54.674355 18610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:54.674419 18610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:54.677655 18610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:54.677781 18610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.3
I20251214 21:04:54.681473 18610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.16.120.3
--webserver_port=0
--tserver_master_addrs=127.16.120.62:41291
--never_fsync=true
--heap_profile_path=/tmp/kudu.18610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.3
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:54.682475 18610 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:54.683522 18610 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:54.689640 18618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:54.689607 18616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:54.689595 18615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:54.689874 18610 server_base.cc:1047] running on GCE node
I20251214 21:04:54.690304 18610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:54.690886 18610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:54.692035 18610 hybrid_clock.cc:648] HybridClock initialized: now 1765746294692020 us; error 34 us; skew 500 ppm
I20251214 21:04:54.693758 18610 webserver.cc:492] Webserver started at http://127.16.120.3:42209/ using document root <none> and password file <none>
I20251214 21:04:54.694303 18610 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:54.694363 18610 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:54.694531 18610 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:54.696043 18610 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "a8eeeef062934223ba9fb0e3746a70eb"
format_stamp: "Formatted at 2025-12-14 21:04:54 on dist-test-slave-8rzr"
I20251214 21:04:54.696484 18610 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "a8eeeef062934223ba9fb0e3746a70eb"
format_stamp: "Formatted at 2025-12-14 21:04:54 on dist-test-slave-8rzr"
I20251214 21:04:54.699692 18610 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20251214 21:04:54.701802 18624 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:54.702754 18610 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:54.702852 18610 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "a8eeeef062934223ba9fb0e3746a70eb"
format_stamp: "Formatted at 2025-12-14 21:04:54 on dist-test-slave-8rzr"
I20251214 21:04:54.702929 18610 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:54.732861 18610 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:54.733479 18610 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:54.733637 18610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:54.734252 18610 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:54.735221 18610 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:54.735271 18610 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:54.735324 18610 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:54.735351 18610 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:54.744127 18610 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.3:33769
I20251214 21:04:54.744191 18737 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.3:33769 every 8 connection(s)
I20251214 21:04:54.745029 18610 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251214 21:04:54.753546 18738 heartbeater.cc:344] Connected to a master server at 127.16.120.62:41291
I20251214 21:04:54.753777 18738 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:54.754434 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 18610
I20251214 21:04:54.754515 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251214 21:04:54.755014 18738 heartbeater.cc:507] Master 127.16.120.62:41291 requested a full tablet report, sending...
I20251214 21:04:54.756044 18287 ts_manager.cc:194] Registered new tserver with Master: a8eeeef062934223ba9fb0e3746a70eb (127.16.120.3:33769)
I20251214 21:04:54.756634 18287 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.3:39739
I20251214 21:04:54.757026 16864 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251214 21:04:54.764848 18287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39360:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20251214 21:04:54.767180 18287 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:04:54.783258 18672 tablet_service.cc:1505] Processing CreateTablet for tablet 4c0a326f96264ea2a0b072d641844bbd (DEFAULT_TABLE table=TestTable [id=99a073481e4143c39d60e23ace6972b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:54.783280 18409 tablet_service.cc:1505] Processing CreateTablet for tablet 4c0a326f96264ea2a0b072d641844bbd (DEFAULT_TABLE table=TestTable [id=99a073481e4143c39d60e23ace6972b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:54.783279 18540 tablet_service.cc:1505] Processing CreateTablet for tablet 4c0a326f96264ea2a0b072d641844bbd (DEFAULT_TABLE table=TestTable [id=99a073481e4143c39d60e23ace6972b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:54.784111 18672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c0a326f96264ea2a0b072d641844bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:54.784132 18409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c0a326f96264ea2a0b072d641844bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:54.784132 18540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c0a326f96264ea2a0b072d641844bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:54.789170 18755 tablet_bootstrap.cc:492] T 4c0a326f96264ea2a0b072d641844bbd P a8eeeef062934223ba9fb0e3746a70eb: Bootstrap starting.
I20251214 21:04:54.790392 18756 tablet_bootstrap.cc:492] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61: Bootstrap starting.
I20251214 21:04:54.791473 18755 tablet_bootstrap.cc:654] T 4c0a326f96264ea2a0b072d641844bbd P a8eeeef062934223ba9fb0e3746a70eb: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:54.792152 18756 tablet_bootstrap.cc:654] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:54.792150 18755 log.cc:826] T 4c0a326f96264ea2a0b072d641844bbd P a8eeeef062934223ba9fb0e3746a70eb: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:54.792771 18756 log.cc:826] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:54.793303 18757 tablet_bootstrap.cc:492] T 4c0a326f96264ea2a0b072d641844bbd P 7acd14314e364b148849b983ef5ae307: Bootstrap starting.
I20251214 21:04:54.793895 18755 tablet_bootstrap.cc:492] T 4c0a326f96264ea2a0b072d641844bbd P a8eeeef062934223ba9fb0e3746a70eb: No bootstrap required, opened a new log
I20251214 21:04:54.794070 18755 ts_tablet_manager.cc:1403] T 4c0a326f96264ea2a0b072d641844bbd P a8eeeef062934223ba9fb0e3746a70eb: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20251214 21:04:54.794440 18756 tablet_bootstrap.cc:492] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61: No bootstrap required, opened a new log
I20251214 21:04:54.794610 18756 ts_tablet_manager.cc:1403] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20251214 21:04:54.795258 18757 tablet_bootstrap.cc:654] T 4c0a326f96264ea2a0b072d641844bbd P 7acd14314e364b148849b983ef5ae307: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:54.796013 18757 log.cc:826] T 4c0a326f96264ea2a0b072d641844bbd P 7acd14314e364b148849b983ef5ae307: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:54.796494 18755 raft_consensus.cc:359] T 4c0a326f96264ea2a0b072d641844bbd P a8eeeef062934223ba9fb0e3746a70eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.796682 18755 raft_consensus.cc:385] T 4c0a326f96264ea2a0b072d641844bbd P a8eeeef062934223ba9fb0e3746a70eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:54.796736 18755 raft_consensus.cc:740] T 4c0a326f96264ea2a0b072d641844bbd P a8eeeef062934223ba9fb0e3746a70eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8eeeef062934223ba9fb0e3746a70eb, State: Initialized, Role: FOLLOWER
I20251214 21:04:54.797119 18755 consensus_queue.cc:260] T 4c0a326f96264ea2a0b072d641844bbd P a8eeeef062934223ba9fb0e3746a70eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.797369 18756 raft_consensus.cc:359] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.797540 18756 raft_consensus.cc:385] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:54.797590 18756 raft_consensus.cc:740] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6098ce4fc24c37b94359549ca01e61, State: Initialized, Role: FOLLOWER
I20251214 21:04:54.797729 18738 heartbeater.cc:499] Master 127.16.120.62:41291 was elected leader, sending a full tablet report...
I20251214 21:04:54.797967 18755 ts_tablet_manager.cc:1434] T 4c0a326f96264ea2a0b072d641844bbd P a8eeeef062934223ba9fb0e3746a70eb: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251214 21:04:54.797987 18756 consensus_queue.cc:260] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.798569 18607 heartbeater.cc:499] Master 127.16.120.62:41291 was elected leader, sending a full tablet report...
I20251214 21:04:54.798755 18756 ts_tablet_manager.cc:1434] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251214 21:04:54.799337 18757 tablet_bootstrap.cc:492] T 4c0a326f96264ea2a0b072d641844bbd P 7acd14314e364b148849b983ef5ae307: No bootstrap required, opened a new log
I20251214 21:04:54.799530 18757 ts_tablet_manager.cc:1403] T 4c0a326f96264ea2a0b072d641844bbd P 7acd14314e364b148849b983ef5ae307: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20251214 21:04:54.801936 18757 raft_consensus.cc:359] T 4c0a326f96264ea2a0b072d641844bbd P 7acd14314e364b148849b983ef5ae307 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.802129 18757 raft_consensus.cc:385] T 4c0a326f96264ea2a0b072d641844bbd P 7acd14314e364b148849b983ef5ae307 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:54.802184 18757 raft_consensus.cc:740] T 4c0a326f96264ea2a0b072d641844bbd P 7acd14314e364b148849b983ef5ae307 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7acd14314e364b148849b983ef5ae307, State: Initialized, Role: FOLLOWER
I20251214 21:04:54.802577 18757 consensus_queue.cc:260] T 4c0a326f96264ea2a0b072d641844bbd P 7acd14314e364b148849b983ef5ae307 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.803211 18475 heartbeater.cc:499] Master 127.16.120.62:41291 was elected leader, sending a full tablet report...
I20251214 21:04:54.804060 18757 ts_tablet_manager.cc:1434] T 4c0a326f96264ea2a0b072d641844bbd P 7acd14314e364b148849b983ef5ae307: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
W20251214 21:04:54.809612 18608 tablet.cc:2378] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:04:54.842368 18762 raft_consensus.cc:493] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:54.842586 18762 raft_consensus.cc:515] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.843719 18762 leader_election.cc:290] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7acd14314e364b148849b983ef5ae307 (127.16.120.1:42627), a8eeeef062934223ba9fb0e3746a70eb (127.16.120.3:33769)
I20251214 21:04:54.847479 18429 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c0a326f96264ea2a0b072d641844bbd" candidate_uuid: "fc6098ce4fc24c37b94359549ca01e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7acd14314e364b148849b983ef5ae307" is_pre_election: true
I20251214 21:04:54.847486 18692 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c0a326f96264ea2a0b072d641844bbd" candidate_uuid: "fc6098ce4fc24c37b94359549ca01e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8eeeef062934223ba9fb0e3746a70eb" is_pre_election: true
I20251214 21:04:54.847745 18692 raft_consensus.cc:2468] T 4c0a326f96264ea2a0b072d641844bbd P a8eeeef062934223ba9fb0e3746a70eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6098ce4fc24c37b94359549ca01e61 in term 0.
I20251214 21:04:54.847748 18429 raft_consensus.cc:2468] T 4c0a326f96264ea2a0b072d641844bbd P 7acd14314e364b148849b983ef5ae307 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc6098ce4fc24c37b94359549ca01e61 in term 0.
I20251214 21:04:54.848166 18494 leader_election.cc:304] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8eeeef062934223ba9fb0e3746a70eb, fc6098ce4fc24c37b94359549ca01e61; no voters:
I20251214 21:04:54.848394 18762 raft_consensus.cc:2804] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:54.848479 18762 raft_consensus.cc:493] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:54.848520 18762 raft_consensus.cc:3060] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:54.849365 18762 raft_consensus.cc:515] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.849700 18762 leader_election.cc:290] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [CANDIDATE]: Term 1 election: Requested vote from peers 7acd14314e364b148849b983ef5ae307 (127.16.120.1:42627), a8eeeef062934223ba9fb0e3746a70eb (127.16.120.3:33769)
I20251214 21:04:54.850066 18692 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c0a326f96264ea2a0b072d641844bbd" candidate_uuid: "fc6098ce4fc24c37b94359549ca01e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8eeeef062934223ba9fb0e3746a70eb"
I20251214 21:04:54.850088 18429 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c0a326f96264ea2a0b072d641844bbd" candidate_uuid: "fc6098ce4fc24c37b94359549ca01e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7acd14314e364b148849b983ef5ae307"
I20251214 21:04:54.850176 18692 raft_consensus.cc:3060] T 4c0a326f96264ea2a0b072d641844bbd P a8eeeef062934223ba9fb0e3746a70eb [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:54.850199 18429 raft_consensus.cc:3060] T 4c0a326f96264ea2a0b072d641844bbd P 7acd14314e364b148849b983ef5ae307 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:54.851362 18429 raft_consensus.cc:2468] T 4c0a326f96264ea2a0b072d641844bbd P 7acd14314e364b148849b983ef5ae307 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6098ce4fc24c37b94359549ca01e61 in term 1.
I20251214 21:04:54.851378 18692 raft_consensus.cc:2468] T 4c0a326f96264ea2a0b072d641844bbd P a8eeeef062934223ba9fb0e3746a70eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc6098ce4fc24c37b94359549ca01e61 in term 1.
I20251214 21:04:54.851668 18496 leader_election.cc:304] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7acd14314e364b148849b983ef5ae307, fc6098ce4fc24c37b94359549ca01e61; no voters:
I20251214 21:04:54.851832 18762 raft_consensus.cc:2804] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:54.852082 18762 raft_consensus.cc:697] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [term 1 LEADER]: Becoming Leader. State: Replica: fc6098ce4fc24c37b94359549ca01e61, State: Running, Role: LEADER
I20251214 21:04:54.852425 18762 consensus_queue.cc:237] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.855638 18286 catalog_manager.cc:5654] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc6098ce4fc24c37b94359549ca01e61 (127.16.120.2). New cstate: current_term: 1 leader_uuid: "fc6098ce4fc24c37b94359549ca01e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:54.875329 16864 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251214 21:04:54.876655 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 7acd14314e364b148849b983ef5ae307 to finish bootstrapping
I20251214 21:04:54.881878 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver fc6098ce4fc24c37b94359549ca01e61 to finish bootstrapping
I20251214 21:04:54.886773 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver a8eeeef062934223ba9fb0e3746a70eb to finish bootstrapping
I20251214 21:04:54.892773 18286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39360:
name: "TestAnotherTable"
schema {
columns {
name: "foo"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "bar"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
comment: "comment for bar"
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "foo"
}
}
}
W20251214 21:04:54.893236 18286 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestAnotherTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251214 21:04:54.896966 18476 tablet.cc:2378] T 4c0a326f96264ea2a0b072d641844bbd P 7acd14314e364b148849b983ef5ae307: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:04:54.898331 18409 tablet_service.cc:1505] Processing CreateTablet for tablet ffff68cb1ab54ad889bec09db7acca2b (DEFAULT_TABLE table=TestAnotherTable [id=9b6346c9047b4e7985172b48b598f2a3]), partition=RANGE (foo) PARTITION UNBOUNDED
I20251214 21:04:54.898415 18540 tablet_service.cc:1505] Processing CreateTablet for tablet ffff68cb1ab54ad889bec09db7acca2b (DEFAULT_TABLE table=TestAnotherTable [id=9b6346c9047b4e7985172b48b598f2a3]), partition=RANGE (foo) PARTITION UNBOUNDED
I20251214 21:04:54.898623 18409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffff68cb1ab54ad889bec09db7acca2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:54.898624 18672 tablet_service.cc:1505] Processing CreateTablet for tablet ffff68cb1ab54ad889bec09db7acca2b (DEFAULT_TABLE table=TestAnotherTable [id=9b6346c9047b4e7985172b48b598f2a3]), partition=RANGE (foo) PARTITION UNBOUNDED
I20251214 21:04:54.898702 18540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffff68cb1ab54ad889bec09db7acca2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:54.898878 18672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffff68cb1ab54ad889bec09db7acca2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:54.900262 18757 tablet_bootstrap.cc:492] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307: Bootstrap starting.
I20251214 21:04:54.900739 18756 tablet_bootstrap.cc:492] T ffff68cb1ab54ad889bec09db7acca2b P fc6098ce4fc24c37b94359549ca01e61: Bootstrap starting.
I20251214 21:04:54.901257 18757 tablet_bootstrap.cc:654] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:54.901684 18756 tablet_bootstrap.cc:654] T ffff68cb1ab54ad889bec09db7acca2b P fc6098ce4fc24c37b94359549ca01e61: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:54.901973 18755 tablet_bootstrap.cc:492] T ffff68cb1ab54ad889bec09db7acca2b P a8eeeef062934223ba9fb0e3746a70eb: Bootstrap starting.
I20251214 21:04:54.902487 18757 tablet_bootstrap.cc:492] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307: No bootstrap required, opened a new log
I20251214 21:04:54.902545 18757 ts_tablet_manager.cc:1403] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:54.902730 18755 tablet_bootstrap.cc:654] T ffff68cb1ab54ad889bec09db7acca2b P a8eeeef062934223ba9fb0e3746a70eb: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:54.902981 18757 raft_consensus.cc:359] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.903082 18757 raft_consensus.cc:385] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:54.903115 18757 raft_consensus.cc:740] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7acd14314e364b148849b983ef5ae307, State: Initialized, Role: FOLLOWER
I20251214 21:04:54.903242 18757 consensus_queue.cc:260] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.903510 18757 ts_tablet_manager.cc:1434] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:54.903872 18755 tablet_bootstrap.cc:492] T ffff68cb1ab54ad889bec09db7acca2b P a8eeeef062934223ba9fb0e3746a70eb: No bootstrap required, opened a new log
I20251214 21:04:54.903944 18755 ts_tablet_manager.cc:1403] T ffff68cb1ab54ad889bec09db7acca2b P a8eeeef062934223ba9fb0e3746a70eb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:54.904183 18756 tablet_bootstrap.cc:492] T ffff68cb1ab54ad889bec09db7acca2b P fc6098ce4fc24c37b94359549ca01e61: No bootstrap required, opened a new log
I20251214 21:04:54.904255 18756 ts_tablet_manager.cc:1403] T ffff68cb1ab54ad889bec09db7acca2b P fc6098ce4fc24c37b94359549ca01e61: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20251214 21:04:54.904539 18755 raft_consensus.cc:359] T ffff68cb1ab54ad889bec09db7acca2b P a8eeeef062934223ba9fb0e3746a70eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.904632 18755 raft_consensus.cc:385] T ffff68cb1ab54ad889bec09db7acca2b P a8eeeef062934223ba9fb0e3746a70eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:54.904660 18755 raft_consensus.cc:740] T ffff68cb1ab54ad889bec09db7acca2b P a8eeeef062934223ba9fb0e3746a70eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8eeeef062934223ba9fb0e3746a70eb, State: Initialized, Role: FOLLOWER
I20251214 21:04:54.904784 18755 consensus_queue.cc:260] T ffff68cb1ab54ad889bec09db7acca2b P a8eeeef062934223ba9fb0e3746a70eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.904778 18756 raft_consensus.cc:359] T ffff68cb1ab54ad889bec09db7acca2b P fc6098ce4fc24c37b94359549ca01e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.904874 18756 raft_consensus.cc:385] T ffff68cb1ab54ad889bec09db7acca2b P fc6098ce4fc24c37b94359549ca01e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:54.904904 18756 raft_consensus.cc:740] T ffff68cb1ab54ad889bec09db7acca2b P fc6098ce4fc24c37b94359549ca01e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6098ce4fc24c37b94359549ca01e61, State: Initialized, Role: FOLLOWER
I20251214 21:04:54.905030 18755 ts_tablet_manager.cc:1434] T ffff68cb1ab54ad889bec09db7acca2b P a8eeeef062934223ba9fb0e3746a70eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:54.905016 18756 consensus_queue.cc:260] T ffff68cb1ab54ad889bec09db7acca2b P fc6098ce4fc24c37b94359549ca01e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.905277 18756 ts_tablet_manager.cc:1434] T ffff68cb1ab54ad889bec09db7acca2b P fc6098ce4fc24c37b94359549ca01e61: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:54.908823 18763 raft_consensus.cc:493] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:54.908907 18763 raft_consensus.cc:515] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.910030 18763 leader_election.cc:290] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6098ce4fc24c37b94359549ca01e61 (127.16.120.2:41915), a8eeeef062934223ba9fb0e3746a70eb (127.16.120.3:33769)
I20251214 21:04:54.913672 18692 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ffff68cb1ab54ad889bec09db7acca2b" candidate_uuid: "7acd14314e364b148849b983ef5ae307" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8eeeef062934223ba9fb0e3746a70eb" is_pre_election: true
I20251214 21:04:54.913983 18692 raft_consensus.cc:2468] T ffff68cb1ab54ad889bec09db7acca2b P a8eeeef062934223ba9fb0e3746a70eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7acd14314e364b148849b983ef5ae307 in term 0.
I20251214 21:04:54.914405 18363 leader_election.cc:304] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7acd14314e364b148849b983ef5ae307, a8eeeef062934223ba9fb0e3746a70eb; no voters:
I20251214 21:04:54.914470 18560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ffff68cb1ab54ad889bec09db7acca2b" candidate_uuid: "7acd14314e364b148849b983ef5ae307" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6098ce4fc24c37b94359549ca01e61" is_pre_election: true
I20251214 21:04:54.914672 18763 raft_consensus.cc:2804] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:54.914678 18560 raft_consensus.cc:2468] T ffff68cb1ab54ad889bec09db7acca2b P fc6098ce4fc24c37b94359549ca01e61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7acd14314e364b148849b983ef5ae307 in term 0.
I20251214 21:04:54.914734 18763 raft_consensus.cc:493] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:54.914770 18763 raft_consensus.cc:3060] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:54.915575 18763 raft_consensus.cc:515] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.915934 18763 leader_election.cc:290] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [CANDIDATE]: Term 1 election: Requested vote from peers fc6098ce4fc24c37b94359549ca01e61 (127.16.120.2:41915), a8eeeef062934223ba9fb0e3746a70eb (127.16.120.3:33769)
I20251214 21:04:54.916270 18560 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ffff68cb1ab54ad889bec09db7acca2b" candidate_uuid: "7acd14314e364b148849b983ef5ae307" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6098ce4fc24c37b94359549ca01e61"
I20251214 21:04:54.916384 18560 raft_consensus.cc:3060] T ffff68cb1ab54ad889bec09db7acca2b P fc6098ce4fc24c37b94359549ca01e61 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:54.916316 18692 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ffff68cb1ab54ad889bec09db7acca2b" candidate_uuid: "7acd14314e364b148849b983ef5ae307" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8eeeef062934223ba9fb0e3746a70eb"
I20251214 21:04:54.916467 18692 raft_consensus.cc:3060] T ffff68cb1ab54ad889bec09db7acca2b P a8eeeef062934223ba9fb0e3746a70eb [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:54.917229 18692 raft_consensus.cc:2468] T ffff68cb1ab54ad889bec09db7acca2b P a8eeeef062934223ba9fb0e3746a70eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7acd14314e364b148849b983ef5ae307 in term 1.
I20251214 21:04:54.917281 18560 raft_consensus.cc:2468] T ffff68cb1ab54ad889bec09db7acca2b P fc6098ce4fc24c37b94359549ca01e61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7acd14314e364b148849b983ef5ae307 in term 1.
I20251214 21:04:54.917568 18363 leader_election.cc:304] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7acd14314e364b148849b983ef5ae307, a8eeeef062934223ba9fb0e3746a70eb; no voters:
I20251214 21:04:54.917785 18763 raft_consensus.cc:2804] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:54.918031 18763 raft_consensus.cc:697] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [term 1 LEADER]: Becoming Leader. State: Replica: 7acd14314e364b148849b983ef5ae307, State: Running, Role: LEADER
I20251214 21:04:54.918350 18763 consensus_queue.cc:237] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } } peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } }
I20251214 21:04:54.921197 18285 catalog_manager.cc:5654] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7acd14314e364b148849b983ef5ae307 (127.16.120.1). New cstate: current_term: 1 leader_uuid: "7acd14314e364b148849b983ef5ae307" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 } health_report { overall_health: UNKNOWN } } }
W20251214 21:04:54.995857 18739 tablet.cc:2378] T 4c0a326f96264ea2a0b072d641844bbd P a8eeeef062934223ba9fb0e3746a70eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251214 21:04:55.028860 18775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:55.029124 18775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:55.032388 18775 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
W20251214 21:04:55.222410 18785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:55.222638 18785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:55.225863 18785 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20251214 21:04:55.257126 18762 consensus_queue.cc:1048] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7acd14314e364b148849b983ef5ae307" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:55.261440 18762 consensus_queue.cc:1048] T 4c0a326f96264ea2a0b072d641844bbd P fc6098ce4fc24c37b94359549ca01e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:55.306236 18763 consensus_queue.cc:1048] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6098ce4fc24c37b94359549ca01e61" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:04:55.310472 18773 consensus_queue.cc:1048] T ffff68cb1ab54ad889bec09db7acca2b P 7acd14314e364b148849b983ef5ae307 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8eeeef062934223ba9fb0e3746a70eb" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 33769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251214 21:04:55.415563 18802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:55.415786 18802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:55.419091 18802 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
W20251214 21:04:55.554526 18813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:55.554750 18813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:55.558025 18813 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20251214 21:04:55.642062 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 18347
I20251214 21:04:55.649974 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 18478
I20251214 21:04:55.657130 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 18610
I20251214 21:04:55.663949 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 18256
2025-12-14T21:04:55Z chronyd exiting
[ OK ] AdminCliTest.TestDescribeTableColumnFlags (1697 ms)
[ RUN ] AdminCliTest.TestAuthzResetCacheNotAuthorized
I20251214 21:04:55.685535 16864 test_util.cc:276] Using random seed: -659045992
I20251214 21:04:55.686475 16864 ts_itest-base.cc:115] Starting cluster with:
I20251214 21:04:55.686519 16864 ts_itest-base.cc:116] --------------
I20251214 21:04:55.686537 16864 ts_itest-base.cc:117] 3 tablet servers
I20251214 21:04:55.686554 16864 ts_itest-base.cc:118] 3 replicas per TS
I20251214 21:04:55.686578 16864 ts_itest-base.cc:119] --------------
2025-12-14T21:04:55Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-14T21:04:55Z Disabled control of system clock
I20251214 21:04:55.694675 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:35661
--webserver_interface=127.16.120.62
--webserver_port=0
--builtin_ntp_servers=127.16.120.20:37589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.120.62:35661
--superuser_acl=no-such-user with env {}
W20251214 21:04:55.796929 18830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:55.797173 18830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:55.797235 18830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:55.800587 18830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251214 21:04:55.800652 18830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:55.800680 18830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251214 21:04:55.800704 18830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251214 21:04:55.804797 18830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:37589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.120.62:35661
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:35661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.16.120.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.18830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:55.805943 18830 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:55.807061 18830 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:55.812599 18835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:55.812772 18830 server_base.cc:1047] running on GCE node
W20251214 21:04:55.812574 18838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:55.812568 18836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:55.813318 18830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:55.814230 18830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:55.815366 18830 hybrid_clock.cc:648] HybridClock initialized: now 1765746295815346 us; error 38 us; skew 500 ppm
I20251214 21:04:55.817018 18830 webserver.cc:492] Webserver started at http://127.16.120.62:46057/ using document root <none> and password file <none>
I20251214 21:04:55.817553 18830 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:55.817611 18830 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:55.817795 18830 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:55.819294 18830 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "b7d6e9bf3015406f862feae2c95b8ccb"
format_stamp: "Formatted at 2025-12-14 21:04:55 on dist-test-slave-8rzr"
I20251214 21:04:55.819713 18830 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "b7d6e9bf3015406f862feae2c95b8ccb"
format_stamp: "Formatted at 2025-12-14 21:04:55 on dist-test-slave-8rzr"
I20251214 21:04:55.822836 18830 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251214 21:04:55.824918 18844 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:55.826020 18830 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251214 21:04:55.826125 18830 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
uuid: "b7d6e9bf3015406f862feae2c95b8ccb"
format_stamp: "Formatted at 2025-12-14 21:04:55 on dist-test-slave-8rzr"
I20251214 21:04:55.826207 18830 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:55.846045 18830 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:55.846742 18830 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:55.846909 18830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:55.854050 18830 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.62:35661
I20251214 21:04:55.854048 18896 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.62:35661 every 8 connection(s)
I20251214 21:04:55.855026 18830 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251214 21:04:55.857791 18897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:55.859691 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 18830
I20251214 21:04:55.859810 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251214 21:04:55.863220 18897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb: Bootstrap starting.
I20251214 21:04:55.865247 18897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:55.866022 18897 log.cc:826] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:55.867857 18897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb: No bootstrap required, opened a new log
I20251214 21:04:55.870296 18897 raft_consensus.cc:359] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d6e9bf3015406f862feae2c95b8ccb" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 35661 } }
I20251214 21:04:55.870473 18897 raft_consensus.cc:385] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:55.870530 18897 raft_consensus.cc:740] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7d6e9bf3015406f862feae2c95b8ccb, State: Initialized, Role: FOLLOWER
I20251214 21:04:55.870908 18897 consensus_queue.cc:260] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d6e9bf3015406f862feae2c95b8ccb" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 35661 } }
I20251214 21:04:55.871034 18897 raft_consensus.cc:399] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:55.871093 18897 raft_consensus.cc:493] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:55.871184 18897 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:55.871910 18897 raft_consensus.cc:515] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d6e9bf3015406f862feae2c95b8ccb" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 35661 } }
I20251214 21:04:55.872225 18897 leader_election.cc:304] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7d6e9bf3015406f862feae2c95b8ccb; no voters:
I20251214 21:04:55.872474 18897 leader_election.cc:290] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:04:55.872581 18902 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:55.872771 18902 raft_consensus.cc:697] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [term 1 LEADER]: Becoming Leader. State: Replica: b7d6e9bf3015406f862feae2c95b8ccb, State: Running, Role: LEADER
I20251214 21:04:55.873088 18902 consensus_queue.cc:237] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d6e9bf3015406f862feae2c95b8ccb" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 35661 } }
I20251214 21:04:55.873500 18897 sys_catalog.cc:565] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:04:55.874529 18903 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b7d6e9bf3015406f862feae2c95b8ccb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d6e9bf3015406f862feae2c95b8ccb" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 35661 } } }
I20251214 21:04:55.874647 18903 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:55.875244 18911 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:04:55.874970 18904 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7d6e9bf3015406f862feae2c95b8ccb. Latest consensus state: current_term: 1 leader_uuid: "b7d6e9bf3015406f862feae2c95b8ccb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d6e9bf3015406f862feae2c95b8ccb" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 35661 } } }
I20251214 21:04:55.875594 18904 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:55.878388 18911 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:04:55.883930 18911 catalog_manager.cc:1357] Generated new cluster ID: 525cf59c1e14431aa9dbc7208d6f4c02
I20251214 21:04:55.884006 18911 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:04:55.903972 18911 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:04:55.904855 18911 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:04:55.914207 18911 catalog_manager.cc:6027] T 00000000000000000000000000000000 P b7d6e9bf3015406f862feae2c95b8ccb: Generated new TSK 0
I20251214 21:04:55.914894 18911 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:04:55.926520 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.1:0
--local_ip_for_outbound_sockets=127.16.120.1
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:35661
--builtin_ntp_servers=127.16.120.20:37589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251214 21:04:56.028853 18921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:56.029062 18921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:56.029121 18921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:56.032409 18921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:56.032531 18921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.1
I20251214 21:04:56.036230 18921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:37589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:35661
--never_fsync=true
--heap_profile_path=/tmp/kudu.18921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.1
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:56.037204 18921 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:56.038319 18921 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:56.044664 18929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:56.044661 18926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:56.044683 18927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:56.045146 18921 server_base.cc:1047] running on GCE node
I20251214 21:04:56.045542 18921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:56.046216 18921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:56.047397 18921 hybrid_clock.cc:648] HybridClock initialized: now 1765746296047374 us; error 32 us; skew 500 ppm
I20251214 21:04:56.049454 18921 webserver.cc:492] Webserver started at http://127.16.120.1:43327/ using document root <none> and password file <none>
I20251214 21:04:56.050011 18921 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:56.050067 18921 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:56.050232 18921 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:56.051713 18921 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "7e7321a4744b489e87561404c1a7980a"
format_stamp: "Formatted at 2025-12-14 21:04:56 on dist-test-slave-8rzr"
I20251214 21:04:56.052145 18921 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "7e7321a4744b489e87561404c1a7980a"
format_stamp: "Formatted at 2025-12-14 21:04:56 on dist-test-slave-8rzr"
I20251214 21:04:56.055354 18921 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20251214 21:04:56.057510 18935 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:56.058494 18921 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251214 21:04:56.058590 18921 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "7e7321a4744b489e87561404c1a7980a"
format_stamp: "Formatted at 2025-12-14 21:04:56 on dist-test-slave-8rzr"
I20251214 21:04:56.058682 18921 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:56.071405 18921 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:56.072117 18921 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:56.072283 18921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:56.072855 18921 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:56.073773 18921 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:56.073819 18921 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:56.073904 18921 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:56.073936 18921 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:56.082221 18921 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.1:39799
I20251214 21:04:56.082270 19048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.1:39799 every 8 connection(s)
I20251214 21:04:56.083094 18921 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251214 21:04:56.091702 19049 heartbeater.cc:344] Connected to a master server at 127.16.120.62:35661
I20251214 21:04:56.091892 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 18921
I20251214 21:04:56.091945 19049 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:56.091995 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251214 21:04:56.092556 19049 heartbeater.cc:507] Master 127.16.120.62:35661 requested a full tablet report, sending...
I20251214 21:04:56.094025 18861 ts_manager.cc:194] Registered new tserver with Master: 7e7321a4744b489e87561404c1a7980a (127.16.120.1:39799)
I20251214 21:04:56.094121 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.2:0
--local_ip_for_outbound_sockets=127.16.120.2
--webserver_interface=127.16.120.2
--webserver_port=0
--tserver_master_addrs=127.16.120.62:35661
--builtin_ntp_servers=127.16.120.20:37589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251214 21:04:56.095530 18861 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.1:46109
W20251214 21:04:56.198197 19052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:56.198426 19052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:56.198493 19052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:56.201709 19052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:56.201822 19052 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.2
I20251214 21:04:56.205507 19052 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:37589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.16.120.2
--webserver_port=0
--tserver_master_addrs=127.16.120.62:35661
--never_fsync=true
--heap_profile_path=/tmp/kudu.19052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.2
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:56.206543 19052 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:56.207617 19052 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:56.213778 19058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:56.213797 19057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:56.213987 19052 server_base.cc:1047] running on GCE node
W20251214 21:04:56.213798 19060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:56.214340 19052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:56.214869 19052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:56.216001 19052 hybrid_clock.cc:648] HybridClock initialized: now 1765746296215987 us; error 34 us; skew 500 ppm
I20251214 21:04:56.217639 19052 webserver.cc:492] Webserver started at http://127.16.120.2:33857/ using document root <none> and password file <none>
I20251214 21:04:56.218204 19052 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:56.218263 19052 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:56.218441 19052 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:56.219906 19052 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "effe8b25bb544247baac6b8ba206cde4"
format_stamp: "Formatted at 2025-12-14 21:04:56 on dist-test-slave-8rzr"
I20251214 21:04:56.220350 19052 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "effe8b25bb544247baac6b8ba206cde4"
format_stamp: "Formatted at 2025-12-14 21:04:56 on dist-test-slave-8rzr"
I20251214 21:04:56.223506 19052 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20251214 21:04:56.225524 19066 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:56.226490 19052 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:56.226588 19052 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "effe8b25bb544247baac6b8ba206cde4"
format_stamp: "Formatted at 2025-12-14 21:04:56 on dist-test-slave-8rzr"
I20251214 21:04:56.226661 19052 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:56.241410 19052 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:56.242107 19052 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:56.242281 19052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:56.242826 19052 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:56.243788 19052 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:56.243834 19052 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:56.243885 19052 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:56.243911 19052 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:56.252588 19052 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.2:42953
I20251214 21:04:56.252622 19179 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.2:42953 every 8 connection(s)
I20251214 21:04:56.253463 19052 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251214 21:04:56.259801 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 19052
I20251214 21:04:56.259932 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251214 21:04:56.261940 19180 heartbeater.cc:344] Connected to a master server at 127.16.120.62:35661
I20251214 21:04:56.262148 19180 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:56.262200 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.3:0
--local_ip_for_outbound_sockets=127.16.120.3
--webserver_interface=127.16.120.3
--webserver_port=0
--tserver_master_addrs=127.16.120.62:35661
--builtin_ntp_servers=127.16.120.20:37589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251214 21:04:56.262733 19180 heartbeater.cc:507] Master 127.16.120.62:35661 requested a full tablet report, sending...
I20251214 21:04:56.263687 18861 ts_manager.cc:194] Registered new tserver with Master: effe8b25bb544247baac6b8ba206cde4 (127.16.120.2:42953)
I20251214 21:04:56.264204 18861 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.2:44507
W20251214 21:04:56.364472 19183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:56.364692 19183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:56.364743 19183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:56.368112 19183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:56.368217 19183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.3
I20251214 21:04:56.371922 19183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:37589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.16.120.3
--webserver_port=0
--tserver_master_addrs=127.16.120.62:35661
--never_fsync=true
--heap_profile_path=/tmp/kudu.19183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.3
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:56.372964 19183 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:56.374091 19183 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:56.380404 19188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:56.380420 19189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:56.380522 19191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:56.380712 19183 server_base.cc:1047] running on GCE node
I20251214 21:04:56.381027 19183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:56.381536 19183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:56.382678 19183 hybrid_clock.cc:648] HybridClock initialized: now 1765746296382662 us; error 30 us; skew 500 ppm
I20251214 21:04:56.384289 19183 webserver.cc:492] Webserver started at http://127.16.120.3:40657/ using document root <none> and password file <none>
I20251214 21:04:56.384817 19183 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:56.384876 19183 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:56.385042 19183 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:56.386569 19183 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "08f2b55a6a0748e49cd4e650c54c19f7"
format_stamp: "Formatted at 2025-12-14 21:04:56 on dist-test-slave-8rzr"
I20251214 21:04:56.386994 19183 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "08f2b55a6a0748e49cd4e650c54c19f7"
format_stamp: "Formatted at 2025-12-14 21:04:56 on dist-test-slave-8rzr"
I20251214 21:04:56.390120 19183 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251214 21:04:56.392122 19197 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:56.393045 19183 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:56.393143 19183 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "08f2b55a6a0748e49cd4e650c54c19f7"
format_stamp: "Formatted at 2025-12-14 21:04:56 on dist-test-slave-8rzr"
I20251214 21:04:56.393220 19183 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:56.408857 19183 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:56.409524 19183 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:56.409690 19183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:56.410267 19183 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:56.411226 19183 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:56.411274 19183 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:56.411324 19183 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:56.411355 19183 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:56.420811 19183 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.3:34743
I20251214 21:04:56.420846 19313 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.3:34743 every 8 connection(s)
I20251214 21:04:56.421712 19183 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251214 21:04:56.427719 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 19183
I20251214 21:04:56.427830 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251214 21:04:56.430402 19314 heartbeater.cc:344] Connected to a master server at 127.16.120.62:35661
I20251214 21:04:56.430621 19314 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:56.431133 19314 heartbeater.cc:507] Master 127.16.120.62:35661 requested a full tablet report, sending...
I20251214 21:04:56.432034 18860 ts_manager.cc:194] Registered new tserver with Master: 08f2b55a6a0748e49cd4e650c54c19f7 (127.16.120.3:34743)
I20251214 21:04:56.432590 18860 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.3:48829
I20251214 21:04:56.441941 16864 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251214 21:04:56.450325 18860 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60696:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20251214 21:04:56.452625 18860 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:04:56.468310 19247 tablet_service.cc:1505] Processing CreateTablet for tablet bfaf812cc93f45df920c99e746481e57 (DEFAULT_TABLE table=TestTable [id=c32d6854854d42459b7fbaf7f56a3e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:56.468340 18983 tablet_service.cc:1505] Processing CreateTablet for tablet bfaf812cc93f45df920c99e746481e57 (DEFAULT_TABLE table=TestTable [id=c32d6854854d42459b7fbaf7f56a3e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:56.468340 19114 tablet_service.cc:1505] Processing CreateTablet for tablet bfaf812cc93f45df920c99e746481e57 (DEFAULT_TABLE table=TestTable [id=c32d6854854d42459b7fbaf7f56a3e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:56.469184 19247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfaf812cc93f45df920c99e746481e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:56.469195 19114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfaf812cc93f45df920c99e746481e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:56.469195 18983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfaf812cc93f45df920c99e746481e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:56.474278 19331 tablet_bootstrap.cc:492] T bfaf812cc93f45df920c99e746481e57 P 08f2b55a6a0748e49cd4e650c54c19f7: Bootstrap starting.
I20251214 21:04:56.475293 19332 tablet_bootstrap.cc:492] T bfaf812cc93f45df920c99e746481e57 P effe8b25bb544247baac6b8ba206cde4: Bootstrap starting.
I20251214 21:04:56.475682 19333 tablet_bootstrap.cc:492] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a: Bootstrap starting.
I20251214 21:04:56.476438 19331 tablet_bootstrap.cc:654] T bfaf812cc93f45df920c99e746481e57 P 08f2b55a6a0748e49cd4e650c54c19f7: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:56.477097 19331 log.cc:826] T bfaf812cc93f45df920c99e746481e57 P 08f2b55a6a0748e49cd4e650c54c19f7: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:56.477403 19333 tablet_bootstrap.cc:654] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:56.478134 19333 log.cc:826] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:56.478804 19331 tablet_bootstrap.cc:492] T bfaf812cc93f45df920c99e746481e57 P 08f2b55a6a0748e49cd4e650c54c19f7: No bootstrap required, opened a new log
I20251214 21:04:56.478992 19331 ts_tablet_manager.cc:1403] T bfaf812cc93f45df920c99e746481e57 P 08f2b55a6a0748e49cd4e650c54c19f7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20251214 21:04:56.479236 19332 tablet_bootstrap.cc:654] T bfaf812cc93f45df920c99e746481e57 P effe8b25bb544247baac6b8ba206cde4: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:56.479763 19333 tablet_bootstrap.cc:492] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a: No bootstrap required, opened a new log
I20251214 21:04:56.479846 19332 log.cc:826] T bfaf812cc93f45df920c99e746481e57 P effe8b25bb544247baac6b8ba206cde4: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:56.479936 19333 ts_tablet_manager.cc:1403] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20251214 21:04:56.481249 19332 tablet_bootstrap.cc:492] T bfaf812cc93f45df920c99e746481e57 P effe8b25bb544247baac6b8ba206cde4: No bootstrap required, opened a new log
I20251214 21:04:56.481480 19332 ts_tablet_manager.cc:1403] T bfaf812cc93f45df920c99e746481e57 P effe8b25bb544247baac6b8ba206cde4: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20251214 21:04:56.482041 19331 raft_consensus.cc:359] T bfaf812cc93f45df920c99e746481e57 P 08f2b55a6a0748e49cd4e650c54c19f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f2b55a6a0748e49cd4e650c54c19f7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 34743 } } peers { permanent_uuid: "effe8b25bb544247baac6b8ba206cde4" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 42953 } } peers { permanent_uuid: "7e7321a4744b489e87561404c1a7980a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39799 } }
I20251214 21:04:56.482285 19331 raft_consensus.cc:385] T bfaf812cc93f45df920c99e746481e57 P 08f2b55a6a0748e49cd4e650c54c19f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:56.482375 19331 raft_consensus.cc:740] T bfaf812cc93f45df920c99e746481e57 P 08f2b55a6a0748e49cd4e650c54c19f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08f2b55a6a0748e49cd4e650c54c19f7, State: Initialized, Role: FOLLOWER
I20251214 21:04:56.482838 19331 consensus_queue.cc:260] T bfaf812cc93f45df920c99e746481e57 P 08f2b55a6a0748e49cd4e650c54c19f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f2b55a6a0748e49cd4e650c54c19f7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 34743 } } peers { permanent_uuid: "effe8b25bb544247baac6b8ba206cde4" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 42953 } } peers { permanent_uuid: "7e7321a4744b489e87561404c1a7980a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39799 } }
I20251214 21:04:56.482803 19333 raft_consensus.cc:359] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f2b55a6a0748e49cd4e650c54c19f7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 34743 } } peers { permanent_uuid: "effe8b25bb544247baac6b8ba206cde4" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 42953 } } peers { permanent_uuid: "7e7321a4744b489e87561404c1a7980a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39799 } }
I20251214 21:04:56.482976 19333 raft_consensus.cc:385] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:56.483045 19333 raft_consensus.cc:740] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e7321a4744b489e87561404c1a7980a, State: Initialized, Role: FOLLOWER
I20251214 21:04:56.483503 19333 consensus_queue.cc:260] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f2b55a6a0748e49cd4e650c54c19f7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 34743 } } peers { permanent_uuid: "effe8b25bb544247baac6b8ba206cde4" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 42953 } } peers { permanent_uuid: "7e7321a4744b489e87561404c1a7980a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39799 } }
I20251214 21:04:56.483723 19331 ts_tablet_manager.cc:1434] T bfaf812cc93f45df920c99e746481e57 P 08f2b55a6a0748e49cd4e650c54c19f7: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20251214 21:04:56.484068 19314 heartbeater.cc:499] Master 127.16.120.62:35661 was elected leader, sending a full tablet report...
I20251214 21:04:56.484202 19049 heartbeater.cc:499] Master 127.16.120.62:35661 was elected leader, sending a full tablet report...
I20251214 21:04:56.484301 19333 ts_tablet_manager.cc:1434] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20251214 21:04:56.483975 19332 raft_consensus.cc:359] T bfaf812cc93f45df920c99e746481e57 P effe8b25bb544247baac6b8ba206cde4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f2b55a6a0748e49cd4e650c54c19f7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 34743 } } peers { permanent_uuid: "effe8b25bb544247baac6b8ba206cde4" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 42953 } } peers { permanent_uuid: "7e7321a4744b489e87561404c1a7980a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39799 } }
I20251214 21:04:56.485080 19332 raft_consensus.cc:385] T bfaf812cc93f45df920c99e746481e57 P effe8b25bb544247baac6b8ba206cde4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:56.485152 19332 raft_consensus.cc:740] T bfaf812cc93f45df920c99e746481e57 P effe8b25bb544247baac6b8ba206cde4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: effe8b25bb544247baac6b8ba206cde4, State: Initialized, Role: FOLLOWER
I20251214 21:04:56.486729 19332 consensus_queue.cc:260] T bfaf812cc93f45df920c99e746481e57 P effe8b25bb544247baac6b8ba206cde4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f2b55a6a0748e49cd4e650c54c19f7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 34743 } } peers { permanent_uuid: "effe8b25bb544247baac6b8ba206cde4" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 42953 } } peers { permanent_uuid: "7e7321a4744b489e87561404c1a7980a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39799 } }
I20251214 21:04:56.487447 19332 ts_tablet_manager.cc:1434] T bfaf812cc93f45df920c99e746481e57 P effe8b25bb544247baac6b8ba206cde4: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20251214 21:04:56.487751 19180 heartbeater.cc:499] Master 127.16.120.62:35661 was elected leader, sending a full tablet report...
W20251214 21:04:56.504277 19181 tablet.cc:2378] T bfaf812cc93f45df920c99e746481e57 P effe8b25bb544247baac6b8ba206cde4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251214 21:04:56.584228 19050 tablet.cc:2378] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:04:56.607882 19338 raft_consensus.cc:493] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:56.608062 19338 raft_consensus.cc:515] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f2b55a6a0748e49cd4e650c54c19f7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 34743 } } peers { permanent_uuid: "effe8b25bb544247baac6b8ba206cde4" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 42953 } } peers { permanent_uuid: "7e7321a4744b489e87561404c1a7980a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39799 } }
I20251214 21:04:56.609293 19338 leader_election.cc:290] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08f2b55a6a0748e49cd4e650c54c19f7 (127.16.120.3:34743), effe8b25bb544247baac6b8ba206cde4 (127.16.120.2:42953)
I20251214 21:04:56.612939 19267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfaf812cc93f45df920c99e746481e57" candidate_uuid: "7e7321a4744b489e87561404c1a7980a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08f2b55a6a0748e49cd4e650c54c19f7" is_pre_election: true
I20251214 21:04:56.613233 19267 raft_consensus.cc:2468] T bfaf812cc93f45df920c99e746481e57 P 08f2b55a6a0748e49cd4e650c54c19f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e7321a4744b489e87561404c1a7980a in term 0.
I20251214 21:04:56.613663 18937 leader_election.cc:304] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08f2b55a6a0748e49cd4e650c54c19f7, 7e7321a4744b489e87561404c1a7980a; no voters:
I20251214 21:04:56.613699 19134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfaf812cc93f45df920c99e746481e57" candidate_uuid: "7e7321a4744b489e87561404c1a7980a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "effe8b25bb544247baac6b8ba206cde4" is_pre_election: true
I20251214 21:04:56.613926 19338 raft_consensus.cc:2804] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:04:56.613977 19134 raft_consensus.cc:2468] T bfaf812cc93f45df920c99e746481e57 P effe8b25bb544247baac6b8ba206cde4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e7321a4744b489e87561404c1a7980a in term 0.
I20251214 21:04:56.614010 19338 raft_consensus.cc:493] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:04:56.614059 19338 raft_consensus.cc:3060] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:56.615063 19338 raft_consensus.cc:515] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f2b55a6a0748e49cd4e650c54c19f7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 34743 } } peers { permanent_uuid: "effe8b25bb544247baac6b8ba206cde4" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 42953 } } peers { permanent_uuid: "7e7321a4744b489e87561404c1a7980a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39799 } }
I20251214 21:04:56.615375 19338 leader_election.cc:290] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [CANDIDATE]: Term 1 election: Requested vote from peers 08f2b55a6a0748e49cd4e650c54c19f7 (127.16.120.3:34743), effe8b25bb544247baac6b8ba206cde4 (127.16.120.2:42953)
I20251214 21:04:56.615700 19267 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfaf812cc93f45df920c99e746481e57" candidate_uuid: "7e7321a4744b489e87561404c1a7980a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08f2b55a6a0748e49cd4e650c54c19f7"
I20251214 21:04:56.615753 19134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfaf812cc93f45df920c99e746481e57" candidate_uuid: "7e7321a4744b489e87561404c1a7980a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "effe8b25bb544247baac6b8ba206cde4"
I20251214 21:04:56.615824 19267 raft_consensus.cc:3060] T bfaf812cc93f45df920c99e746481e57 P 08f2b55a6a0748e49cd4e650c54c19f7 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:56.615851 19134 raft_consensus.cc:3060] T bfaf812cc93f45df920c99e746481e57 P effe8b25bb544247baac6b8ba206cde4 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:56.616901 19134 raft_consensus.cc:2468] T bfaf812cc93f45df920c99e746481e57 P effe8b25bb544247baac6b8ba206cde4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e7321a4744b489e87561404c1a7980a in term 1.
I20251214 21:04:56.617190 18937 leader_election.cc:304] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e7321a4744b489e87561404c1a7980a, effe8b25bb544247baac6b8ba206cde4; no voters:
I20251214 21:04:56.617312 19267 raft_consensus.cc:2468] T bfaf812cc93f45df920c99e746481e57 P 08f2b55a6a0748e49cd4e650c54c19f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e7321a4744b489e87561404c1a7980a in term 1.
I20251214 21:04:56.617367 19338 raft_consensus.cc:2804] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:56.617595 19338 raft_consensus.cc:697] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [term 1 LEADER]: Becoming Leader. State: Replica: 7e7321a4744b489e87561404c1a7980a, State: Running, Role: LEADER
I20251214 21:04:56.617974 19338 consensus_queue.cc:237] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f2b55a6a0748e49cd4e650c54c19f7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 34743 } } peers { permanent_uuid: "effe8b25bb544247baac6b8ba206cde4" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 42953 } } peers { permanent_uuid: "7e7321a4744b489e87561404c1a7980a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39799 } }
I20251214 21:04:56.620957 18859 catalog_manager.cc:5654] T bfaf812cc93f45df920c99e746481e57 P 7e7321a4744b489e87561404c1a7980a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e7321a4744b489e87561404c1a7980a (127.16.120.1). New cstate: current_term: 1 leader_uuid: "7e7321a4744b489e87561404c1a7980a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08f2b55a6a0748e49cd4e650c54c19f7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "effe8b25bb544247baac6b8ba206cde4" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e7321a4744b489e87561404c1a7980a" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39799 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:56.649006 16864 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251214 21:04:56.650391 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 7e7321a4744b489e87561404c1a7980a to finish bootstrapping
I20251214 21:04:56.655699 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver effe8b25bb544247baac6b8ba206cde4 to finish bootstrapping
I20251214 21:04:56.660598 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 08f2b55a6a0748e49cd4e650c54c19f7 to finish bootstrapping
W20251214 21:04:56.672540 19315 tablet.cc:2378] T bfaf812cc93f45df920c99e746481e57 P 08f2b55a6a0748e49cd4e650c54c19f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251214 21:04:56.790526 18859 server_base.cc:1129] Unauthorized access attempt to method kudu.master.MasterService.RefreshAuthzCache from {username='slave'} at 127.0.0.1:60706
I20251214 21:04:56.797631 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 18921
I20251214 21:04:56.803510 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 19052
I20251214 21:04:56.808175 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 19183
I20251214 21:04:56.812729 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 18830
2025-12-14T21:04:56Z chronyd exiting
[ OK ] AdminCliTest.TestAuthzResetCacheNotAuthorized (1147 ms)
[ RUN ] AdminCliTest.TestRebuildTables
I20251214 21:04:56.833099 16864 test_util.cc:276] Using random seed: -657898426
I20251214 21:04:56.833855 16864 ts_itest-base.cc:115] Starting cluster with:
I20251214 21:04:56.833896 16864 ts_itest-base.cc:116] --------------
I20251214 21:04:56.833911 16864 ts_itest-base.cc:117] 3 tablet servers
I20251214 21:04:56.833925 16864 ts_itest-base.cc:118] 3 replicas per TS
I20251214 21:04:56.833938 16864 ts_itest-base.cc:119] --------------
2025-12-14T21:04:56Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-14T21:04:56Z Disabled control of system clock
I20251214 21:04:56.841302 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:39793
--webserver_interface=127.16.120.62
--webserver_port=0
--builtin_ntp_servers=127.16.120.20:39161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.120.62:39793 with env {}
W20251214 21:04:56.943657 19367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:56.943884 19367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:56.943939 19367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:56.947166 19367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251214 21:04:56.947223 19367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:56.947250 19367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251214 21:04:56.947273 19367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251214 21:04:56.951026 19367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:39161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.120.62:39793
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:39793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.16.120.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.19367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:56.952087 19367 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:56.953197 19367 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:56.958806 19373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:56.958806 19375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:56.958948 19367 server_base.cc:1047] running on GCE node
W20251214 21:04:56.959098 19372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:56.959559 19367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:56.960430 19367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:56.961571 19367 hybrid_clock.cc:648] HybridClock initialized: now 1765746296961560 us; error 29 us; skew 500 ppm
I20251214 21:04:56.963268 19367 webserver.cc:492] Webserver started at http://127.16.120.62:44831/ using document root <none> and password file <none>
I20251214 21:04:56.963796 19367 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:56.963850 19367 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:56.964027 19367 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:56.965553 19367 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc"
format_stamp: "Formatted at 2025-12-14 21:04:56 on dist-test-slave-8rzr"
I20251214 21:04:56.966017 19367 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc"
format_stamp: "Formatted at 2025-12-14 21:04:56 on dist-test-slave-8rzr"
I20251214 21:04:56.969153 19367 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20251214 21:04:56.971238 19381 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:56.972208 19367 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:56.972307 19367 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc"
format_stamp: "Formatted at 2025-12-14 21:04:56 on dist-test-slave-8rzr"
I20251214 21:04:56.972383 19367 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:56.999891 19367 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:57.000589 19367 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:57.000767 19367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:57.007969 19367 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.62:39793
I20251214 21:04:57.007975 19433 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.62:39793 every 8 connection(s)
I20251214 21:04:57.008947 19367 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251214 21:04:57.011775 19434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:57.016093 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 19367
I20251214 21:04:57.016217 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251214 21:04:57.016938 19434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: Bootstrap starting.
I20251214 21:04:57.019184 19434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:57.019840 19434 log.cc:826] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:57.021330 19434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: No bootstrap required, opened a new log
I20251214 21:04:57.023782 19434 raft_consensus.cc:359] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } }
I20251214 21:04:57.023957 19434 raft_consensus.cc:385] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:57.024016 19434 raft_consensus.cc:740] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcdde350b9b34bf895e9aa2d8b4cb8bc, State: Initialized, Role: FOLLOWER
I20251214 21:04:57.024389 19434 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } }
I20251214 21:04:57.024510 19434 raft_consensus.cc:399] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:57.024565 19434 raft_consensus.cc:493] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:57.024646 19434 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:57.025583 19434 raft_consensus.cc:515] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } }
I20251214 21:04:57.025978 19434 leader_election.cc:304] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bcdde350b9b34bf895e9aa2d8b4cb8bc; no voters:
I20251214 21:04:57.026249 19434 leader_election.cc:290] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:04:57.026327 19439 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:57.026536 19439 raft_consensus.cc:697] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 1 LEADER]: Becoming Leader. State: Replica: bcdde350b9b34bf895e9aa2d8b4cb8bc, State: Running, Role: LEADER
I20251214 21:04:57.026867 19439 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } }
I20251214 21:04:57.027319 19434 sys_catalog.cc:565] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:04:57.028210 19441 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcdde350b9b34bf895e9aa2d8b4cb8bc. Latest consensus state: current_term: 1 leader_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } } }
I20251214 21:04:57.028328 19441 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:57.028627 19440 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } } }
I20251214 21:04:57.028709 19440 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:57.029603 19449 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:04:57.031929 19449 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:04:57.036787 19449 catalog_manager.cc:1357] Generated new cluster ID: 3a229215965748ffab15eda97d23c984
I20251214 21:04:57.036850 19449 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:04:57.047438 19449 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:04:57.048563 19449 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:04:57.064482 19449 catalog_manager.cc:6027] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: Generated new TSK 0
I20251214 21:04:57.065332 19449 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:04:57.070302 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.1:0
--local_ip_for_outbound_sockets=127.16.120.1
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:39793
--builtin_ntp_servers=127.16.120.20:39161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251214 21:04:57.172801 19459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:57.173019 19459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:57.173065 19459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:57.176403 19459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:57.176512 19459 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.1
I20251214 21:04:57.181197 19459 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:39161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:39793
--never_fsync=true
--heap_profile_path=/tmp/kudu.19459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.1
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:57.182740 19459 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:57.184180 19459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:57.191879 19464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:57.191880 19467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:57.191931 19465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:57.192309 19459 server_base.cc:1047] running on GCE node
I20251214 21:04:57.192831 19459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:57.193470 19459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:57.194656 19459 hybrid_clock.cc:648] HybridClock initialized: now 1765746297194610 us; error 41 us; skew 500 ppm
I20251214 21:04:57.196835 19459 webserver.cc:492] Webserver started at http://127.16.120.1:34671/ using document root <none> and password file <none>
I20251214 21:04:57.197503 19459 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:57.197572 19459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:57.197782 19459 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:57.199749 19459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "91af76edef3b41c1895b0594fcc764a8"
format_stamp: "Formatted at 2025-12-14 21:04:57 on dist-test-slave-8rzr"
I20251214 21:04:57.200299 19459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "91af76edef3b41c1895b0594fcc764a8"
format_stamp: "Formatted at 2025-12-14 21:04:57 on dist-test-slave-8rzr"
I20251214 21:04:57.204322 19459 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20251214 21:04:57.206971 19473 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:57.208091 19459 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251214 21:04:57.208199 19459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "91af76edef3b41c1895b0594fcc764a8"
format_stamp: "Formatted at 2025-12-14 21:04:57 on dist-test-slave-8rzr"
I20251214 21:04:57.208298 19459 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:57.227890 19459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:57.228629 19459 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:57.228786 19459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:57.229373 19459 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:57.230414 19459 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:57.230463 19459 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:57.230502 19459 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:57.230522 19459 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:57.239147 19459 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.1:39925
I20251214 21:04:57.239174 19587 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.1:39925 every 8 connection(s)
I20251214 21:04:57.240100 19459 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251214 21:04:57.248737 19588 heartbeater.cc:344] Connected to a master server at 127.16.120.62:39793
I20251214 21:04:57.248955 19588 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:57.249460 19588 heartbeater.cc:507] Master 127.16.120.62:39793 requested a full tablet report, sending...
I20251214 21:04:57.250043 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 19459
I20251214 21:04:57.250145 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251214 21:04:57.250969 19398 ts_manager.cc:194] Registered new tserver with Master: 91af76edef3b41c1895b0594fcc764a8 (127.16.120.1:39925)
I20251214 21:04:57.252315 19398 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.1:60005
I20251214 21:04:57.252383 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.2:0
--local_ip_for_outbound_sockets=127.16.120.2
--webserver_interface=127.16.120.2
--webserver_port=0
--tserver_master_addrs=127.16.120.62:39793
--builtin_ntp_servers=127.16.120.20:39161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251214 21:04:57.356594 19591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:57.356822 19591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:57.356873 19591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:57.360157 19591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:57.360291 19591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.2
I20251214 21:04:57.364027 19591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:39161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.16.120.2
--webserver_port=0
--tserver_master_addrs=127.16.120.62:39793
--never_fsync=true
--heap_profile_path=/tmp/kudu.19591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.2
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:57.365085 19591 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:57.366204 19591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:57.372517 19597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:57.372476 19596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:57.372551 19599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:57.372799 19591 server_base.cc:1047] running on GCE node
I20251214 21:04:57.373116 19591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:57.373625 19591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:57.374781 19591 hybrid_clock.cc:648] HybridClock initialized: now 1765746297374755 us; error 40 us; skew 500 ppm
I20251214 21:04:57.376533 19591 webserver.cc:492] Webserver started at http://127.16.120.2:39839/ using document root <none> and password file <none>
I20251214 21:04:57.377100 19591 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:57.377159 19591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:57.377333 19591 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:57.378871 19591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "c44e69909f96434ab52b070ca1fda567"
format_stamp: "Formatted at 2025-12-14 21:04:57 on dist-test-slave-8rzr"
I20251214 21:04:57.379293 19591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "c44e69909f96434ab52b070ca1fda567"
format_stamp: "Formatted at 2025-12-14 21:04:57 on dist-test-slave-8rzr"
I20251214 21:04:57.382431 19591 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20251214 21:04:57.384451 19605 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:57.385409 19591 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:57.385506 19591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "c44e69909f96434ab52b070ca1fda567"
format_stamp: "Formatted at 2025-12-14 21:04:57 on dist-test-slave-8rzr"
I20251214 21:04:57.385589 19591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:57.401015 19591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:57.401683 19591 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:57.401895 19591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:57.402454 19591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:57.403425 19591 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:57.403472 19591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:57.403523 19591 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:57.403551 19591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:57.412212 19591 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.2:46235
I20251214 21:04:57.412240 19719 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.2:46235 every 8 connection(s)
I20251214 21:04:57.413159 19591 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251214 21:04:57.417465 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 19591
I20251214 21:04:57.417562 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251214 21:04:57.419766 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.3:0
--local_ip_for_outbound_sockets=127.16.120.3
--webserver_interface=127.16.120.3
--webserver_port=0
--tserver_master_addrs=127.16.120.62:39793
--builtin_ntp_servers=127.16.120.20:39161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251214 21:04:57.422204 19720 heartbeater.cc:344] Connected to a master server at 127.16.120.62:39793
I20251214 21:04:57.422446 19720 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:57.422989 19720 heartbeater.cc:507] Master 127.16.120.62:39793 requested a full tablet report, sending...
I20251214 21:04:57.423934 19398 ts_manager.cc:194] Registered new tserver with Master: c44e69909f96434ab52b070ca1fda567 (127.16.120.2:46235)
I20251214 21:04:57.424489 19398 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.2:41719
W20251214 21:04:57.524402 19723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:57.524632 19723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:57.524680 19723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:57.527944 19723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:57.528056 19723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.3
I20251214 21:04:57.531905 19723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:39161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.16.120.3
--webserver_port=0
--tserver_master_addrs=127.16.120.62:39793
--never_fsync=true
--heap_profile_path=/tmp/kudu.19723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.3
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:57.532943 19723 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:57.534092 19723 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:57.540670 19728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:57.540616 19731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:57.540609 19729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:57.540869 19723 server_base.cc:1047] running on GCE node
I20251214 21:04:57.541183 19723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:57.541715 19723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:57.542852 19723 hybrid_clock.cc:648] HybridClock initialized: now 1765746297542839 us; error 30 us; skew 500 ppm
I20251214 21:04:57.544579 19723 webserver.cc:492] Webserver started at http://127.16.120.3:44125/ using document root <none> and password file <none>
I20251214 21:04:57.545137 19723 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:57.545197 19723 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:57.545369 19723 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:57.546952 19723 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "fca4bd6184db470a8693d9ba700f92e6"
format_stamp: "Formatted at 2025-12-14 21:04:57 on dist-test-slave-8rzr"
I20251214 21:04:57.547415 19723 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "fca4bd6184db470a8693d9ba700f92e6"
format_stamp: "Formatted at 2025-12-14 21:04:57 on dist-test-slave-8rzr"
I20251214 21:04:57.550634 19723 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251214 21:04:57.552783 19737 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:57.553737 19723 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:57.553860 19723 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "fca4bd6184db470a8693d9ba700f92e6"
format_stamp: "Formatted at 2025-12-14 21:04:57 on dist-test-slave-8rzr"
I20251214 21:04:57.553946 19723 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:57.566252 19723 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:57.566851 19723 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:57.567004 19723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:57.567519 19723 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:57.568432 19723 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:04:57.568486 19723 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:57.568538 19723 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:04:57.568564 19723 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:57.577354 19723 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.3:36667
I20251214 21:04:57.577382 19851 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.3:36667 every 8 connection(s)
I20251214 21:04:57.578292 19723 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251214 21:04:57.585423 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 19723
I20251214 21:04:57.585525 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251214 21:04:57.586540 19852 heartbeater.cc:344] Connected to a master server at 127.16.120.62:39793
I20251214 21:04:57.586796 19852 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:57.587319 19852 heartbeater.cc:507] Master 127.16.120.62:39793 requested a full tablet report, sending...
I20251214 21:04:57.588224 19398 ts_manager.cc:194] Registered new tserver with Master: fca4bd6184db470a8693d9ba700f92e6 (127.16.120.3:36667)
I20251214 21:04:57.588779 19398 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.3:47947
I20251214 21:04:57.599315 16864 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251214 21:04:57.607580 16864 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251214 21:04:57.607669 16864 test_util.cc:276] Using random seed: -657123851
I20251214 21:04:57.616700 19398 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55436:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251214 21:04:57.631914 19521 tablet_service.cc:1505] Processing CreateTablet for tablet 03f866aefe33434da72b59b27643c7b5 (DEFAULT_TABLE table=TestTable [id=56dd607f5bf940bea9a611d014acaaa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:57.632834 19521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f866aefe33434da72b59b27643c7b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:57.637693 19870 tablet_bootstrap.cc:492] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8: Bootstrap starting.
I20251214 21:04:57.639530 19870 tablet_bootstrap.cc:654] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:57.640237 19870 log.cc:826] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:57.641944 19870 tablet_bootstrap.cc:492] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8: No bootstrap required, opened a new log
I20251214 21:04:57.642125 19870 ts_tablet_manager.cc:1403] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20251214 21:04:57.644402 19870 raft_consensus.cc:359] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } }
I20251214 21:04:57.644586 19870 raft_consensus.cc:385] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:57.644652 19870 raft_consensus.cc:740] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91af76edef3b41c1895b0594fcc764a8, State: Initialized, Role: FOLLOWER
I20251214 21:04:57.645031 19870 consensus_queue.cc:260] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } }
I20251214 21:04:57.645152 19870 raft_consensus.cc:399] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:57.645210 19870 raft_consensus.cc:493] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:57.645298 19870 raft_consensus.cc:3060] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:57.646071 19870 raft_consensus.cc:515] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } }
I20251214 21:04:57.646399 19870 leader_election.cc:304] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91af76edef3b41c1895b0594fcc764a8; no voters:
I20251214 21:04:57.646723 19870 leader_election.cc:290] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:04:57.646854 19872 raft_consensus.cc:2804] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:57.647078 19872 raft_consensus.cc:697] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 1 LEADER]: Becoming Leader. State: Replica: 91af76edef3b41c1895b0594fcc764a8, State: Running, Role: LEADER
I20251214 21:04:57.647336 19588 heartbeater.cc:499] Master 127.16.120.62:39793 was elected leader, sending a full tablet report...
I20251214 21:04:57.647467 19872 consensus_queue.cc:237] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } }
I20251214 21:04:57.647542 19870 ts_tablet_manager.cc:1434] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20251214 21:04:57.650995 19398 catalog_manager.cc:5654] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91af76edef3b41c1895b0594fcc764a8 (127.16.120.1). New cstate: current_term: 1 leader_uuid: "91af76edef3b41c1895b0594fcc764a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:57.691903 16864 test_util.cc:276] Using random seed: -657039626
I20251214 21:04:57.699229 19398 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55442:
name: "TestTable1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251214 21:04:57.710395 19653 tablet_service.cc:1505] Processing CreateTablet for tablet 3814c8774e034c798a778688b3bb7cbe (DEFAULT_TABLE table=TestTable1 [id=5ff49c6d2feb4d8c9bdda8d8df38dabd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:57.711273 19653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3814c8774e034c798a778688b3bb7cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:57.716173 19892 tablet_bootstrap.cc:492] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567: Bootstrap starting.
I20251214 21:04:57.718205 19892 tablet_bootstrap.cc:654] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:57.718904 19892 log.cc:826] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:57.720417 19892 tablet_bootstrap.cc:492] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567: No bootstrap required, opened a new log
I20251214 21:04:57.720597 19892 ts_tablet_manager.cc:1403] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20251214 21:04:57.723071 19892 raft_consensus.cc:359] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } }
I20251214 21:04:57.723244 19892 raft_consensus.cc:385] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:57.723299 19892 raft_consensus.cc:740] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44e69909f96434ab52b070ca1fda567, State: Initialized, Role: FOLLOWER
I20251214 21:04:57.723695 19892 consensus_queue.cc:260] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } }
I20251214 21:04:57.723815 19892 raft_consensus.cc:399] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:57.723874 19892 raft_consensus.cc:493] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:57.723963 19892 raft_consensus.cc:3060] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:57.724695 19892 raft_consensus.cc:515] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } }
I20251214 21:04:57.725005 19892 leader_election.cc:304] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c44e69909f96434ab52b070ca1fda567; no voters:
I20251214 21:04:57.725273 19892 leader_election.cc:290] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:04:57.725402 19894 raft_consensus.cc:2804] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:57.725600 19894 raft_consensus.cc:697] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 1 LEADER]: Becoming Leader. State: Replica: c44e69909f96434ab52b070ca1fda567, State: Running, Role: LEADER
I20251214 21:04:57.725893 19720 heartbeater.cc:499] Master 127.16.120.62:39793 was elected leader, sending a full tablet report...
I20251214 21:04:57.725953 19894 consensus_queue.cc:237] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } }
I20251214 21:04:57.726106 19892 ts_tablet_manager.cc:1434] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20251214 21:04:57.728557 19398 catalog_manager.cc:5654] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 reported cstate change: term changed from 0 to 1, leader changed from <none> to c44e69909f96434ab52b070ca1fda567 (127.16.120.2). New cstate: current_term: 1 leader_uuid: "c44e69909f96434ab52b070ca1fda567" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:57.771653 16864 test_util.cc:276] Using random seed: -656959876
I20251214 21:04:57.778800 19397 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55450:
name: "TestTable2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251214 21:04:57.789916 19785 tablet_service.cc:1505] Processing CreateTablet for tablet 22ec6f4d188347d5a44d2b73d8ab810d (DEFAULT_TABLE table=TestTable2 [id=cb73019158f44b46b9dade5458d43a02]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:04:57.790824 19785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ec6f4d188347d5a44d2b73d8ab810d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:57.795818 19914 tablet_bootstrap.cc:492] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6: Bootstrap starting.
I20251214 21:04:57.797845 19914 tablet_bootstrap.cc:654] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:57.798543 19914 log.cc:826] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:57.800074 19914 tablet_bootstrap.cc:492] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6: No bootstrap required, opened a new log
I20251214 21:04:57.800264 19914 ts_tablet_manager.cc:1403] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20251214 21:04:57.802785 19914 raft_consensus.cc:359] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 36667 } }
I20251214 21:04:57.802965 19914 raft_consensus.cc:385] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:57.803023 19914 raft_consensus.cc:740] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca4bd6184db470a8693d9ba700f92e6, State: Initialized, Role: FOLLOWER
I20251214 21:04:57.803467 19914 consensus_queue.cc:260] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 36667 } }
I20251214 21:04:57.803602 19914 raft_consensus.cc:399] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:57.803648 19914 raft_consensus.cc:493] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:57.803727 19914 raft_consensus.cc:3060] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:57.804468 19914 raft_consensus.cc:515] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 36667 } }
I20251214 21:04:57.804795 19914 leader_election.cc:304] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fca4bd6184db470a8693d9ba700f92e6; no voters:
I20251214 21:04:57.804817 19916 raft_consensus.cc:493] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:04:57.804905 19916 raft_consensus.cc:515] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 36667 } }
I20251214 21:04:57.805068 19914 leader_election.cc:290] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:04:57.805140 19917 raft_consensus.cc:2804] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:57.805311 19917 raft_consensus.cc:697] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 1 LEADER]: Becoming Leader. State: Replica: fca4bd6184db470a8693d9ba700f92e6, State: Running, Role: LEADER
I20251214 21:04:57.805430 19916 leader_election.cc:304] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fca4bd6184db470a8693d9ba700f92e6; no voters:
I20251214 21:04:57.805691 19916 leader_election.cc:290] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers
I20251214 21:04:57.805642 19917 consensus_queue.cc:237] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 36667 } }
I20251214 21:04:57.805868 19852 heartbeater.cc:499] Master 127.16.120.62:39793 was elected leader, sending a full tablet report...
I20251214 21:04:57.805955 19914 ts_tablet_manager.cc:1434] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251214 21:04:57.808399 19397 catalog_manager.cc:5654] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fca4bd6184db470a8693d9ba700f92e6 (127.16.120.3). New cstate: current_term: 1 leader_uuid: "fca4bd6184db470a8693d9ba700f92e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 36667 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:57.851107 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 19367
I20251214 21:04:58.306154 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 19459
I20251214 21:04:58.311117 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 19591
I20251214 21:04:58.315930 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 19723
I20251214 21:04:58.321061 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:39793
--webserver_interface=127.16.120.62
--webserver_port=44831
--builtin_ntp_servers=127.16.120.20:39161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.120.62:39793 with env {}
W20251214 21:04:58.424305 19975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:58.424551 19975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:58.424609 19975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:58.427824 19975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251214 21:04:58.427879 19975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:58.427906 19975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251214 21:04:58.427930 19975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251214 21:04:58.431619 19975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:39161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.120.62:39793
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:39793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.16.120.62
--webserver_port=44831
--never_fsync=true
--heap_profile_path=/tmp/kudu.19975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:58.432672 19975 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:58.433768 19975 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:58.439041 19981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:58.439083 19980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:58.439054 19983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:58.439152 19975 server_base.cc:1047] running on GCE node
I20251214 21:04:58.439751 19975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:58.440605 19975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:58.441746 19975 hybrid_clock.cc:648] HybridClock initialized: now 1765746298441730 us; error 31 us; skew 500 ppm
I20251214 21:04:58.443370 19975 webserver.cc:492] Webserver started at http://127.16.120.62:44831/ using document root <none> and password file <none>
I20251214 21:04:58.443902 19975 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:58.443960 19975 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:58.447182 19975 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20251214 21:04:58.449036 19989 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:58.450037 19975 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:58.450136 19975 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc"
format_stamp: "Formatted at 2025-12-14 21:04:56 on dist-test-slave-8rzr"
I20251214 21:04:58.450513 19975 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:58.460085 19975 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:58.460672 19975 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:58.460825 19975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:58.467636 20042 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.62:39793 every 8 connection(s)
I20251214 21:04:58.467641 19975 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.62:39793
I20251214 21:04:58.468634 19975 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251214 21:04:58.472369 20043 sys_catalog.cc:263] Verifying existing consensus state
I20251214 21:04:58.473790 20043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: Bootstrap starting.
I20251214 21:04:58.476061 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 19975
I20251214 21:04:58.476420 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.1:39925
--local_ip_for_outbound_sockets=127.16.120.1
--tserver_master_addrs=127.16.120.62:39793
--webserver_port=34671
--webserver_interface=127.16.120.1
--builtin_ntp_servers=127.16.120.20:39161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251214 21:04:58.478423 20043 log.cc:826] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:58.490785 20043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=0 applied=18 ignored=0} inserts{seen=13 ignored=0} mutations{seen=10 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:58.491180 20043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: Bootstrap complete.
I20251214 21:04:58.494052 20043 raft_consensus.cc:359] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } }
I20251214 21:04:58.494398 20043 raft_consensus.cc:740] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcdde350b9b34bf895e9aa2d8b4cb8bc, State: Initialized, Role: FOLLOWER
I20251214 21:04:58.494921 20043 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 2.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } }
I20251214 21:04:58.495052 20043 raft_consensus.cc:399] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:58.495115 20043 raft_consensus.cc:493] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:58.495203 20043 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 2 FOLLOWER]: Advancing to term 3
I20251214 21:04:58.496685 20043 raft_consensus.cc:515] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } }
I20251214 21:04:58.496991 20043 leader_election.cc:304] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bcdde350b9b34bf895e9aa2d8b4cb8bc; no voters:
I20251214 21:04:58.497248 20043 leader_election.cc:290] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [CANDIDATE]: Term 3 election: Requested vote from peers
I20251214 21:04:58.497380 20047 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 3 FOLLOWER]: Leader election won for term 3
I20251214 21:04:58.497601 20047 raft_consensus.cc:697] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 3 LEADER]: Becoming Leader. State: Replica: bcdde350b9b34bf895e9aa2d8b4cb8bc, State: Running, Role: LEADER
I20251214 21:04:58.497980 20047 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 2.18, Last appended by leader: 18, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } }
I20251214 21:04:58.498411 20043 sys_catalog.cc:565] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:04:58.499353 20050 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcdde350b9b34bf895e9aa2d8b4cb8bc. Latest consensus state: current_term: 3 leader_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } } }
I20251214 21:04:58.499492 20050 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:58.499799 20049 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } } }
I20251214 21:04:58.499900 20049 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:58.504055 20063 catalog_manager.cc:1269] Loaded cluster ID: 3a229215965748ffab15eda97d23c984
I20251214 21:04:58.504122 20063 catalog_manager.cc:1562] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: loading cluster ID for follower catalog manager: success
I20251214 21:04:58.507212 20063 catalog_manager.cc:1584] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: acquiring CA information for follower catalog manager: success
I20251214 21:04:58.508714 20063 catalog_manager.cc:1612] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251214 21:04:58.508849 20057 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:04:58.510089 20057 catalog_manager.cc:679] Loaded metadata for table TestTable1 [id=19a8512bac914048b2d75943867d0340]
I20251214 21:04:58.510352 20057 catalog_manager.cc:679] Loaded metadata for table TestTable [id=33685ac316fd4c8c9bae77c751a19208]
I20251214 21:04:58.510603 20057 catalog_manager.cc:679] Loaded metadata for table TestTable2 [id=cb73019158f44b46b9dade5458d43a02]
I20251214 21:04:58.511500 20057 tablet_loader.cc:96] loaded metadata for tablet 03f866aefe33434da72b59b27643c7b5 (table TestTable [id=33685ac316fd4c8c9bae77c751a19208])
I20251214 21:04:58.511730 20057 tablet_loader.cc:96] loaded metadata for tablet 22ec6f4d188347d5a44d2b73d8ab810d (table TestTable2 [id=cb73019158f44b46b9dade5458d43a02])
I20251214 21:04:58.511909 20057 tablet_loader.cc:96] loaded metadata for tablet 3814c8774e034c798a778688b3bb7cbe (table TestTable1 [id=19a8512bac914048b2d75943867d0340])
I20251214 21:04:58.512006 20057 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:04:58.512410 20057 catalog_manager.cc:1269] Loaded cluster ID: 3a229215965748ffab15eda97d23c984
I20251214 21:04:58.512459 20057 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:04:58.513038 20057 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:04:58.513453 20057 catalog_manager.cc:6038] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: Loaded TSK: 0
I20251214 21:04:58.514071 20057 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20251214 21:04:58.589720 20045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:58.589967 20045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:58.590029 20045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:58.593289 20045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:58.593413 20045 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.1
I20251214 21:04:58.597174 20045 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:39161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.1:39925
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.16.120.1
--webserver_port=34671
--tserver_master_addrs=127.16.120.62:39793
--never_fsync=true
--heap_profile_path=/tmp/kudu.20045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.1
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:58.598255 20045 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:58.599406 20045 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:58.605762 20073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:58.605804 20071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:58.605778 20070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:58.606237 20045 server_base.cc:1047] running on GCE node
I20251214 21:04:58.606631 20045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:58.607228 20045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:58.608395 20045 hybrid_clock.cc:648] HybridClock initialized: now 1765746298608366 us; error 42 us; skew 500 ppm
I20251214 21:04:58.610361 20045 webserver.cc:492] Webserver started at http://127.16.120.1:34671/ using document root <none> and password file <none>
I20251214 21:04:58.611014 20045 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:58.611097 20045 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:58.615192 20045 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20251214 21:04:58.617560 20079 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:58.618729 20045 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251214 21:04:58.618841 20045 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "91af76edef3b41c1895b0594fcc764a8"
format_stamp: "Formatted at 2025-12-14 21:04:57 on dist-test-slave-8rzr"
I20251214 21:04:58.619321 20045 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:58.638660 20045 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:58.639467 20045 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:58.639675 20045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:58.640376 20045 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:58.641978 20086 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251214 21:04:58.645257 20045 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251214 21:04:58.645340 20045 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.001s
I20251214 21:04:58.645464 20045 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251214 21:04:58.647332 20045 ts_tablet_manager.cc:616] Registered 1 tablets
I20251214 21:04:58.647398 20045 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s user 0.000s sys 0.001s
I20251214 21:04:58.647706 20086 tablet_bootstrap.cc:492] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8: Bootstrap starting.
I20251214 21:04:58.658850 20045 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.1:39925
I20251214 21:04:58.659097 20193 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.1:39925 every 8 connection(s)
I20251214 21:04:58.660324 20045 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251214 21:04:58.662113 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 20045
I20251214 21:04:58.662575 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.2:46235
--local_ip_for_outbound_sockets=127.16.120.2
--tserver_master_addrs=127.16.120.62:39793
--webserver_port=39839
--webserver_interface=127.16.120.2
--builtin_ntp_servers=127.16.120.20:39161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251214 21:04:58.666795 20086 log.cc:826] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:58.676901 20194 heartbeater.cc:344] Connected to a master server at 127.16.120.62:39793
I20251214 21:04:58.677160 20194 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:58.677784 20194 heartbeater.cc:507] Master 127.16.120.62:39793 requested a full tablet report, sending...
I20251214 21:04:58.680289 20006 ts_manager.cc:194] Registered new tserver with Master: 91af76edef3b41c1895b0594fcc764a8 (127.16.120.1:39925)
I20251214 21:04:58.682952 20006 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.1:56307
I20251214 21:04:58.691843 20086 tablet_bootstrap.cc:492] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:58.692250 20086 tablet_bootstrap.cc:492] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8: Bootstrap complete.
I20251214 21:04:58.693601 20086 ts_tablet_manager.cc:1403] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8: Time spent bootstrapping tablet: real 0.046s user 0.029s sys 0.008s
I20251214 21:04:58.696429 20086 raft_consensus.cc:359] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } }
I20251214 21:04:58.696820 20086 raft_consensus.cc:740] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91af76edef3b41c1895b0594fcc764a8, State: Initialized, Role: FOLLOWER
I20251214 21:04:58.697328 20086 consensus_queue.cc:260] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } }
I20251214 21:04:58.697486 20086 raft_consensus.cc:399] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:58.697582 20086 raft_consensus.cc:493] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:58.697687 20086 raft_consensus.cc:3060] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:58.699806 20086 raft_consensus.cc:515] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } }
I20251214 21:04:58.700192 20086 leader_election.cc:304] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91af76edef3b41c1895b0594fcc764a8; no voters:
I20251214 21:04:58.700558 20086 leader_election.cc:290] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20251214 21:04:58.700814 20201 raft_consensus.cc:2804] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:58.701058 20201 raft_consensus.cc:697] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 2 LEADER]: Becoming Leader. State: Replica: 91af76edef3b41c1895b0594fcc764a8, State: Running, Role: LEADER
I20251214 21:04:58.701402 20201 consensus_queue.cc:237] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } }
I20251214 21:04:58.701582 20086 ts_tablet_manager.cc:1434] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8: Time spent starting tablet: real 0.008s user 0.011s sys 0.000s
I20251214 21:04:58.702013 20194 heartbeater.cc:499] Master 127.16.120.62:39793 was elected leader, sending a full tablet report...
I20251214 21:04:58.704188 20006 catalog_manager.cc:5654] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 reported cstate change: term changed from 0 to 2, leader changed from <none> to 91af76edef3b41c1895b0594fcc764a8 (127.16.120.1), VOTER 91af76edef3b41c1895b0594fcc764a8 (127.16.120.1) added. New cstate: current_term: 2 leader_uuid: "91af76edef3b41c1895b0594fcc764a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } health_report { overall_health: HEALTHY } } }
W20251214 21:04:58.710925 20006 catalog_manager.cc:5332] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 03f866aefe33434da72b59b27643c7b5 with cas_config_opid_index -1: no extra replica candidate found for tablet 03f866aefe33434da72b59b27643c7b5 (table TestTable [id=33685ac316fd4c8c9bae77c751a19208]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy: the total number of registered tablet servers (1) does not allow for adding an extra replica; consider bringing up more to have at least 4 tablet servers up and running
W20251214 21:04:58.784461 20199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:58.784678 20199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:58.784723 20199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:58.787912 20199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:58.788007 20199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.2
I20251214 21:04:58.791579 20199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:39161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.2:46235
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.16.120.2
--webserver_port=39839
--tserver_master_addrs=127.16.120.62:39793
--never_fsync=true
--heap_profile_path=/tmp/kudu.20199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.2
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:58.792533 20199 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:58.793581 20199 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:58.799777 20211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:58.799875 20214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:58.799911 20199 server_base.cc:1047] running on GCE node
W20251214 21:04:58.799813 20212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:58.800293 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:58.800839 20199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:58.801976 20199 hybrid_clock.cc:648] HybridClock initialized: now 1765746298801960 us; error 34 us; skew 500 ppm
I20251214 21:04:58.803606 20199 webserver.cc:492] Webserver started at http://127.16.120.2:39839/ using document root <none> and password file <none>
I20251214 21:04:58.804157 20199 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:58.804234 20199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:58.807667 20199 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20251214 21:04:58.809573 20220 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:58.810689 20199 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20251214 21:04:58.810796 20199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "c44e69909f96434ab52b070ca1fda567"
format_stamp: "Formatted at 2025-12-14 21:04:57 on dist-test-slave-8rzr"
I20251214 21:04:58.811187 20199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:58.830161 20199 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:58.830818 20199 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:58.830983 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:58.831519 20199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:58.832697 20227 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251214 21:04:58.836057 20199 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251214 21:04:58.836120 20199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20251214 21:04:58.836197 20199 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251214 21:04:58.837661 20199 ts_tablet_manager.cc:616] Registered 1 tablets
I20251214 21:04:58.837703 20199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20251214 21:04:58.838027 20227 tablet_bootstrap.cc:492] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567: Bootstrap starting.
I20251214 21:04:58.847904 20199 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.2:46235
I20251214 21:04:58.847965 20335 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.2:46235 every 8 connection(s)
I20251214 21:04:58.848865 20199 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251214 21:04:58.850049 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 20199
I20251214 21:04:58.850433 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.3:36667
--local_ip_for_outbound_sockets=127.16.120.3
--tserver_master_addrs=127.16.120.62:39793
--webserver_port=44125
--webserver_interface=127.16.120.3
--builtin_ntp_servers=127.16.120.20:39161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251214 21:04:58.853391 20227 log.cc:826] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:58.858701 20336 heartbeater.cc:344] Connected to a master server at 127.16.120.62:39793
I20251214 21:04:58.858938 20336 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:58.859544 20336 heartbeater.cc:507] Master 127.16.120.62:39793 requested a full tablet report, sending...
I20251214 21:04:58.861366 20006 ts_manager.cc:194] Registered new tserver with Master: c44e69909f96434ab52b070ca1fda567 (127.16.120.2:46235)
I20251214 21:04:58.862387 20006 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.2:58983
I20251214 21:04:58.870278 20227 tablet_bootstrap.cc:492] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=350 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:58.870584 20227 tablet_bootstrap.cc:492] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567: Bootstrap complete.
I20251214 21:04:58.871490 20227 ts_tablet_manager.cc:1403] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567: Time spent bootstrapping tablet: real 0.034s user 0.028s sys 0.004s
I20251214 21:04:58.873417 20227 raft_consensus.cc:359] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } }
I20251214 21:04:58.873723 20227 raft_consensus.cc:740] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44e69909f96434ab52b070ca1fda567, State: Initialized, Role: FOLLOWER
I20251214 21:04:58.874159 20227 consensus_queue.cc:260] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } }
I20251214 21:04:58.874277 20227 raft_consensus.cc:399] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:58.874336 20227 raft_consensus.cc:493] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:58.874423 20227 raft_consensus.cc:3060] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:58.875883 20227 raft_consensus.cc:515] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } }
I20251214 21:04:58.876178 20227 leader_election.cc:304] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c44e69909f96434ab52b070ca1fda567; no voters:
I20251214 21:04:58.876437 20227 leader_election.cc:290] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [CANDIDATE]: Term 2 election: Requested vote from peers
I20251214 21:04:58.876544 20341 raft_consensus.cc:2804] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:58.876694 20341 raft_consensus.cc:697] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 2 LEADER]: Becoming Leader. State: Replica: c44e69909f96434ab52b070ca1fda567, State: Running, Role: LEADER
I20251214 21:04:58.876960 20341 consensus_queue.cc:237] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } }
I20251214 21:04:58.877097 20336 heartbeater.cc:499] Master 127.16.120.62:39793 was elected leader, sending a full tablet report...
I20251214 21:04:58.877264 20227 ts_tablet_manager.cc:1434] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20251214 21:04:58.879091 20006 catalog_manager.cc:5654] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 reported cstate change: term changed from 0 to 2, leader changed from <none> to c44e69909f96434ab52b070ca1fda567 (127.16.120.2), VOTER c44e69909f96434ab52b070ca1fda567 (127.16.120.2) added. New cstate: current_term: 2 leader_uuid: "c44e69909f96434ab52b070ca1fda567" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:58.887108 20289 consensus_queue.cc:237] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } } peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: NON_VOTER last_known_addr { host: "127.16.120.1" port: 39925 } attrs { promote: true } }
I20251214 21:04:58.888341 20343 raft_consensus.cc:2955] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index -1 to 10, NON_VOTER 91af76edef3b41c1895b0594fcc764a8 (127.16.120.1) added. New config: { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } } peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: NON_VOTER last_known_addr { host: "127.16.120.1" port: 39925 } attrs { promote: true } } }
I20251214 21:04:58.890460 19990 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 3814c8774e034c798a778688b3bb7cbe with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20251214 21:04:58.891125 20006 catalog_manager.cc:5654] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 reported cstate change: config changed from index -1 to 10, NON_VOTER 91af76edef3b41c1895b0594fcc764a8 (127.16.120.1) added. New cstate: current_term: 2 leader_uuid: "c44e69909f96434ab52b070ca1fda567" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: NON_VOTER last_known_addr { host: "127.16.120.1" port: 39925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251214 21:04:58.894322 20221 consensus_peers.cc:597] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 -> Peer 91af76edef3b41c1895b0594fcc764a8 (127.16.120.1:39925): Couldn't send request to peer 91af76edef3b41c1895b0594fcc764a8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3814c8774e034c798a778688b3bb7cbe. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:58.922829 20148 consensus_queue.cc:237] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 2.10, Last appended by leader: 9, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } } peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: NON_VOTER last_known_addr { host: "127.16.120.2" port: 46235 } attrs { promote: true } }
I20251214 21:04:58.924037 20203 raft_consensus.cc:2955] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 2 LEADER]: Committing config change with OpId 2.11: config changed from index -1 to 11, NON_VOTER c44e69909f96434ab52b070ca1fda567 (127.16.120.2) added. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } } peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: NON_VOTER last_known_addr { host: "127.16.120.2" port: 46235 } attrs { promote: true } } }
I20251214 21:04:58.925663 19990 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 03f866aefe33434da72b59b27643c7b5 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 4)
I20251214 21:04:58.926662 20006 catalog_manager.cc:5654] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 reported cstate change: config changed from index -1 to 11, NON_VOTER c44e69909f96434ab52b070ca1fda567 (127.16.120.2) added. New cstate: current_term: 2 leader_uuid: "91af76edef3b41c1895b0594fcc764a8" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: NON_VOTER last_known_addr { host: "127.16.120.2" port: 46235 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251214 21:04:58.928836 20080 consensus_peers.cc:597] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 -> Peer c44e69909f96434ab52b070ca1fda567 (127.16.120.2:46235): Couldn't send request to peer c44e69909f96434ab52b070ca1fda567. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03f866aefe33434da72b59b27643c7b5. This is attempt 1: this message will repeat every 5th retry.
W20251214 21:04:58.963850 20339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:58.964076 20339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:58.964123 20339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:58.967453 20339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:58.967556 20339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.3
I20251214 21:04:58.971302 20339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:39161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.3:36667
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.16.120.3
--webserver_port=44125
--tserver_master_addrs=127.16.120.62:39793
--never_fsync=true
--heap_profile_path=/tmp/kudu.20339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.3
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:58.972285 20339 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:58.973380 20339 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:58.979856 20353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:58.979848 20354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:58.979862 20356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:58.980093 20339 server_base.cc:1047] running on GCE node
I20251214 21:04:58.980520 20339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:58.981038 20339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:58.982178 20339 hybrid_clock.cc:648] HybridClock initialized: now 1765746298982159 us; error 32 us; skew 500 ppm
I20251214 21:04:58.983784 20339 webserver.cc:492] Webserver started at http://127.16.120.3:44125/ using document root <none> and password file <none>
I20251214 21:04:58.984301 20339 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:58.984375 20339 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:58.987658 20339 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20251214 21:04:58.989421 20362 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:58.990371 20339 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:58.990468 20339 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "fca4bd6184db470a8693d9ba700f92e6"
format_stamp: "Formatted at 2025-12-14 21:04:57 on dist-test-slave-8rzr"
I20251214 21:04:58.990846 20339 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:59.000406 20339 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:59.000989 20339 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:59.001148 20339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:59.001677 20339 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:04:59.002803 20369 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251214 21:04:59.006006 20339 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251214 21:04:59.006063 20339 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20251214 21:04:59.006131 20339 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251214 21:04:59.007619 20339 ts_tablet_manager.cc:616] Registered 1 tablets
I20251214 21:04:59.007663 20339 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20251214 21:04:59.007951 20369 tablet_bootstrap.cc:492] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6: Bootstrap starting.
I20251214 21:04:59.016574 20339 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.3:36667
I20251214 21:04:59.016629 20477 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.3:36667 every 8 connection(s)
I20251214 21:04:59.017509 20339 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251214 21:04:59.023375 20369 log.cc:826] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:59.026177 20478 heartbeater.cc:344] Connected to a master server at 127.16.120.62:39793
I20251214 21:04:59.026429 20478 heartbeater.cc:461] Registering TS with master...
I20251214 21:04:59.027073 20478 heartbeater.cc:507] Master 127.16.120.62:39793 requested a full tablet report, sending...
I20251214 21:04:59.027596 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 20339
I20251214 21:04:59.028879 20006 ts_manager.cc:194] Registered new tserver with Master: fca4bd6184db470a8693d9ba700f92e6 (127.16.120.3:36667)
I20251214 21:04:59.029618 20006 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.3:50183
I20251214 21:04:59.033252 20148 consensus_queue.cc:237] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 2.11, Last appended by leader: 9, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } } peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: NON_VOTER last_known_addr { host: "127.16.120.2" port: 46235 } attrs { promote: true } } peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 36667 } attrs { promote: true } }
I20251214 21:04:59.034327 20203 raft_consensus.cc:2955] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 [term 2 LEADER]: Committing config change with OpId 2.12: config changed from index 11 to 12, NON_VOTER fca4bd6184db470a8693d9ba700f92e6 (127.16.120.3) added. New config: { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } } peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: NON_VOTER last_known_addr { host: "127.16.120.2" port: 46235 } attrs { promote: true } } peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 36667 } attrs { promote: true } } }
W20251214 21:04:59.035712 20080 consensus_peers.cc:597] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 -> Peer c44e69909f96434ab52b070ca1fda567 (127.16.120.2:46235): Couldn't send request to peer c44e69909f96434ab52b070ca1fda567. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03f866aefe33434da72b59b27643c7b5. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:59.035914 19990 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 03f866aefe33434da72b59b27643c7b5 with cas_config_opid_index 11: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 3)
I20251214 21:04:59.036047 16864 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251214 21:04:59.036633 20006 catalog_manager.cc:5654] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 reported cstate change: config changed from index 11 to 12, NON_VOTER fca4bd6184db470a8693d9ba700f92e6 (127.16.120.3) added. New cstate: current_term: 2 leader_uuid: "91af76edef3b41c1895b0594fcc764a8" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: NON_VOTER last_known_addr { host: "127.16.120.2" port: 46235 } attrs { promote: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 36667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251214 21:04:59.038728 20369 tablet_bootstrap.cc:492] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=250 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:59.039093 20369 tablet_bootstrap.cc:492] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6: Bootstrap complete.
I20251214 21:04:59.039238 16864 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251214 21:04:59.040165 20369 ts_tablet_manager.cc:1403] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6: Time spent bootstrapping tablet: real 0.032s user 0.026s sys 0.004s
I20251214 21:04:59.040838 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 91af76edef3b41c1895b0594fcc764a8 to finish bootstrapping
W20251214 21:04:59.042228 20080 consensus_peers.cc:597] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8 -> Peer fca4bd6184db470a8693d9ba700f92e6 (127.16.120.3:36667): Couldn't send request to peer fca4bd6184db470a8693d9ba700f92e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03f866aefe33434da72b59b27643c7b5. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:59.042454 20369 raft_consensus.cc:359] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 36667 } }
I20251214 21:04:59.042757 20369 raft_consensus.cc:740] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca4bd6184db470a8693d9ba700f92e6, State: Initialized, Role: FOLLOWER
I20251214 21:04:59.043125 20369 consensus_queue.cc:260] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 36667 } }
I20251214 21:04:59.043242 20369 raft_consensus.cc:399] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:59.043301 20369 raft_consensus.cc:493] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:59.043390 20369 raft_consensus.cc:3060] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:04:59.044975 20369 raft_consensus.cc:515] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 36667 } }
I20251214 21:04:59.045277 20369 leader_election.cc:304] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fca4bd6184db470a8693d9ba700f92e6; no voters:
I20251214 21:04:59.045542 20369 leader_election.cc:290] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20251214 21:04:59.045697 20484 raft_consensus.cc:2804] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:04:59.046077 20484 raft_consensus.cc:697] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [term 2 LEADER]: Becoming Leader. State: Replica: fca4bd6184db470a8693d9ba700f92e6, State: Running, Role: LEADER
I20251214 21:04:59.046389 20369 ts_tablet_manager.cc:1434] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20251214 21:04:59.046404 20484 consensus_queue.cc:237] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 36667 } }
I20251214 21:04:59.046788 20478 heartbeater.cc:499] Master 127.16.120.62:39793 was elected leader, sending a full tablet report...
I20251214 21:04:59.047174 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver c44e69909f96434ab52b070ca1fda567 to finish bootstrapping
I20251214 21:04:59.048374 20005 catalog_manager.cc:5654] T 22ec6f4d188347d5a44d2b73d8ab810d P fca4bd6184db470a8693d9ba700f92e6 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "fca4bd6184db470a8693d9ba700f92e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 36667 } health_report { overall_health: HEALTHY } } }
I20251214 21:04:59.052742 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver fca4bd6184db470a8693d9ba700f92e6 to finish bootstrapping
I20251214 21:04:59.090713 20289 consensus_queue.cc:237] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 2.10, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } } peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: NON_VOTER last_known_addr { host: "127.16.120.1" port: 39925 } attrs { promote: true } } peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 36667 } attrs { promote: true } }
I20251214 21:04:59.091981 20342 raft_consensus.cc:2955] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 [term 2 LEADER]: Committing config change with OpId 2.11: config changed from index 10 to 11, NON_VOTER fca4bd6184db470a8693d9ba700f92e6 (127.16.120.3) added. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } } peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: NON_VOTER last_known_addr { host: "127.16.120.1" port: 39925 } attrs { promote: true } } peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 36667 } attrs { promote: true } } }
W20251214 21:04:59.092767 20221 consensus_peers.cc:597] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 -> Peer 91af76edef3b41c1895b0594fcc764a8 (127.16.120.1:39925): Couldn't send request to peer 91af76edef3b41c1895b0594fcc764a8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3814c8774e034c798a778688b3bb7cbe. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:59.093873 19990 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 3814c8774e034c798a778688b3bb7cbe with cas_config_opid_index 10: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 4)
I20251214 21:04:59.094485 20005 catalog_manager.cc:5654] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 reported cstate change: config changed from index 10 to 11, NON_VOTER fca4bd6184db470a8693d9ba700f92e6 (127.16.120.3) added. New cstate: current_term: 2 leader_uuid: "c44e69909f96434ab52b070ca1fda567" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: NON_VOTER last_known_addr { host: "127.16.120.1" port: 39925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 36667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251214 21:04:59.096516 20221 consensus_peers.cc:597] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567 -> Peer fca4bd6184db470a8693d9ba700f92e6 (127.16.120.3:36667): Couldn't send request to peer fca4bd6184db470a8693d9ba700f92e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3814c8774e034c798a778688b3bb7cbe. This is attempt 1: this message will repeat every 5th retry.
I20251214 21:04:59.112754 20128 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251214 21:04:59.112965 20411 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251214 21:04:59.113186 20269 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
bcdde350b9b34bf895e9aa2d8b4cb8bc | 127.16.120.62:39793 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.16.120.20:39161 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
91af76edef3b41c1895b0594fcc764a8 | 127.16.120.1:39925 | HEALTHY | <none> | 1 | 0
c44e69909f96434ab52b070ca1fda567 | 127.16.120.2:46235 | HEALTHY | <none> | 1 | 0
fca4bd6184db470a8693d9ba700f92e6 | 127.16.120.3:36667 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.16.120.1 | experimental | 127.16.120.1:39925
local_ip_for_outbound_sockets | 127.16.120.2 | experimental | 127.16.120.2:46235
local_ip_for_outbound_sockets | 127.16.120.3 | experimental | 127.16.120.3:36667
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.16.120.1:39925
server_dump_info_path | /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.16.120.2:46235
server_dump_info_path | /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.16.120.3:36667
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.16.120.20:39161 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
TestTable1 | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
TestTable2 | 1 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 2
First Quartile | 2
Median | 2
Third Quartile | 3
Maximum | 3
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 3
Tablets | 3
Replicas | 7
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20251214 21:04:59.138926 16864 log_verifier.cc:126] Checking tablet 03f866aefe33434da72b59b27643c7b5
I20251214 21:04:59.149806 16864 log_verifier.cc:177] Verified matching terms for 12 ops in tablet 03f866aefe33434da72b59b27643c7b5
I20251214 21:04:59.149921 16864 log_verifier.cc:126] Checking tablet 22ec6f4d188347d5a44d2b73d8ab810d
I20251214 21:04:59.157541 16864 log_verifier.cc:177] Verified matching terms for 7 ops in tablet 22ec6f4d188347d5a44d2b73d8ab810d
I20251214 21:04:59.157605 16864 log_verifier.cc:126] Checking tablet 3814c8774e034c798a778688b3bb7cbe
I20251214 21:04:59.165771 16864 log_verifier.cc:177] Verified matching terms for 11 ops in tablet 3814c8774e034c798a778688b3bb7cbe
I20251214 21:04:59.165916 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 19975
I20251214 21:04:59.173221 16864 minidump.cc:252] Setting minidump size limit to 20M
I20251214 21:04:59.173677 16864 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:59.174194 16864 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:59.178988 20515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:59.179003 20514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:59.179005 20517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:59.179091 16864 server_base.cc:1047] running on GCE node
I20251214 21:04:59.179723 16864 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251214 21:04:59.179821 16864 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251214 21:04:59.179847 16864 hybrid_clock.cc:648] HybridClock initialized: now 1765746299179844 us; error 0 us; skew 500 ppm
I20251214 21:04:59.181118 16864 webserver.cc:492] Webserver started at http://0.0.0.0:35253/ using document root <none> and password file <none>
I20251214 21:04:59.181680 16864 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:59.181730 16864 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:59.184279 16864 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20251214 21:04:59.186352 20522 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:59.187351 16864 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:59.187479 16864 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc"
format_stamp: "Formatted at 2025-12-14 21:04:56 on dist-test-slave-8rzr"
I20251214 21:04:59.187811 16864 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:59.194880 16864 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:59.195417 16864 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:59.195655 16864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:59.198396 16864 sys_catalog.cc:263] Verifying existing consensus state
W20251214 21:04:59.199194 16864 sys_catalog.cc:243] For a single master config, on-disk Raft master: 127.16.120.62:39793 exists but no master address supplied!
I20251214 21:04:59.200409 16864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: Bootstrap starting.
I20251214 21:04:59.213204 16864 log.cc:826] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:59.228436 16864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=13 ignored=0} mutations{seen=17 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:59.228782 16864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc: Bootstrap complete.
I20251214 21:04:59.231760 16864 raft_consensus.cc:359] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } }
I20251214 21:04:59.231925 16864 raft_consensus.cc:740] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcdde350b9b34bf895e9aa2d8b4cb8bc, State: Initialized, Role: FOLLOWER
I20251214 21:04:59.232331 16864 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 3.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } }
I20251214 21:04:59.232448 16864 raft_consensus.cc:399] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 3 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:59.232515 16864 raft_consensus.cc:493] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 3 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:59.232602 16864 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 3 FOLLOWER]: Advancing to term 4
I20251214 21:04:59.234040 16864 raft_consensus.cc:515] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } }
I20251214 21:04:59.234344 16864 leader_election.cc:304] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bcdde350b9b34bf895e9aa2d8b4cb8bc; no voters:
I20251214 21:04:59.234628 16864 leader_election.cc:290] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [CANDIDATE]: Term 4 election: Requested vote from peers
I20251214 21:04:59.234767 20529 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 4 FOLLOWER]: Leader election won for term 4
I20251214 21:04:59.234988 20529 raft_consensus.cc:697] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 4 LEADER]: Becoming Leader. State: Replica: bcdde350b9b34bf895e9aa2d8b4cb8bc, State: Running, Role: LEADER
I20251214 21:04:59.235278 20529 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 3.26, Last appended by leader: 26, Current term: 4, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } }
I20251214 21:04:59.236433 20530 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 leader_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } } }
I20251214 21:04:59.236545 20530 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:59.236536 20531 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcdde350b9b34bf895e9aa2d8b4cb8bc. Latest consensus state: current_term: 4 leader_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcdde350b9b34bf895e9aa2d8b4cb8bc" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 39793 } } }
I20251214 21:04:59.236778 20531 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:59.243604 16864 tablet_replica.cc:333] stopping tablet replica
I20251214 21:04:59.243845 16864 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 4 LEADER]: Raft consensus shutting down.
I20251214 21:04:59.243978 16864 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bcdde350b9b34bf895e9aa2d8b4cb8bc [term 4 FOLLOWER]: Raft consensus is shut down!
I20251214 21:04:59.244998 16864 master.cc:561] Master@0.0.0.0:7051 shutting down...
W20251214 21:04:59.245249 16864 acceptor_pool.cc:194] Could not shut down acceptor socket on 0.0.0.0:7051: Network error: shutdown error: Transport endpoint is not connected (error 107)
I20251214 21:04:59.256538 16864 master.cc:583] Master@0.0.0.0:7051 shutdown complete.
I20251214 21:04:59.494688 20571 ts_tablet_manager.cc:933] T 03f866aefe33434da72b59b27643c7b5 P c44e69909f96434ab52b070ca1fda567: Initiating tablet copy from peer 91af76edef3b41c1895b0594fcc764a8 (127.16.120.1:39925)
I20251214 21:04:59.495380 20571 tablet_copy_client.cc:323] T 03f866aefe33434da72b59b27643c7b5 P c44e69909f96434ab52b070ca1fda567: tablet copy: Beginning tablet copy session from remote peer at address 127.16.120.1:39925
I20251214 21:04:59.496145 20168 tablet_copy_service.cc:140] P 91af76edef3b41c1895b0594fcc764a8: Received BeginTabletCopySession request for tablet 03f866aefe33434da72b59b27643c7b5 from peer c44e69909f96434ab52b070ca1fda567 ({username='slave'} at 127.16.120.2:55961)
I20251214 21:04:59.496309 20168 tablet_copy_service.cc:161] P 91af76edef3b41c1895b0594fcc764a8: Beginning new tablet copy session on tablet 03f866aefe33434da72b59b27643c7b5 from peer c44e69909f96434ab52b070ca1fda567 at {username='slave'} at 127.16.120.2:55961: session id = c44e69909f96434ab52b070ca1fda567-03f866aefe33434da72b59b27643c7b5
I20251214 21:04:59.497401 20168 tablet_copy_source_session.cc:215] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:59.499115 20571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f866aefe33434da72b59b27643c7b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:59.501734 20571 tablet_copy_client.cc:806] T 03f866aefe33434da72b59b27643c7b5 P c44e69909f96434ab52b070ca1fda567: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:59.501924 20571 tablet_copy_client.cc:670] T 03f866aefe33434da72b59b27643c7b5 P c44e69909f96434ab52b070ca1fda567: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:59.503494 20571 tablet_copy_client.cc:538] T 03f866aefe33434da72b59b27643c7b5 P c44e69909f96434ab52b070ca1fda567: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:59.504612 20571 tablet_bootstrap.cc:492] T 03f866aefe33434da72b59b27643c7b5 P c44e69909f96434ab52b070ca1fda567: Bootstrap starting.
I20251214 21:04:59.520125 20571 tablet_bootstrap.cc:492] T 03f866aefe33434da72b59b27643c7b5 P c44e69909f96434ab52b070ca1fda567: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:59.520390 20571 tablet_bootstrap.cc:492] T 03f866aefe33434da72b59b27643c7b5 P c44e69909f96434ab52b070ca1fda567: Bootstrap complete.
I20251214 21:04:59.520550 20571 ts_tablet_manager.cc:1403] T 03f866aefe33434da72b59b27643c7b5 P c44e69909f96434ab52b070ca1fda567: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.004s
I20251214 21:04:59.521049 20571 raft_consensus.cc:359] T 03f866aefe33434da72b59b27643c7b5 P c44e69909f96434ab52b070ca1fda567 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } } peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: NON_VOTER last_known_addr { host: "127.16.120.2" port: 46235 } attrs { promote: true } } peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 36667 } attrs { promote: true } }
I20251214 21:04:59.521153 20571 raft_consensus.cc:740] T 03f866aefe33434da72b59b27643c7b5 P c44e69909f96434ab52b070ca1fda567 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: c44e69909f96434ab52b070ca1fda567, State: Initialized, Role: LEARNER
I20251214 21:04:59.521245 20571 consensus_queue.cc:260] T 03f866aefe33434da72b59b27643c7b5 P c44e69909f96434ab52b070ca1fda567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 2.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } } peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: NON_VOTER last_known_addr { host: "127.16.120.2" port: 46235 } attrs { promote: true } } peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 36667 } attrs { promote: true } }
I20251214 21:04:59.521514 20571 ts_tablet_manager.cc:1434] T 03f866aefe33434da72b59b27643c7b5 P c44e69909f96434ab52b070ca1fda567: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20251214 21:04:59.522296 20168 tablet_copy_service.cc:342] P 91af76edef3b41c1895b0594fcc764a8: Request end of tablet copy session c44e69909f96434ab52b070ca1fda567-03f866aefe33434da72b59b27643c7b5 received from {username='slave'} at 127.16.120.2:55961
I20251214 21:04:59.522434 20168 tablet_copy_service.cc:434] P 91af76edef3b41c1895b0594fcc764a8: ending tablet copy session c44e69909f96434ab52b070ca1fda567-03f866aefe33434da72b59b27643c7b5 on tablet 03f866aefe33434da72b59b27643c7b5 with peer c44e69909f96434ab52b070ca1fda567
W20251214 21:04:59.522531 20336 heartbeater.cc:646] Failed to heartbeat to 127.16.120.62:39793 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.120.62:39793: connect: Connection refused (error 111)
I20251214 21:04:59.587417 20583 ts_tablet_manager.cc:933] T 03f866aefe33434da72b59b27643c7b5 P fca4bd6184db470a8693d9ba700f92e6: Initiating tablet copy from peer 91af76edef3b41c1895b0594fcc764a8 (127.16.120.1:39925)
I20251214 21:04:59.587975 20583 tablet_copy_client.cc:323] T 03f866aefe33434da72b59b27643c7b5 P fca4bd6184db470a8693d9ba700f92e6: tablet copy: Beginning tablet copy session from remote peer at address 127.16.120.1:39925
I20251214 21:04:59.592131 20168 tablet_copy_service.cc:140] P 91af76edef3b41c1895b0594fcc764a8: Received BeginTabletCopySession request for tablet 03f866aefe33434da72b59b27643c7b5 from peer fca4bd6184db470a8693d9ba700f92e6 ({username='slave'} at 127.16.120.3:40325)
I20251214 21:04:59.592238 20168 tablet_copy_service.cc:161] P 91af76edef3b41c1895b0594fcc764a8: Beginning new tablet copy session on tablet 03f866aefe33434da72b59b27643c7b5 from peer fca4bd6184db470a8693d9ba700f92e6 at {username='slave'} at 127.16.120.3:40325: session id = fca4bd6184db470a8693d9ba700f92e6-03f866aefe33434da72b59b27643c7b5
I20251214 21:04:59.592959 20168 tablet_copy_source_session.cc:215] T 03f866aefe33434da72b59b27643c7b5 P 91af76edef3b41c1895b0594fcc764a8: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:59.594527 20583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f866aefe33434da72b59b27643c7b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:59.598129 20583 tablet_copy_client.cc:806] T 03f866aefe33434da72b59b27643c7b5 P fca4bd6184db470a8693d9ba700f92e6: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:59.598392 20583 tablet_copy_client.cc:670] T 03f866aefe33434da72b59b27643c7b5 P fca4bd6184db470a8693d9ba700f92e6: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:59.600229 20583 tablet_copy_client.cc:538] T 03f866aefe33434da72b59b27643c7b5 P fca4bd6184db470a8693d9ba700f92e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:59.601914 20583 tablet_bootstrap.cc:492] T 03f866aefe33434da72b59b27643c7b5 P fca4bd6184db470a8693d9ba700f92e6: Bootstrap starting.
I20251214 21:04:59.605226 20586 ts_tablet_manager.cc:933] T 3814c8774e034c798a778688b3bb7cbe P 91af76edef3b41c1895b0594fcc764a8: Initiating tablet copy from peer c44e69909f96434ab52b070ca1fda567 (127.16.120.2:46235)
I20251214 21:04:59.605962 20586 tablet_copy_client.cc:323] T 3814c8774e034c798a778688b3bb7cbe P 91af76edef3b41c1895b0594fcc764a8: tablet copy: Beginning tablet copy session from remote peer at address 127.16.120.2:46235
I20251214 21:04:59.606657 20310 tablet_copy_service.cc:140] P c44e69909f96434ab52b070ca1fda567: Received BeginTabletCopySession request for tablet 3814c8774e034c798a778688b3bb7cbe from peer 91af76edef3b41c1895b0594fcc764a8 ({username='slave'} at 127.16.120.1:52023)
I20251214 21:04:59.606810 20310 tablet_copy_service.cc:161] P c44e69909f96434ab52b070ca1fda567: Beginning new tablet copy session on tablet 3814c8774e034c798a778688b3bb7cbe from peer 91af76edef3b41c1895b0594fcc764a8 at {username='slave'} at 127.16.120.1:52023: session id = 91af76edef3b41c1895b0594fcc764a8-3814c8774e034c798a778688b3bb7cbe
I20251214 21:04:59.607798 20310 tablet_copy_source_session.cc:215] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:59.609133 20586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3814c8774e034c798a778688b3bb7cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:59.611624 20586 tablet_copy_client.cc:806] T 3814c8774e034c798a778688b3bb7cbe P 91af76edef3b41c1895b0594fcc764a8: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:59.611817 20586 tablet_copy_client.cc:670] T 3814c8774e034c798a778688b3bb7cbe P 91af76edef3b41c1895b0594fcc764a8: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:59.613305 20586 tablet_copy_client.cc:538] T 3814c8774e034c798a778688b3bb7cbe P 91af76edef3b41c1895b0594fcc764a8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:59.614415 20586 tablet_bootstrap.cc:492] T 3814c8774e034c798a778688b3bb7cbe P 91af76edef3b41c1895b0594fcc764a8: Bootstrap starting.
I20251214 21:04:59.625339 20583 tablet_bootstrap.cc:492] T 03f866aefe33434da72b59b27643c7b5 P fca4bd6184db470a8693d9ba700f92e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:59.625722 20583 tablet_bootstrap.cc:492] T 03f866aefe33434da72b59b27643c7b5 P fca4bd6184db470a8693d9ba700f92e6: Bootstrap complete.
I20251214 21:04:59.625932 20583 ts_tablet_manager.cc:1403] T 03f866aefe33434da72b59b27643c7b5 P fca4bd6184db470a8693d9ba700f92e6: Time spent bootstrapping tablet: real 0.024s user 0.021s sys 0.003s
I20251214 21:04:59.626534 20583 raft_consensus.cc:359] T 03f866aefe33434da72b59b27643c7b5 P fca4bd6184db470a8693d9ba700f92e6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } } peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: NON_VOTER last_known_addr { host: "127.16.120.2" port: 46235 } attrs { promote: true } } peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 36667 } attrs { promote: true } }
I20251214 21:04:59.626673 20583 raft_consensus.cc:740] T 03f866aefe33434da72b59b27643c7b5 P fca4bd6184db470a8693d9ba700f92e6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: fca4bd6184db470a8693d9ba700f92e6, State: Initialized, Role: LEARNER
I20251214 21:04:59.626823 20583 consensus_queue.cc:260] T 03f866aefe33434da72b59b27643c7b5 P fca4bd6184db470a8693d9ba700f92e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 2.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 39925 } } peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: NON_VOTER last_known_addr { host: "127.16.120.2" port: 46235 } attrs { promote: true } } peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 36667 } attrs { promote: true } }
I20251214 21:04:59.627214 20583 ts_tablet_manager.cc:1434] T 03f866aefe33434da72b59b27643c7b5 P fca4bd6184db470a8693d9ba700f92e6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:59.627768 20586 tablet_bootstrap.cc:492] T 3814c8774e034c798a778688b3bb7cbe P 91af76edef3b41c1895b0594fcc764a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=350 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:59.627902 20168 tablet_copy_service.cc:342] P 91af76edef3b41c1895b0594fcc764a8: Request end of tablet copy session fca4bd6184db470a8693d9ba700f92e6-03f866aefe33434da72b59b27643c7b5 received from {username='slave'} at 127.16.120.3:40325
I20251214 21:04:59.627970 20168 tablet_copy_service.cc:434] P 91af76edef3b41c1895b0594fcc764a8: ending tablet copy session fca4bd6184db470a8693d9ba700f92e6-03f866aefe33434da72b59b27643c7b5 on tablet 03f866aefe33434da72b59b27643c7b5 with peer fca4bd6184db470a8693d9ba700f92e6
I20251214 21:04:59.628054 20586 tablet_bootstrap.cc:492] T 3814c8774e034c798a778688b3bb7cbe P 91af76edef3b41c1895b0594fcc764a8: Bootstrap complete.
I20251214 21:04:59.628196 20586 ts_tablet_manager.cc:1403] T 3814c8774e034c798a778688b3bb7cbe P 91af76edef3b41c1895b0594fcc764a8: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.001s
W20251214 21:04:59.628299 20478 heartbeater.cc:646] Failed to heartbeat to 127.16.120.62:39793 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.120.62:39793: connect: Connection refused (error 111)
I20251214 21:04:59.628774 20586 raft_consensus.cc:359] T 3814c8774e034c798a778688b3bb7cbe P 91af76edef3b41c1895b0594fcc764a8 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } } peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: NON_VOTER last_known_addr { host: "127.16.120.1" port: 39925 } attrs { promote: true } } peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 36667 } attrs { promote: true } }
I20251214 21:04:59.628909 20586 raft_consensus.cc:740] T 3814c8774e034c798a778688b3bb7cbe P 91af76edef3b41c1895b0594fcc764a8 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 91af76edef3b41c1895b0594fcc764a8, State: Initialized, Role: LEARNER
I20251214 21:04:59.629043 20586 consensus_queue.cc:260] T 3814c8774e034c798a778688b3bb7cbe P 91af76edef3b41c1895b0594fcc764a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 2.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } } peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: NON_VOTER last_known_addr { host: "127.16.120.1" port: 39925 } attrs { promote: true } } peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 36667 } attrs { promote: true } }
I20251214 21:04:59.629285 20586 ts_tablet_manager.cc:1434] T 3814c8774e034c798a778688b3bb7cbe P 91af76edef3b41c1895b0594fcc764a8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:04:59.629989 20310 tablet_copy_service.cc:342] P c44e69909f96434ab52b070ca1fda567: Request end of tablet copy session 91af76edef3b41c1895b0594fcc764a8-3814c8774e034c798a778688b3bb7cbe received from {username='slave'} at 127.16.120.1:52023
I20251214 21:04:59.630102 20310 tablet_copy_service.cc:434] P c44e69909f96434ab52b070ca1fda567: ending tablet copy session 91af76edef3b41c1895b0594fcc764a8-3814c8774e034c798a778688b3bb7cbe on tablet 3814c8774e034c798a778688b3bb7cbe with peer 91af76edef3b41c1895b0594fcc764a8
W20251214 21:04:59.630180 20194 heartbeater.cc:646] Failed to heartbeat to 127.16.120.62:39793 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.120.62:39793: connect: Connection refused (error 111)
I20251214 21:04:59.656623 20583 ts_tablet_manager.cc:933] T 3814c8774e034c798a778688b3bb7cbe P fca4bd6184db470a8693d9ba700f92e6: Initiating tablet copy from peer c44e69909f96434ab52b070ca1fda567 (127.16.120.2:46235)
I20251214 21:04:59.656972 20583 tablet_copy_client.cc:323] T 3814c8774e034c798a778688b3bb7cbe P fca4bd6184db470a8693d9ba700f92e6: tablet copy: Beginning tablet copy session from remote peer at address 127.16.120.2:46235
I20251214 21:04:59.660678 20310 tablet_copy_service.cc:140] P c44e69909f96434ab52b070ca1fda567: Received BeginTabletCopySession request for tablet 3814c8774e034c798a778688b3bb7cbe from peer fca4bd6184db470a8693d9ba700f92e6 ({username='slave'} at 127.16.120.3:58545)
I20251214 21:04:59.660789 20310 tablet_copy_service.cc:161] P c44e69909f96434ab52b070ca1fda567: Beginning new tablet copy session on tablet 3814c8774e034c798a778688b3bb7cbe from peer fca4bd6184db470a8693d9ba700f92e6 at {username='slave'} at 127.16.120.3:58545: session id = fca4bd6184db470a8693d9ba700f92e6-3814c8774e034c798a778688b3bb7cbe
I20251214 21:04:59.661662 20310 tablet_copy_source_session.cc:215] T 3814c8774e034c798a778688b3bb7cbe P c44e69909f96434ab52b070ca1fda567: Tablet Copy: opened 0 blocks and 1 log segments
I20251214 21:04:59.662542 20583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3814c8774e034c798a778688b3bb7cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:59.664690 20583 tablet_copy_client.cc:806] T 3814c8774e034c798a778688b3bb7cbe P fca4bd6184db470a8693d9ba700f92e6: tablet copy: Starting download of 0 data blocks...
I20251214 21:04:59.664882 20583 tablet_copy_client.cc:670] T 3814c8774e034c798a778688b3bb7cbe P fca4bd6184db470a8693d9ba700f92e6: tablet copy: Starting download of 1 WAL segments...
I20251214 21:04:59.665979 20583 tablet_copy_client.cc:538] T 3814c8774e034c798a778688b3bb7cbe P fca4bd6184db470a8693d9ba700f92e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251214 21:04:59.667165 20583 tablet_bootstrap.cc:492] T 3814c8774e034c798a778688b3bb7cbe P fca4bd6184db470a8693d9ba700f92e6: Bootstrap starting.
I20251214 21:04:59.681958 20583 tablet_bootstrap.cc:492] T 3814c8774e034c798a778688b3bb7cbe P fca4bd6184db470a8693d9ba700f92e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=350 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:04:59.682222 20583 tablet_bootstrap.cc:492] T 3814c8774e034c798a778688b3bb7cbe P fca4bd6184db470a8693d9ba700f92e6: Bootstrap complete.
I20251214 21:04:59.682376 20583 ts_tablet_manager.cc:1403] T 3814c8774e034c798a778688b3bb7cbe P fca4bd6184db470a8693d9ba700f92e6: Time spent bootstrapping tablet: real 0.015s user 0.016s sys 0.000s
I20251214 21:04:59.682819 20583 raft_consensus.cc:359] T 3814c8774e034c798a778688b3bb7cbe P fca4bd6184db470a8693d9ba700f92e6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } } peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: NON_VOTER last_known_addr { host: "127.16.120.1" port: 39925 } attrs { promote: true } } peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 36667 } attrs { promote: true } }
I20251214 21:04:59.682920 20583 raft_consensus.cc:740] T 3814c8774e034c798a778688b3bb7cbe P fca4bd6184db470a8693d9ba700f92e6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: fca4bd6184db470a8693d9ba700f92e6, State: Initialized, Role: LEARNER
I20251214 21:04:59.683017 20583 consensus_queue.cc:260] T 3814c8774e034c798a778688b3bb7cbe P fca4bd6184db470a8693d9ba700f92e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 2.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c44e69909f96434ab52b070ca1fda567" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 46235 } } peers { permanent_uuid: "91af76edef3b41c1895b0594fcc764a8" member_type: NON_VOTER last_known_addr { host: "127.16.120.1" port: 39925 } attrs { promote: true } } peers { permanent_uuid: "fca4bd6184db470a8693d9ba700f92e6" member_type: NON_VOTER last_known_addr { host: "127.16.120.3" port: 36667 } attrs { promote: true } }
I20251214 21:04:59.683285 20583 ts_tablet_manager.cc:1434] T 3814c8774e034c798a778688b3bb7cbe P fca4bd6184db470a8693d9ba700f92e6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251214 21:04:59.684041 20310 tablet_copy_service.cc:342] P c44e69909f96434ab52b070ca1fda567: Request end of tablet copy session fca4bd6184db470a8693d9ba700f92e6-3814c8774e034c798a778688b3bb7cbe received from {username='slave'} at 127.16.120.3:58545
I20251214 21:04:59.684139 20310 tablet_copy_service.cc:434] P c44e69909f96434ab52b070ca1fda567: ending tablet copy session fca4bd6184db470a8693d9ba700f92e6-3814c8774e034c798a778688b3bb7cbe on tablet 3814c8774e034c798a778688b3bb7cbe with peer fca4bd6184db470a8693d9ba700f92e6
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tools/kudu-admin-test.cc:3916: Failure
Value of: stdout2
Expected: has substring "Rebuilt from 3 replicas, of which 0 had errors"
Actual: "Rebuild Report\nTablet Servers\n address | status\n--------------------+--------\n 127.16.120.1:39925 | OK\n 127.16.120.2:46235 | OK\n 127.16.120.3:36667 | OK\nRebuilt from 3 tablet servers, of which 0 had errors\n\nReplicas\n table | tablet | tablet server | status\n-----------+----------------------------------+--------------------+--------\n TestTable | 03f866aefe33434da72b59b27643c7b5 | 127.16.120.1:39925 | OK\nRebuilt from 1 replicas, of which 0 had errors\n"
I20251214 21:04:59.766335 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 20045
I20251214 21:04:59.771723 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 20199
I20251214 21:04:59.776786 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 20339
2025-12-14T21:04:59Z chronyd exiting
I20251214 21:04:59.792927 16864 test_util.cc:183] -----------------------------------------------
I20251214 21:04:59.792981 16864 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765746286170956-16864-0
[ FAILED ] AdminCliTest.TestRebuildTables (2960 ms)
[----------] 5 tests from AdminCliTest (13612 ms total)
[----------] 1 test from EnableKudu1097AndDownTS/MoveTabletParamTest
[ RUN ] EnableKudu1097AndDownTS/MoveTabletParamTest.Test/4
I20251214 21:04:59.793637 16864 test_util.cc:276] Using random seed: -654937888
I20251214 21:04:59.794380 16864 ts_itest-base.cc:115] Starting cluster with:
I20251214 21:04:59.794417 16864 ts_itest-base.cc:116] --------------
I20251214 21:04:59.794431 16864 ts_itest-base.cc:117] 5 tablet servers
I20251214 21:04:59.794445 16864 ts_itest-base.cc:118] 3 replicas per TS
I20251214 21:04:59.794473 16864 ts_itest-base.cc:119] --------------
2025-12-14T21:04:59Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-14T21:04:59Z Disabled control of system clock
I20251214 21:04:59.802515 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:38293
--webserver_interface=127.16.120.62
--webserver_port=0
--builtin_ntp_servers=127.16.120.20:41361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.120.62:38293
--raft_prepare_replacement_before_eviction=true with env {}
W20251214 21:04:59.909299 20601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:04:59.909535 20601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:04:59.909592 20601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:04:59.912830 20601 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251214 21:04:59.912901 20601 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251214 21:04:59.912930 20601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:04:59.912967 20601 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251214 21:04:59.913000 20601 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251214 21:04:59.916864 20601 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.120.62:38293
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:38293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.16.120.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.20601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:04:59.917989 20601 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:04:59.919086 20601 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:04:59.924384 20606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:04:59.924448 20607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:59.924507 20601 server_base.cc:1047] running on GCE node
W20251214 21:04:59.924417 20609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:04:59.925040 20601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:04:59.925944 20601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:04:59.927100 20601 hybrid_clock.cc:648] HybridClock initialized: now 1765746299927089 us; error 28 us; skew 500 ppm
I20251214 21:04:59.928789 20601 webserver.cc:492] Webserver started at http://127.16.120.62:40679/ using document root <none> and password file <none>
I20251214 21:04:59.929312 20601 fs_manager.cc:362] Metadata directory not provided
I20251214 21:04:59.929370 20601 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:04:59.929548 20601 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:04:59.931051 20601 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "77f0ded1b7584579bbbe39f48bc0f762"
format_stamp: "Formatted at 2025-12-14 21:04:59 on dist-test-slave-8rzr"
I20251214 21:04:59.931489 20601 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "77f0ded1b7584579bbbe39f48bc0f762"
format_stamp: "Formatted at 2025-12-14 21:04:59 on dist-test-slave-8rzr"
I20251214 21:04:59.934554 20601 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251214 21:04:59.936461 20615 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:04:59.937376 20601 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:04:59.937481 20601 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
uuid: "77f0ded1b7584579bbbe39f48bc0f762"
format_stamp: "Formatted at 2025-12-14 21:04:59 on dist-test-slave-8rzr"
I20251214 21:04:59.937556 20601 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:04:59.969954 20601 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:04:59.970640 20601 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:04:59.970810 20601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:04:59.977555 20667 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.62:38293 every 8 connection(s)
I20251214 21:04:59.977561 20601 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.62:38293
I20251214 21:04:59.978586 20601 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251214 21:04:59.981261 20668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:04:59.986042 20668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762: Bootstrap starting.
I20251214 21:04:59.987708 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 20601
I20251214 21:04:59.987815 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251214 21:04:59.988206 20668 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762: Neither blocks nor log segments found. Creating new log.
I20251214 21:04:59.988960 20668 log.cc:826] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762: Log is configured to *not* fsync() on all Append() calls
I20251214 21:04:59.990880 20668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762: No bootstrap required, opened a new log
I20251214 21:04:59.993803 20668 raft_consensus.cc:359] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f0ded1b7584579bbbe39f48bc0f762" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 38293 } }
I20251214 21:04:59.994029 20668 raft_consensus.cc:385] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:04:59.994089 20668 raft_consensus.cc:740] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77f0ded1b7584579bbbe39f48bc0f762, State: Initialized, Role: FOLLOWER
I20251214 21:04:59.994540 20668 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f0ded1b7584579bbbe39f48bc0f762" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 38293 } }
I20251214 21:04:59.994725 20668 raft_consensus.cc:399] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:04:59.994791 20668 raft_consensus.cc:493] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:04:59.994881 20668 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:04:59.995604 20668 raft_consensus.cc:515] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f0ded1b7584579bbbe39f48bc0f762" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 38293 } }
I20251214 21:04:59.995934 20668 leader_election.cc:304] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77f0ded1b7584579bbbe39f48bc0f762; no voters:
I20251214 21:04:59.996233 20668 leader_election.cc:290] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:04:59.996317 20673 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:04:59.996529 20673 raft_consensus.cc:697] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [term 1 LEADER]: Becoming Leader. State: Replica: 77f0ded1b7584579bbbe39f48bc0f762, State: Running, Role: LEADER
I20251214 21:04:59.996847 20673 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f0ded1b7584579bbbe39f48bc0f762" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 38293 } }
I20251214 21:04:59.997426 20668 sys_catalog.cc:565] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:04:59.998485 20675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77f0ded1b7584579bbbe39f48bc0f762. Latest consensus state: current_term: 1 leader_uuid: "77f0ded1b7584579bbbe39f48bc0f762" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f0ded1b7584579bbbe39f48bc0f762" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 38293 } } }
I20251214 21:04:59.998600 20675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [sys.catalog]: This master's current role is: LEADER
I20251214 21:04:59.998961 20682 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:04:59.999519 20674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77f0ded1b7584579bbbe39f48bc0f762" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f0ded1b7584579bbbe39f48bc0f762" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 38293 } } }
I20251214 21:04:59.999612 20674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762 [sys.catalog]: This master's current role is: LEADER
I20251214 21:05:00.002009 20682 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:05:00.007407 20682 catalog_manager.cc:1357] Generated new cluster ID: afe0eca074b64cdbb9689366920afb88
I20251214 21:05:00.007467 20682 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:05:00.024504 20682 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:05:00.025334 20682 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:05:00.030948 20682 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 77f0ded1b7584579bbbe39f48bc0f762: Generated new TSK 0
I20251214 21:05:00.031569 20682 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:05:00.036173 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.1:0
--local_ip_for_outbound_sockets=127.16.120.1
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:38293
--builtin_ntp_servers=127.16.120.20:41361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20251214 21:05:00.139194 20692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:00.139396 20692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:00.139461 20692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:00.142714 20692 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251214 21:05:00.142781 20692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:00.142863 20692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.1
I20251214 21:05:00.146525 20692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:38293
--never_fsync=true
--heap_profile_path=/tmp/kudu.20692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.1
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:00.147539 20692 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:00.148620 20692 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:00.154959 20700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:00.154945 20698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:00.154924 20697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:00.155185 20692 server_base.cc:1047] running on GCE node
I20251214 21:05:00.155696 20692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:00.156216 20692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:00.157361 20692 hybrid_clock.cc:648] HybridClock initialized: now 1765746300157343 us; error 38 us; skew 500 ppm
I20251214 21:05:00.159010 20692 webserver.cc:492] Webserver started at http://127.16.120.1:32991/ using document root <none> and password file <none>
I20251214 21:05:00.159538 20692 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:00.159593 20692 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:00.159780 20692 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:05:00.161278 20692 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "27ed73fa615a46c4a1d68a7343e3ae2c"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.161715 20692 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "27ed73fa615a46c4a1d68a7343e3ae2c"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.164866 20692 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20251214 21:05:00.166985 20706 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.167961 20692 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251214 21:05:00.168056 20692 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "27ed73fa615a46c4a1d68a7343e3ae2c"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.168139 20692 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:00.189765 20692 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:00.190546 20692 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:00.190734 20692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:00.191390 20692 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:05:00.192526 20692 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:05:00.192574 20692 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.192611 20692 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:05:00.192625 20692 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.201429 20692 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.1:40979
I20251214 21:05:00.201457 20822 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.1:40979 every 8 connection(s)
I20251214 21:05:00.202466 20692 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251214 21:05:00.210829 20823 heartbeater.cc:344] Connected to a master server at 127.16.120.62:38293
I20251214 21:05:00.211063 20823 heartbeater.cc:461] Registering TS with master...
I20251214 21:05:00.211607 20823 heartbeater.cc:507] Master 127.16.120.62:38293 requested a full tablet report, sending...
I20251214 21:05:00.211984 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 20692
I20251214 21:05:00.212100 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251214 21:05:00.213106 20632 ts_manager.cc:194] Registered new tserver with Master: 27ed73fa615a46c4a1d68a7343e3ae2c (127.16.120.1:40979)
I20251214 21:05:00.214314 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.2:0
--local_ip_for_outbound_sockets=127.16.120.2
--webserver_interface=127.16.120.2
--webserver_port=0
--tserver_master_addrs=127.16.120.62:38293
--builtin_ntp_servers=127.16.120.20:41361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20251214 21:05:00.214561 20632 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.1:58141
W20251214 21:05:00.319087 20826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:00.319334 20826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:00.319427 20826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:00.322817 20826 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251214 21:05:00.322893 20826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:00.322983 20826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.2
I20251214 21:05:00.326836 20826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.16.120.2
--webserver_port=0
--tserver_master_addrs=127.16.120.62:38293
--never_fsync=true
--heap_profile_path=/tmp/kudu.20826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.2
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:00.327929 20826 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:00.329051 20826 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:00.335426 20834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:00.335426 20831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:00.335481 20832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:00.335681 20826 server_base.cc:1047] running on GCE node
I20251214 21:05:00.336020 20826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:00.336555 20826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:00.337702 20826 hybrid_clock.cc:648] HybridClock initialized: now 1765746300337689 us; error 29 us; skew 500 ppm
I20251214 21:05:00.339352 20826 webserver.cc:492] Webserver started at http://127.16.120.2:34197/ using document root <none> and password file <none>
I20251214 21:05:00.339911 20826 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:00.339970 20826 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:00.340138 20826 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:05:00.341691 20826 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "74446e7d25204d5e95beaa5705353a73"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.342186 20826 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "74446e7d25204d5e95beaa5705353a73"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.345319 20826 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20251214 21:05:00.347455 20840 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.348452 20826 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20251214 21:05:00.348567 20826 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "74446e7d25204d5e95beaa5705353a73"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.348645 20826 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:00.369947 20826 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:00.370617 20826 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:00.370785 20826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:00.371345 20826 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:05:00.372351 20826 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:05:00.372400 20826 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.372452 20826 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:05:00.372488 20826 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.381230 20826 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.2:38443
I20251214 21:05:00.381270 20954 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.2:38443 every 8 connection(s)
I20251214 21:05:00.382157 20826 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251214 21:05:00.390481 20955 heartbeater.cc:344] Connected to a master server at 127.16.120.62:38293
I20251214 21:05:00.390748 20955 heartbeater.cc:461] Registering TS with master...
I20251214 21:05:00.391036 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 20826
I20251214 21:05:00.391160 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251214 21:05:00.391479 20955 heartbeater.cc:507] Master 127.16.120.62:38293 requested a full tablet report, sending...
I20251214 21:05:00.392429 20631 ts_manager.cc:194] Registered new tserver with Master: 74446e7d25204d5e95beaa5705353a73 (127.16.120.2:38443)
I20251214 21:05:00.393003 20631 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.2:45201
I20251214 21:05:00.393492 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.3:0
--local_ip_for_outbound_sockets=127.16.120.3
--webserver_interface=127.16.120.3
--webserver_port=0
--tserver_master_addrs=127.16.120.62:38293
--builtin_ntp_servers=127.16.120.20:41361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20251214 21:05:00.498042 20958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:00.498261 20958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:00.498318 20958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:00.501546 20958 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251214 21:05:00.501611 20958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:00.501698 20958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.3
I20251214 21:05:00.505332 20958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.16.120.3
--webserver_port=0
--tserver_master_addrs=127.16.120.62:38293
--never_fsync=true
--heap_profile_path=/tmp/kudu.20958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.3
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:00.506389 20958 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:00.507480 20958 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:00.513788 20966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:00.513821 20963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:00.513789 20964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:00.514031 20958 server_base.cc:1047] running on GCE node
I20251214 21:05:00.514436 20958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:00.515014 20958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:00.516187 20958 hybrid_clock.cc:648] HybridClock initialized: now 1765746300516175 us; error 27 us; skew 500 ppm
I20251214 21:05:00.518051 20958 webserver.cc:492] Webserver started at http://127.16.120.3:41353/ using document root <none> and password file <none>
I20251214 21:05:00.518600 20958 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:00.518666 20958 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:00.518882 20958 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:05:00.520431 20958 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "240db3de68a743aeb9ccf46b9b07f09a"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.520891 20958 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "240db3de68a743aeb9ccf46b9b07f09a"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.524258 20958 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20251214 21:05:00.526367 20972 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.527349 20958 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:05:00.527503 20958 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "240db3de68a743aeb9ccf46b9b07f09a"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.527588 20958 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:00.542752 20958 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:00.543450 20958 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:00.543625 20958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:00.544183 20958 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:05:00.545171 20958 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:05:00.545224 20958 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.545280 20958 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:05:00.545308 20958 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.554709 20958 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.3:37731
I20251214 21:05:00.554739 21086 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.3:37731 every 8 connection(s)
I20251214 21:05:00.555634 20958 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251214 21:05:00.559607 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 20958
I20251214 21:05:00.559715 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251214 21:05:00.561865 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.4:0
--local_ip_for_outbound_sockets=127.16.120.4
--webserver_interface=127.16.120.4
--webserver_port=0
--tserver_master_addrs=127.16.120.62:38293
--builtin_ntp_servers=127.16.120.20:41361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20251214 21:05:00.564471 21087 heartbeater.cc:344] Connected to a master server at 127.16.120.62:38293
I20251214 21:05:00.564700 21087 heartbeater.cc:461] Registering TS with master...
I20251214 21:05:00.565199 21087 heartbeater.cc:507] Master 127.16.120.62:38293 requested a full tablet report, sending...
I20251214 21:05:00.566192 20631 ts_manager.cc:194] Registered new tserver with Master: 240db3de68a743aeb9ccf46b9b07f09a (127.16.120.3:37731)
I20251214 21:05:00.566735 20631 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.3:58083
W20251214 21:05:00.668989 21090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:00.669210 21090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:00.669270 21090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:00.672621 21090 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251214 21:05:00.672693 21090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:00.672780 21090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.4
I20251214 21:05:00.676607 21090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.16.120.4
--webserver_port=0
--tserver_master_addrs=127.16.120.62:38293
--never_fsync=true
--heap_profile_path=/tmp/kudu.21090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.4
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:00.677736 21090 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:00.678866 21090 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:00.685508 21095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:00.685598 21098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:00.685530 21096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:00.685750 21090 server_base.cc:1047] running on GCE node
I20251214 21:05:00.686147 21090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:00.686709 21090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:00.687855 21090 hybrid_clock.cc:648] HybridClock initialized: now 1765746300687844 us; error 26 us; skew 500 ppm
I20251214 21:05:00.689483 21090 webserver.cc:492] Webserver started at http://127.16.120.4:41251/ using document root <none> and password file <none>
I20251214 21:05:00.690074 21090 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:00.690133 21090 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:00.690317 21090 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:05:00.692158 21090 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "ff729ae240f6400984fd4a96b1de3c94"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.692624 21090 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "ff729ae240f6400984fd4a96b1de3c94"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.695933 21090 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20251214 21:05:00.698024 21104 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.699050 21090 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:05:00.699141 21090 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "ff729ae240f6400984fd4a96b1de3c94"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.699225 21090 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:00.731835 21090 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:00.732470 21090 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:00.732613 21090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:00.733107 21090 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:05:00.734038 21090 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:05:00.734083 21090 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.734120 21090 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:05:00.734139 21090 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.742641 21090 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.4:39467
I20251214 21:05:00.742691 21218 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.4:39467 every 8 connection(s)
I20251214 21:05:00.743539 21090 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20251214 21:05:00.748314 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 21090
I20251214 21:05:00.748414 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20251214 21:05:00.750533 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.5:0
--local_ip_for_outbound_sockets=127.16.120.5
--webserver_interface=127.16.120.5
--webserver_port=0
--tserver_master_addrs=127.16.120.62:38293
--builtin_ntp_servers=127.16.120.20:41361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20251214 21:05:00.752234 21219 heartbeater.cc:344] Connected to a master server at 127.16.120.62:38293
I20251214 21:05:00.752461 21219 heartbeater.cc:461] Registering TS with master...
I20251214 21:05:00.753026 21219 heartbeater.cc:507] Master 127.16.120.62:38293 requested a full tablet report, sending...
I20251214 21:05:00.753978 20631 ts_manager.cc:194] Registered new tserver with Master: ff729ae240f6400984fd4a96b1de3c94 (127.16.120.4:39467)
I20251214 21:05:00.754539 20631 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.4:51555
W20251214 21:05:00.856065 21222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:00.856369 21222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:00.856492 21222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:00.859952 21222 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251214 21:05:00.860028 21222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:00.860122 21222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.5
I20251214 21:05:00.864085 21222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.5:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.16.120.5
--webserver_port=0
--tserver_master_addrs=127.16.120.62:38293
--never_fsync=true
--heap_profile_path=/tmp/kudu.21222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.5
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:00.865132 21222 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:00.866253 21222 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:00.872530 21230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:00.872519 21228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:00.872658 21222 server_base.cc:1047] running on GCE node
W20251214 21:05:00.872519 21227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:00.873095 21222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:00.873600 21222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:00.874742 21222 hybrid_clock.cc:648] HybridClock initialized: now 1765746300874721 us; error 37 us; skew 500 ppm
I20251214 21:05:00.876343 21222 webserver.cc:492] Webserver started at http://127.16.120.5:40477/ using document root <none> and password file <none>
I20251214 21:05:00.876865 21222 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:00.876917 21222 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:00.877075 21222 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:05:00.878584 21222 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "8bca10f9ac4e4045adaa0074a38efcf6"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.879025 21222 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "8bca10f9ac4e4045adaa0074a38efcf6"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.882133 21222 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251214 21:05:00.884239 21236 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.885253 21222 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:05:00.885349 21222 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "8bca10f9ac4e4045adaa0074a38efcf6"
format_stamp: "Formatted at 2025-12-14 21:05:00 on dist-test-slave-8rzr"
I20251214 21:05:00.885422 21222 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:00.897640 21222 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:00.898249 21222 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:00.898396 21222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:00.898968 21222 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:05:00.899912 21222 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:05:00.899958 21222 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.900005 21222 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:05:00.900029 21222 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:00.908437 21222 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.5:35677
I20251214 21:05:00.908495 21351 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.5:35677 every 8 connection(s)
I20251214 21:05:00.909349 21222 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20251214 21:05:00.916254 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 21222
I20251214 21:05:00.916378 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20251214 21:05:00.918149 21352 heartbeater.cc:344] Connected to a master server at 127.16.120.62:38293
I20251214 21:05:00.918366 21352 heartbeater.cc:461] Registering TS with master...
I20251214 21:05:00.918907 21352 heartbeater.cc:507] Master 127.16.120.62:38293 requested a full tablet report, sending...
I20251214 21:05:00.919867 20631 ts_manager.cc:194] Registered new tserver with Master: 8bca10f9ac4e4045adaa0074a38efcf6 (127.16.120.5:35677)
I20251214 21:05:00.920398 20631 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.5:54835
I20251214 21:05:00.930691 16864 external_mini_cluster.cc:949] 5 TS(s) registered with all masters
I20251214 21:05:00.938983 20631 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55552:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20251214 21:05:00.956916 20889 tablet_service.cc:1505] Processing CreateTablet for tablet 4c75eea66813484da371537463e52876 (DEFAULT_TABLE table=TestTable [id=4d8b0e4718154884a708e52ba226bd03]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:05:00.956974 21284 tablet_service.cc:1505] Processing CreateTablet for tablet 4c75eea66813484da371537463e52876 (DEFAULT_TABLE table=TestTable [id=4d8b0e4718154884a708e52ba226bd03]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:05:00.956975 21153 tablet_service.cc:1505] Processing CreateTablet for tablet 4c75eea66813484da371537463e52876 (DEFAULT_TABLE table=TestTable [id=4d8b0e4718154884a708e52ba226bd03]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:05:00.957791 20889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c75eea66813484da371537463e52876. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:05:00.957860 21153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c75eea66813484da371537463e52876. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:05:00.957871 21284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c75eea66813484da371537463e52876. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:05:00.962571 21369 tablet_bootstrap.cc:492] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73: Bootstrap starting.
I20251214 21:05:00.963802 21371 tablet_bootstrap.cc:492] T 4c75eea66813484da371537463e52876 P ff729ae240f6400984fd4a96b1de3c94: Bootstrap starting.
I20251214 21:05:00.964203 21370 tablet_bootstrap.cc:492] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6: Bootstrap starting.
I20251214 21:05:00.965135 21369 tablet_bootstrap.cc:654] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73: Neither blocks nor log segments found. Creating new log.
I20251214 21:05:00.965739 21371 tablet_bootstrap.cc:654] T 4c75eea66813484da371537463e52876 P ff729ae240f6400984fd4a96b1de3c94: Neither blocks nor log segments found. Creating new log.
I20251214 21:05:00.965914 21370 tablet_bootstrap.cc:654] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6: Neither blocks nor log segments found. Creating new log.
I20251214 21:05:00.965989 21369 log.cc:826] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73: Log is configured to *not* fsync() on all Append() calls
I20251214 21:05:00.966593 21370 log.cc:826] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6: Log is configured to *not* fsync() on all Append() calls
I20251214 21:05:00.966629 21371 log.cc:826] T 4c75eea66813484da371537463e52876 P ff729ae240f6400984fd4a96b1de3c94: Log is configured to *not* fsync() on all Append() calls
I20251214 21:05:00.967689 21369 tablet_bootstrap.cc:492] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73: No bootstrap required, opened a new log
I20251214 21:05:00.967856 21369 ts_tablet_manager.cc:1403] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20251214 21:05:00.968104 21371 tablet_bootstrap.cc:492] T 4c75eea66813484da371537463e52876 P ff729ae240f6400984fd4a96b1de3c94: No bootstrap required, opened a new log
I20251214 21:05:00.968104 21370 tablet_bootstrap.cc:492] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6: No bootstrap required, opened a new log
I20251214 21:05:00.968271 21370 ts_tablet_manager.cc:1403] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20251214 21:05:00.968271 21371 ts_tablet_manager.cc:1403] T 4c75eea66813484da371537463e52876 P ff729ae240f6400984fd4a96b1de3c94: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20251214 21:05:00.970350 21369 raft_consensus.cc:359] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74446e7d25204d5e95beaa5705353a73" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 38443 } } peers { permanent_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" member_type: VOTER last_known_addr { host: "127.16.120.5" port: 35677 } } peers { permanent_uuid: "ff729ae240f6400984fd4a96b1de3c94" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 39467 } }
I20251214 21:05:00.970525 21369 raft_consensus.cc:385] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:05:00.970574 21369 raft_consensus.cc:740] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74446e7d25204d5e95beaa5705353a73, State: Initialized, Role: FOLLOWER
I20251214 21:05:00.970953 21369 consensus_queue.cc:260] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74446e7d25204d5e95beaa5705353a73" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 38443 } } peers { permanent_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" member_type: VOTER last_known_addr { host: "127.16.120.5" port: 35677 } } peers { permanent_uuid: "ff729ae240f6400984fd4a96b1de3c94" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 39467 } }
I20251214 21:05:00.971148 21370 raft_consensus.cc:359] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74446e7d25204d5e95beaa5705353a73" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 38443 } } peers { permanent_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" member_type: VOTER last_known_addr { host: "127.16.120.5" port: 35677 } } peers { permanent_uuid: "ff729ae240f6400984fd4a96b1de3c94" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 39467 } }
I20251214 21:05:00.971150 21371 raft_consensus.cc:359] T 4c75eea66813484da371537463e52876 P ff729ae240f6400984fd4a96b1de3c94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74446e7d25204d5e95beaa5705353a73" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 38443 } } peers { permanent_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" member_type: VOTER last_known_addr { host: "127.16.120.5" port: 35677 } } peers { permanent_uuid: "ff729ae240f6400984fd4a96b1de3c94" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 39467 } }
I20251214 21:05:00.971341 21370 raft_consensus.cc:385] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:05:00.971341 21371 raft_consensus.cc:385] T 4c75eea66813484da371537463e52876 P ff729ae240f6400984fd4a96b1de3c94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:05:00.971396 21371 raft_consensus.cc:740] T 4c75eea66813484da371537463e52876 P ff729ae240f6400984fd4a96b1de3c94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff729ae240f6400984fd4a96b1de3c94, State: Initialized, Role: FOLLOWER
I20251214 21:05:00.971405 21370 raft_consensus.cc:740] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bca10f9ac4e4045adaa0074a38efcf6, State: Initialized, Role: FOLLOWER
I20251214 21:05:00.971715 20955 heartbeater.cc:499] Master 127.16.120.62:38293 was elected leader, sending a full tablet report...
I20251214 21:05:00.971764 21369 ts_tablet_manager.cc:1434] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20251214 21:05:00.971834 21371 consensus_queue.cc:260] T 4c75eea66813484da371537463e52876 P ff729ae240f6400984fd4a96b1de3c94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74446e7d25204d5e95beaa5705353a73" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 38443 } } peers { permanent_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" member_type: VOTER last_known_addr { host: "127.16.120.5" port: 35677 } } peers { permanent_uuid: "ff729ae240f6400984fd4a96b1de3c94" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 39467 } }
I20251214 21:05:00.971877 21370 consensus_queue.cc:260] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74446e7d25204d5e95beaa5705353a73" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 38443 } } peers { permanent_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" member_type: VOTER last_known_addr { host: "127.16.120.5" port: 35677 } } peers { permanent_uuid: "ff729ae240f6400984fd4a96b1de3c94" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 39467 } }
I20251214 21:05:00.972627 21371 ts_tablet_manager.cc:1434] T 4c75eea66813484da371537463e52876 P ff729ae240f6400984fd4a96b1de3c94: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20251214 21:05:00.972627 21370 ts_tablet_manager.cc:1434] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20251214 21:05:00.972652 21219 heartbeater.cc:499] Master 127.16.120.62:38293 was elected leader, sending a full tablet report...
I20251214 21:05:00.973724 21352 heartbeater.cc:499] Master 127.16.120.62:38293 was elected leader, sending a full tablet report...
W20251214 21:05:00.994350 21220 tablet.cc:2378] T 4c75eea66813484da371537463e52876 P ff729ae240f6400984fd4a96b1de3c94: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:05:01.133229 21376 raft_consensus.cc:493] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251214 21:05:01.133445 20956 tablet.cc:2378] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:05:01.133463 21376 raft_consensus.cc:515] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74446e7d25204d5e95beaa5705353a73" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 38443 } } peers { permanent_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" member_type: VOTER last_known_addr { host: "127.16.120.5" port: 35677 } } peers { permanent_uuid: "ff729ae240f6400984fd4a96b1de3c94" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 39467 } }
I20251214 21:05:01.134776 21376 leader_election.cc:290] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74446e7d25204d5e95beaa5705353a73 (127.16.120.2:38443), ff729ae240f6400984fd4a96b1de3c94 (127.16.120.4:39467)
I20251214 21:05:01.138769 20909 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c75eea66813484da371537463e52876" candidate_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74446e7d25204d5e95beaa5705353a73" is_pre_election: true
I20251214 21:05:01.139032 20909 raft_consensus.cc:2468] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bca10f9ac4e4045adaa0074a38efcf6 in term 0.
I20251214 21:05:01.139114 21173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c75eea66813484da371537463e52876" candidate_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff729ae240f6400984fd4a96b1de3c94" is_pre_election: true
I20251214 21:05:01.139370 21173 raft_consensus.cc:2468] T 4c75eea66813484da371537463e52876 P ff729ae240f6400984fd4a96b1de3c94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bca10f9ac4e4045adaa0074a38efcf6 in term 0.
I20251214 21:05:01.139484 21239 leader_election.cc:304] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74446e7d25204d5e95beaa5705353a73, 8bca10f9ac4e4045adaa0074a38efcf6; no voters:
I20251214 21:05:01.139726 21376 raft_consensus.cc:2804] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:05:01.139796 21376 raft_consensus.cc:493] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:05:01.139847 21376 raft_consensus.cc:3060] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:05:01.140811 21376 raft_consensus.cc:515] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74446e7d25204d5e95beaa5705353a73" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 38443 } } peers { permanent_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" member_type: VOTER last_known_addr { host: "127.16.120.5" port: 35677 } } peers { permanent_uuid: "ff729ae240f6400984fd4a96b1de3c94" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 39467 } }
I20251214 21:05:01.141148 21376 leader_election.cc:290] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [CANDIDATE]: Term 1 election: Requested vote from peers 74446e7d25204d5e95beaa5705353a73 (127.16.120.2:38443), ff729ae240f6400984fd4a96b1de3c94 (127.16.120.4:39467)
I20251214 21:05:01.141479 20909 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c75eea66813484da371537463e52876" candidate_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74446e7d25204d5e95beaa5705353a73"
I20251214 21:05:01.141515 21173 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c75eea66813484da371537463e52876" candidate_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff729ae240f6400984fd4a96b1de3c94"
I20251214 21:05:01.141590 20909 raft_consensus.cc:3060] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:05:01.141623 21173 raft_consensus.cc:3060] T 4c75eea66813484da371537463e52876 P ff729ae240f6400984fd4a96b1de3c94 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:05:01.142508 20909 raft_consensus.cc:2468] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bca10f9ac4e4045adaa0074a38efcf6 in term 1.
I20251214 21:05:01.142786 21239 leader_election.cc:304] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74446e7d25204d5e95beaa5705353a73, 8bca10f9ac4e4045adaa0074a38efcf6; no voters:
I20251214 21:05:01.142889 21173 raft_consensus.cc:2468] T 4c75eea66813484da371537463e52876 P ff729ae240f6400984fd4a96b1de3c94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bca10f9ac4e4045adaa0074a38efcf6 in term 1.
I20251214 21:05:01.142937 21376 raft_consensus.cc:2804] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:05:01.143126 21376 raft_consensus.cc:697] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [term 1 LEADER]: Becoming Leader. State: Replica: 8bca10f9ac4e4045adaa0074a38efcf6, State: Running, Role: LEADER
I20251214 21:05:01.143455 21376 consensus_queue.cc:237] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74446e7d25204d5e95beaa5705353a73" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 38443 } } peers { permanent_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" member_type: VOTER last_known_addr { host: "127.16.120.5" port: 35677 } } peers { permanent_uuid: "ff729ae240f6400984fd4a96b1de3c94" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 39467 } }
I20251214 21:05:01.146441 20629 catalog_manager.cc:5654] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bca10f9ac4e4045adaa0074a38efcf6 (127.16.120.5). New cstate: current_term: 1 leader_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74446e7d25204d5e95beaa5705353a73" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 38443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bca10f9ac4e4045adaa0074a38efcf6" member_type: VOTER last_known_addr { host: "127.16.120.5" port: 35677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff729ae240f6400984fd4a96b1de3c94" member_type: VOTER last_known_addr { host: "127.16.120.4" port: 39467 } health_report { overall_health: UNKNOWN } } }
W20251214 21:05:01.160243 21353 tablet.cc:2378] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:05:01.183208 16864 external_mini_cluster.cc:949] 5 TS(s) registered with all masters
I20251214 21:05:01.184506 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 74446e7d25204d5e95beaa5705353a73 to finish bootstrapping
I20251214 21:05:01.189599 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver ff729ae240f6400984fd4a96b1de3c94 to finish bootstrapping
I20251214 21:05:01.194689 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 8bca10f9ac4e4045adaa0074a38efcf6 to finish bootstrapping
I20251214 21:05:01.199594 16864 test_util.cc:276] Using random seed: -653531928
I20251214 21:05:01.208232 16864 test_workload.cc:405] TestWorkload: Skipping table creation because table TestTable already exists
I20251214 21:05:01.208461 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 21090
I20251214 21:05:01.217044 20823 heartbeater.cc:499] Master 127.16.120.62:38293 was elected leader, sending a full tablet report...
W20251214 21:05:01.226437 21237 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.120.4:39467: connect: Connection refused (error 111)
I20251214 21:05:01.226830 20909 raft_consensus.cc:1275] T 4c75eea66813484da371537463e52876 P 74446e7d25204d5e95beaa5705353a73 [term 1 FOLLOWER]: Refusing update from remote peer 8bca10f9ac4e4045adaa0074a38efcf6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:05:01.227418 21376 consensus_queue.cc:1048] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74446e7d25204d5e95beaa5705353a73" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 38443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251214 21:05:01.227581 21237 consensus_peers.cc:597] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 -> Peer ff729ae240f6400984fd4a96b1de3c94 (127.16.120.4:39467): Couldn't send request to peer ff729ae240f6400984fd4a96b1de3c94. Status: Network error: Client connection negotiation failed: client connection to 127.16.120.4:39467: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251214 21:05:01.234910 21392 mvcc.cc:204] Tried to move back new op lower bound from 7232496849817894912 to 7232496849486266368. Current Snapshot: MvccSnapshot[applied={T|T < 7232496849817894912}]
I20251214 21:05:01.437919 21284 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251214 21:05:01.438298 20755 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:01.441033 21021 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:01.444640 20889 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:01.568584 21087 heartbeater.cc:499] Master 127.16.120.62:38293 was elected leader, sending a full tablet report...
I20251214 21:05:02.536648 21021 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:02.541877 20755 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:02.545091 20889 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:02.550678 21284 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20251214 21:05:03.482913 21237 consensus_peers.cc:597] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 -> Peer ff729ae240f6400984fd4a96b1de3c94 (127.16.120.4:39467): Couldn't send request to peer ff729ae240f6400984fd4a96b1de3c94. Status: Network error: Client connection negotiation failed: client connection to 127.16.120.4:39467: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20251214 21:05:03.630324 20755 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:03.632915 21021 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:03.638736 21284 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251214 21:05:03.640883 20889 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:04.724622 21021 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:04.725739 20889 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:04.727957 21284 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251214 21:05:04.738914 20755 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:05.823240 20889 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:05.823395 21021 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:05.826890 21284 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251214 21:05:05.833541 20755 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20251214 21:05:06.002475 21237 consensus_peers.cc:597] T 4c75eea66813484da371537463e52876 P 8bca10f9ac4e4045adaa0074a38efcf6 -> Peer ff729ae240f6400984fd4a96b1de3c94 (127.16.120.4:39467): Couldn't send request to peer ff729ae240f6400984fd4a96b1de3c94. Status: Network error: Client connection negotiation failed: client connection to 127.16.120.4:39467: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20251214 21:05:06.470983 21237 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.120.4:39467: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20251214 21:05:06.869910 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 20692
I20251214 21:05:06.876751 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 20826
I20251214 21:05:06.882365 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 20958
I20251214 21:05:06.887666 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 21222
I20251214 21:05:06.892930 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 20601
2025-12-14T21:05:06Z chronyd exiting
[ OK ] EnableKudu1097AndDownTS/MoveTabletParamTest.Test/4 (7120 ms)
[----------] 1 test from EnableKudu1097AndDownTS/MoveTabletParamTest (7121 ms total)
[----------] 1 test from ListTableCliSimpleParamTest
[ RUN ] ListTableCliSimpleParamTest.TestListTables/2
I20251214 21:05:06.914753 16864 test_util.cc:276] Using random seed: -647816773
I20251214 21:05:06.915499 16864 ts_itest-base.cc:115] Starting cluster with:
I20251214 21:05:06.915545 16864 ts_itest-base.cc:116] --------------
I20251214 21:05:06.915555 16864 ts_itest-base.cc:117] 1 tablet servers
I20251214 21:05:06.915565 16864 ts_itest-base.cc:118] 1 replicas per TS
I20251214 21:05:06.915573 16864 ts_itest-base.cc:119] --------------
2025-12-14T21:05:06Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-14T21:05:06Z Disabled control of system clock
I20251214 21:05:06.924330 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:37569
--webserver_interface=127.16.120.62
--webserver_port=0
--builtin_ntp_servers=127.16.120.20:41125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.120.62:37569 with env {}
W20251214 21:05:07.029395 21572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:07.029626 21572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:07.029671 21572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:07.032977 21572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251214 21:05:07.033042 21572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:07.033062 21572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251214 21:05:07.033094 21572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251214 21:05:07.036940 21572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.120.62:37569
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:37569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.16.120.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.21572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:07.038064 21572 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:07.039192 21572 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:07.044767 21577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:07.044763 21578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:07.044898 21572 server_base.cc:1047] running on GCE node
W20251214 21:05:07.044786 21580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:07.045490 21572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:07.046406 21572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:07.047567 21572 hybrid_clock.cc:648] HybridClock initialized: now 1765746307047557 us; error 26 us; skew 500 ppm
I20251214 21:05:07.049255 21572 webserver.cc:492] Webserver started at http://127.16.120.62:38645/ using document root <none> and password file <none>
I20251214 21:05:07.049808 21572 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:07.049896 21572 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:07.050091 21572 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:05:07.051584 21572 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "f540c41e6adc483caf35d6d266eb8aa8"
format_stamp: "Formatted at 2025-12-14 21:05:07 on dist-test-slave-8rzr"
I20251214 21:05:07.052028 21572 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "f540c41e6adc483caf35d6d266eb8aa8"
format_stamp: "Formatted at 2025-12-14 21:05:07 on dist-test-slave-8rzr"
I20251214 21:05:07.055289 21572 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20251214 21:05:07.057343 21586 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:07.058367 21572 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:05:07.058476 21572 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
uuid: "f540c41e6adc483caf35d6d266eb8aa8"
format_stamp: "Formatted at 2025-12-14 21:05:07 on dist-test-slave-8rzr"
I20251214 21:05:07.058564 21572 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:07.070369 21572 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:07.071007 21572 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:07.071168 21572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:07.078215 21640 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.62:37569 every 8 connection(s)
I20251214 21:05:07.078217 21572 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.62:37569
I20251214 21:05:07.079270 21572 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251214 21:05:07.082087 21641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:05:07.087011 21641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8: Bootstrap starting.
I20251214 21:05:07.089229 21641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8: Neither blocks nor log segments found. Creating new log.
I20251214 21:05:07.089222 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 21572
I20251214 21:05:07.089325 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251214 21:05:07.090004 21641 log.cc:826] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8: Log is configured to *not* fsync() on all Append() calls
I20251214 21:05:07.091931 21641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8: No bootstrap required, opened a new log
I20251214 21:05:07.095211 21641 raft_consensus.cc:359] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f540c41e6adc483caf35d6d266eb8aa8" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 37569 } }
I20251214 21:05:07.095446 21641 raft_consensus.cc:385] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:05:07.095541 21641 raft_consensus.cc:740] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f540c41e6adc483caf35d6d266eb8aa8, State: Initialized, Role: FOLLOWER
I20251214 21:05:07.096017 21641 consensus_queue.cc:260] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f540c41e6adc483caf35d6d266eb8aa8" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 37569 } }
I20251214 21:05:07.096150 21641 raft_consensus.cc:399] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:05:07.096210 21641 raft_consensus.cc:493] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:05:07.096297 21641 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:05:07.097167 21641 raft_consensus.cc:515] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f540c41e6adc483caf35d6d266eb8aa8" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 37569 } }
I20251214 21:05:07.097489 21641 leader_election.cc:304] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f540c41e6adc483caf35d6d266eb8aa8; no voters:
I20251214 21:05:07.097759 21641 leader_election.cc:290] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:05:07.097872 21646 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:05:07.098065 21646 raft_consensus.cc:697] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [term 1 LEADER]: Becoming Leader. State: Replica: f540c41e6adc483caf35d6d266eb8aa8, State: Running, Role: LEADER
I20251214 21:05:07.098425 21646 consensus_queue.cc:237] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f540c41e6adc483caf35d6d266eb8aa8" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 37569 } }
I20251214 21:05:07.098964 21641 sys_catalog.cc:565] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:05:07.099612 21646 sys_catalog.cc:455] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f540c41e6adc483caf35d6d266eb8aa8. Latest consensus state: current_term: 1 leader_uuid: "f540c41e6adc483caf35d6d266eb8aa8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f540c41e6adc483caf35d6d266eb8aa8" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 37569 } } }
I20251214 21:05:07.099834 21646 sys_catalog.cc:458] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [sys.catalog]: This master's current role is: LEADER
I20251214 21:05:07.099972 21647 sys_catalog.cc:455] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f540c41e6adc483caf35d6d266eb8aa8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f540c41e6adc483caf35d6d266eb8aa8" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 37569 } } }
I20251214 21:05:07.100226 21647 sys_catalog.cc:458] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8 [sys.catalog]: This master's current role is: LEADER
I20251214 21:05:07.100430 21654 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:05:07.103331 21654 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:05:07.108562 21654 catalog_manager.cc:1357] Generated new cluster ID: 7829d9016b9c44e598710f9f6ea55fd6
I20251214 21:05:07.108642 21654 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:05:07.132097 21654 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:05:07.133366 21654 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:05:07.140900 21654 catalog_manager.cc:6027] T 00000000000000000000000000000000 P f540c41e6adc483caf35d6d266eb8aa8: Generated new TSK 0
I20251214 21:05:07.141767 21654 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:05:07.150070 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.1:0
--local_ip_for_outbound_sockets=127.16.120.1
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:37569
--builtin_ntp_servers=127.16.120.20:41125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251214 21:05:07.257258 21666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:07.257475 21666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:07.257520 21666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:07.260891 21666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:07.261000 21666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.1
I20251214 21:05:07.264837 21666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:37569
--never_fsync=true
--heap_profile_path=/tmp/kudu.21666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.1
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:07.265956 21666 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:07.267046 21666 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:07.273325 21674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:07.273303 21671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:07.273504 21666 server_base.cc:1047] running on GCE node
W20251214 21:05:07.273355 21672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:07.274019 21666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:07.274528 21666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:07.275691 21666 hybrid_clock.cc:648] HybridClock initialized: now 1765746307275669 us; error 29 us; skew 500 ppm
I20251214 21:05:07.277267 21666 webserver.cc:492] Webserver started at http://127.16.120.1:39659/ using document root <none> and password file <none>
I20251214 21:05:07.277805 21666 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:07.277894 21666 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:07.278079 21666 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:05:07.279587 21666 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "371b09f3e2124c91aaf499c7fd4a2c76"
format_stamp: "Formatted at 2025-12-14 21:05:07 on dist-test-slave-8rzr"
I20251214 21:05:07.280020 21666 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "371b09f3e2124c91aaf499c7fd4a2c76"
format_stamp: "Formatted at 2025-12-14 21:05:07 on dist-test-slave-8rzr"
I20251214 21:05:07.283167 21666 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20251214 21:05:07.285182 21680 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:07.286221 21666 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:05:07.286317 21666 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "371b09f3e2124c91aaf499c7fd4a2c76"
format_stamp: "Formatted at 2025-12-14 21:05:07 on dist-test-slave-8rzr"
I20251214 21:05:07.286391 21666 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:07.298489 21666 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:07.299093 21666 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:07.299245 21666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:07.299770 21666 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:05:07.300727 21666 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:05:07.300776 21666 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:07.300825 21666 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:05:07.300850 21666 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:07.309469 21666 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.1:42067
I20251214 21:05:07.309484 21794 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.1:42067 every 8 connection(s)
I20251214 21:05:07.310456 21666 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251214 21:05:07.315943 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 21666
I20251214 21:05:07.316040 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765746286170956-16864-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251214 21:05:07.319202 21795 heartbeater.cc:344] Connected to a master server at 127.16.120.62:37569
I20251214 21:05:07.319445 21795 heartbeater.cc:461] Registering TS with master...
I20251214 21:05:07.320007 21795 heartbeater.cc:507] Master 127.16.120.62:37569 requested a full tablet report, sending...
I20251214 21:05:07.321357 21604 ts_manager.cc:194] Registered new tserver with Master: 371b09f3e2124c91aaf499c7fd4a2c76 (127.16.120.1:42067)
I20251214 21:05:07.322566 21604 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.1:54961
I20251214 21:05:07.330039 16864 external_mini_cluster.cc:949] 1 TS(s) registered with all masters
I20251214 21:05:07.338403 21604 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40696:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20251214 21:05:07.353860 21728 tablet_service.cc:1505] Processing CreateTablet for tablet ce6d6e295e714efdb9baaa5b98503379 (DEFAULT_TABLE table=TestTable [id=609ed73959f64fbabbb44a1839d152e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:05:07.354841 21728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6d6e295e714efdb9baaa5b98503379. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:05:07.359980 21805 tablet_bootstrap.cc:492] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76: Bootstrap starting.
I20251214 21:05:07.362000 21805 tablet_bootstrap.cc:654] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76: Neither blocks nor log segments found. Creating new log.
I20251214 21:05:07.362735 21805 log.cc:826] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76: Log is configured to *not* fsync() on all Append() calls
I20251214 21:05:07.364497 21805 tablet_bootstrap.cc:492] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76: No bootstrap required, opened a new log
I20251214 21:05:07.364687 21805 ts_tablet_manager.cc:1403] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20251214 21:05:07.367096 21805 raft_consensus.cc:359] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "371b09f3e2124c91aaf499c7fd4a2c76" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42067 } }
I20251214 21:05:07.367276 21805 raft_consensus.cc:385] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:05:07.367342 21805 raft_consensus.cc:740] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b09f3e2124c91aaf499c7fd4a2c76, State: Initialized, Role: FOLLOWER
I20251214 21:05:07.367749 21805 consensus_queue.cc:260] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "371b09f3e2124c91aaf499c7fd4a2c76" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42067 } }
I20251214 21:05:07.367870 21805 raft_consensus.cc:399] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:05:07.367930 21805 raft_consensus.cc:493] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:05:07.368019 21805 raft_consensus.cc:3060] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:05:07.368793 21805 raft_consensus.cc:515] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "371b09f3e2124c91aaf499c7fd4a2c76" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42067 } }
I20251214 21:05:07.369141 21805 leader_election.cc:304] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 371b09f3e2124c91aaf499c7fd4a2c76; no voters:
I20251214 21:05:07.369480 21805 leader_election.cc:290] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:05:07.369581 21807 raft_consensus.cc:2804] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:05:07.369758 21807 raft_consensus.cc:697] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76 [term 1 LEADER]: Becoming Leader. State: Replica: 371b09f3e2124c91aaf499c7fd4a2c76, State: Running, Role: LEADER
I20251214 21:05:07.370069 21807 consensus_queue.cc:237] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "371b09f3e2124c91aaf499c7fd4a2c76" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42067 } }
I20251214 21:05:07.370146 21795 heartbeater.cc:499] Master 127.16.120.62:37569 was elected leader, sending a full tablet report...
I20251214 21:05:07.370348 21805 ts_tablet_manager.cc:1434] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20251214 21:05:07.373376 21604 catalog_manager.cc:5654] T ce6d6e295e714efdb9baaa5b98503379 P 371b09f3e2124c91aaf499c7fd4a2c76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b09f3e2124c91aaf499c7fd4a2c76 (127.16.120.1). New cstate: current_term: 1 leader_uuid: "371b09f3e2124c91aaf499c7fd4a2c76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "371b09f3e2124c91aaf499c7fd4a2c76" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 42067 } health_report { overall_health: HEALTHY } } }
I20251214 21:05:07.380021 16864 external_mini_cluster.cc:949] 1 TS(s) registered with all masters
I20251214 21:05:07.381368 16864 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 371b09f3e2124c91aaf499c7fd4a2c76 to finish bootstrapping
I20251214 21:05:07.578074 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 21666
I20251214 21:05:07.583458 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 21572
2025-12-14T21:05:07Z chronyd exiting
[ OK ] ListTableCliSimpleParamTest.TestListTables/2 (687 ms)
[----------] 1 test from ListTableCliSimpleParamTest (687 ms total)
[----------] 1 test from ListTableCliParamTest
[ RUN ] ListTableCliParamTest.ListTabletWithPartitionInfo/4
I20251214 21:05:07.602191 16864 test_util.cc:276] Using random seed: -647129335
[ OK ] ListTableCliParamTest.ListTabletWithPartitionInfo/4 (1 ms)
[----------] 1 test from ListTableCliParamTest (1 ms total)
[----------] 1 test from IsSecure/SecureClusterAdminCliParamTest
[ RUN ] IsSecure/SecureClusterAdminCliParamTest.TestRebuildMaster/0
2025-12-14T21:05:07Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-14T21:05:07Z Disabled control of system clock
I20251214 21:05:07.611622 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:33629
--webserver_interface=127.16.120.62
--webserver_port=0
--builtin_ntp_servers=127.16.120.20:41109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.120.62:33629 with env {}
W20251214 21:05:07.713235 21829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:07.713464 21829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:07.713503 21829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:07.716779 21829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251214 21:05:07.716843 21829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:07.716863 21829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251214 21:05:07.716879 21829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251214 21:05:07.720688 21829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.120.62:33629
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:33629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.120.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.21829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:07.721735 21829 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:07.722813 21829 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:07.728250 21834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:07.728329 21837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:07.728278 21835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:07.728650 21829 server_base.cc:1047] running on GCE node
I20251214 21:05:07.729177 21829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:07.730139 21829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:07.731299 21829 hybrid_clock.cc:648] HybridClock initialized: now 1765746307731288 us; error 27 us; skew 500 ppm
I20251214 21:05:07.733105 21829 webserver.cc:492] Webserver started at http://127.16.120.62:46303/ using document root <none> and password file <none>
I20251214 21:05:07.733651 21829 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:07.733707 21829 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:07.733927 21829 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:05:07.735453 21829 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data/instance:
uuid: "9a6fa572f449456d8a87f6630a55aecf"
format_stamp: "Formatted at 2025-12-14 21:05:07 on dist-test-slave-8rzr"
I20251214 21:05:07.735898 21829 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal/instance:
uuid: "9a6fa572f449456d8a87f6630a55aecf"
format_stamp: "Formatted at 2025-12-14 21:05:07 on dist-test-slave-8rzr"
I20251214 21:05:07.739113 21829 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251214 21:05:07.741200 21843 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:07.742266 21829 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251214 21:05:07.742372 21829 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal
uuid: "9a6fa572f449456d8a87f6630a55aecf"
format_stamp: "Formatted at 2025-12-14 21:05:07 on dist-test-slave-8rzr"
I20251214 21:05:07.742465 21829 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:07.774035 21829 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:07.774781 21829 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:07.774945 21829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:07.781865 21829 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.62:33629
I20251214 21:05:07.781878 21896 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.62:33629 every 8 connection(s)
I20251214 21:05:07.782873 21829 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data/info.pb
I20251214 21:05:07.785684 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:05:07.786892 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 21829
I20251214 21:05:07.787029 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal/instance
I20251214 21:05:07.791699 21897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf: Bootstrap starting.
I20251214 21:05:07.793949 21897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf: Neither blocks nor log segments found. Creating new log.
I20251214 21:05:07.794760 21897 log.cc:826] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf: Log is configured to *not* fsync() on all Append() calls
I20251214 21:05:07.796656 21897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf: No bootstrap required, opened a new log
I20251214 21:05:07.799089 21897 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6fa572f449456d8a87f6630a55aecf" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 33629 } }
I20251214 21:05:07.799280 21897 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:05:07.799336 21897 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6fa572f449456d8a87f6630a55aecf, State: Initialized, Role: FOLLOWER
I20251214 21:05:07.799708 21897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6fa572f449456d8a87f6630a55aecf" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 33629 } }
I20251214 21:05:07.799853 21897 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:05:07.799925 21897 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:05:07.800024 21897 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:05:07.800848 21897 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6fa572f449456d8a87f6630a55aecf" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 33629 } }
I20251214 21:05:07.801187 21897 leader_election.cc:304] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a6fa572f449456d8a87f6630a55aecf; no voters:
I20251214 21:05:07.801608 21897 leader_election.cc:290] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:05:07.801733 21902 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:05:07.801959 21902 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [term 1 LEADER]: Becoming Leader. State: Replica: 9a6fa572f449456d8a87f6630a55aecf, State: Running, Role: LEADER
I20251214 21:05:07.802217 21902 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6fa572f449456d8a87f6630a55aecf" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 33629 } }
I20251214 21:05:07.802726 21897 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:05:07.803763 21904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a6fa572f449456d8a87f6630a55aecf. Latest consensus state: current_term: 1 leader_uuid: "9a6fa572f449456d8a87f6630a55aecf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6fa572f449456d8a87f6630a55aecf" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 33629 } } }
I20251214 21:05:07.803763 21903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a6fa572f449456d8a87f6630a55aecf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6fa572f449456d8a87f6630a55aecf" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 33629 } } }
I20251214 21:05:07.803913 21904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [sys.catalog]: This master's current role is: LEADER
I20251214 21:05:07.803913 21903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf [sys.catalog]: This master's current role is: LEADER
I20251214 21:05:07.804335 21911 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:05:07.807546 21911 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:05:07.813041 21911 catalog_manager.cc:1357] Generated new cluster ID: f7de5a7d6d074ab8b54815ae057479d8
I20251214 21:05:07.813114 21911 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:05:07.839406 21911 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:05:07.840690 21911 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:05:07.855598 21911 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 9a6fa572f449456d8a87f6630a55aecf: Generated new TSK 0
I20251214 21:05:07.856472 21911 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251214 21:05:07.864212 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.1:0
--local_ip_for_outbound_sockets=127.16.120.1
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:33629
--builtin_ntp_servers=127.16.120.20:41109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20251214 21:05:07.976367 21921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:07.976583 21921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:07.976645 21921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:07.980017 21921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:07.980142 21921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.1
I20251214 21:05:07.983909 21921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.120.1
--webserver_port=0
--tserver_master_addrs=127.16.120.62:33629
--never_fsync=true
--heap_profile_path=/tmp/kudu.21921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.1
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:07.984898 21921 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:07.986042 21921 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:07.992493 21926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:07.992520 21927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:07.992570 21929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:07.992911 21921 server_base.cc:1047] running on GCE node
I20251214 21:05:07.993269 21921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:07.993821 21921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:07.995033 21921 hybrid_clock.cc:648] HybridClock initialized: now 1765746307995006 us; error 42 us; skew 500 ppm
I20251214 21:05:07.997006 21921 webserver.cc:492] Webserver started at http://127.16.120.1:42721/ using document root <none> and password file <none>
I20251214 21:05:07.997609 21921 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:07.997679 21921 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:07.997926 21921 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:05:07.999641 21921 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data/instance:
uuid: "2076abbfbfbe48c08435ce85afd0fd34"
format_stamp: "Formatted at 2025-12-14 21:05:07 on dist-test-slave-8rzr"
I20251214 21:05:08.000150 21921 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/wal/instance:
uuid: "2076abbfbfbe48c08435ce85afd0fd34"
format_stamp: "Formatted at 2025-12-14 21:05:07 on dist-test-slave-8rzr"
I20251214 21:05:08.003883 21921 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20251214 21:05:08.006212 21935 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:08.007252 21921 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251214 21:05:08.007356 21921 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/wal
uuid: "2076abbfbfbe48c08435ce85afd0fd34"
format_stamp: "Formatted at 2025-12-14 21:05:07 on dist-test-slave-8rzr"
I20251214 21:05:08.007445 21921 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:08.019456 21921 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:08.020139 21921 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:08.020423 21921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:08.021030 21921 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:05:08.022096 21921 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:05:08.022147 21921 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:08.022200 21921 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:05:08.022228 21921 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:08.032035 21921 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.1:45025
I20251214 21:05:08.032068 22049 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.1:45025 every 8 connection(s)
I20251214 21:05:08.033087 21921 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data/info.pb
I20251214 21:05:08.041862 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 21921
I20251214 21:05:08.041982 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/wal/instance
I20251214 21:05:08.042232 22050 heartbeater.cc:344] Connected to a master server at 127.16.120.62:33629
I20251214 21:05:08.042515 22050 heartbeater.cc:461] Registering TS with master...
I20251214 21:05:08.043144 22050 heartbeater.cc:507] Master 127.16.120.62:33629 requested a full tablet report, sending...
I20251214 21:05:08.044247 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.2:0
--local_ip_for_outbound_sockets=127.16.120.2
--webserver_interface=127.16.120.2
--webserver_port=0
--tserver_master_addrs=127.16.120.62:33629
--builtin_ntp_servers=127.16.120.20:41109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251214 21:05:08.044689 21860 ts_manager.cc:194] Registered new tserver with Master: 2076abbfbfbe48c08435ce85afd0fd34 (127.16.120.1:45025)
I20251214 21:05:08.046142 21860 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.1:45469
W20251214 21:05:08.148190 22053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:08.148406 22053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:08.148471 22053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:08.151750 22053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:08.151878 22053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.2
I20251214 21:05:08.155652 22053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.120.2
--webserver_port=0
--tserver_master_addrs=127.16.120.62:33629
--never_fsync=true
--heap_profile_path=/tmp/kudu.22053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.2
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:08.156694 22053 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:08.157778 22053 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:08.164299 22058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:08.164304 22061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:08.164423 22059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:08.164552 22053 server_base.cc:1047] running on GCE node
I20251214 21:05:08.164949 22053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:08.165505 22053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:08.166661 22053 hybrid_clock.cc:648] HybridClock initialized: now 1765746308166635 us; error 37 us; skew 500 ppm
I20251214 21:05:08.168431 22053 webserver.cc:492] Webserver started at http://127.16.120.2:38187/ using document root <none> and password file <none>
I20251214 21:05:08.168987 22053 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:08.169046 22053 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:08.169242 22053 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:05:08.170840 22053 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data/instance:
uuid: "2e1b7c5a377e473593468aa005781b8f"
format_stamp: "Formatted at 2025-12-14 21:05:08 on dist-test-slave-8rzr"
I20251214 21:05:08.171277 22053 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/wal/instance:
uuid: "2e1b7c5a377e473593468aa005781b8f"
format_stamp: "Formatted at 2025-12-14 21:05:08 on dist-test-slave-8rzr"
I20251214 21:05:08.174518 22053 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20251214 21:05:08.176645 22067 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:08.177623 22053 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:05:08.177742 22053 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/wal
uuid: "2e1b7c5a377e473593468aa005781b8f"
format_stamp: "Formatted at 2025-12-14 21:05:08 on dist-test-slave-8rzr"
I20251214 21:05:08.177842 22053 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:08.195115 22053 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:08.195811 22053 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:08.195978 22053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:08.196550 22053 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:05:08.197582 22053 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:05:08.197630 22053 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:08.197683 22053 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:05:08.197712 22053 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:08.207089 22053 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.2:45083
I20251214 21:05:08.207134 22181 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.2:45083 every 8 connection(s)
I20251214 21:05:08.208050 22053 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data/info.pb
I20251214 21:05:08.210253 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 22053
I20251214 21:05:08.210378 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/wal/instance
I20251214 21:05:08.212587 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.3:0
--local_ip_for_outbound_sockets=127.16.120.3
--webserver_interface=127.16.120.3
--webserver_port=0
--tserver_master_addrs=127.16.120.62:33629
--builtin_ntp_servers=127.16.120.20:41109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251214 21:05:08.218437 22182 heartbeater.cc:344] Connected to a master server at 127.16.120.62:33629
I20251214 21:05:08.218739 22182 heartbeater.cc:461] Registering TS with master...
I20251214 21:05:08.219485 22182 heartbeater.cc:507] Master 127.16.120.62:33629 requested a full tablet report, sending...
I20251214 21:05:08.220662 21860 ts_manager.cc:194] Registered new tserver with Master: 2e1b7c5a377e473593468aa005781b8f (127.16.120.2:45083)
I20251214 21:05:08.221432 21860 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.2:37197
W20251214 21:05:08.322638 22185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:08.322871 22185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:08.322918 22185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:08.326236 22185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:08.326354 22185 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.3
I20251214 21:05:08.330181 22185 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.120.3
--webserver_port=0
--tserver_master_addrs=127.16.120.62:33629
--never_fsync=true
--heap_profile_path=/tmp/kudu.22185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.3
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:08.331188 22185 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:08.332260 22185 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:08.338943 22190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:08.338973 22194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:08.338953 22191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:08.339295 22185 server_base.cc:1047] running on GCE node
I20251214 21:05:08.339599 22185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:08.340087 22185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:08.341226 22185 hybrid_clock.cc:648] HybridClock initialized: now 1765746308341207 us; error 36 us; skew 500 ppm
I20251214 21:05:08.342918 22185 webserver.cc:492] Webserver started at http://127.16.120.3:40763/ using document root <none> and password file <none>
I20251214 21:05:08.343458 22185 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:08.343524 22185 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:08.343694 22185 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:05:08.345171 22185 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data/instance:
uuid: "8d5b42d0e3b04c6dac537647db49a7c7"
format_stamp: "Formatted at 2025-12-14 21:05:08 on dist-test-slave-8rzr"
I20251214 21:05:08.345624 22185 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/wal/instance:
uuid: "8d5b42d0e3b04c6dac537647db49a7c7"
format_stamp: "Formatted at 2025-12-14 21:05:08 on dist-test-slave-8rzr"
I20251214 21:05:08.348834 22185 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20251214 21:05:08.350960 22200 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:08.351934 22185 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251214 21:05:08.352037 22185 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/wal
uuid: "8d5b42d0e3b04c6dac537647db49a7c7"
format_stamp: "Formatted at 2025-12-14 21:05:08 on dist-test-slave-8rzr"
I20251214 21:05:08.352118 22185 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:08.367336 22185 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:08.367980 22185 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:08.368144 22185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:08.368727 22185 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:05:08.369668 22185 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251214 21:05:08.369719 22185 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:08.369771 22185 ts_tablet_manager.cc:616] Registered 0 tablets
I20251214 21:05:08.369801 22185 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:08.378264 22185 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.3:35177
I20251214 21:05:08.378314 22314 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.3:35177 every 8 connection(s)
I20251214 21:05:08.379189 22185 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data/info.pb
I20251214 21:05:08.388027 22315 heartbeater.cc:344] Connected to a master server at 127.16.120.62:33629
I20251214 21:05:08.388260 22315 heartbeater.cc:461] Registering TS with master...
I20251214 21:05:08.388849 22315 heartbeater.cc:507] Master 127.16.120.62:33629 requested a full tablet report, sending...
I20251214 21:05:08.389034 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 22185
I20251214 21:05:08.389135 16864 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/wal/instance
I20251214 21:05:08.389860 21860 ts_manager.cc:194] Registered new tserver with Master: 8d5b42d0e3b04c6dac537647db49a7c7 (127.16.120.3:35177)
I20251214 21:05:08.390514 21860 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.3:54705
I20251214 21:05:08.391218 16864 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251214 21:05:08.398010 16864 test_util.cc:276] Using random seed: -646333513
I20251214 21:05:08.406786 21858 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60560:
name: "pre_rebuild"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251214 21:05:08.407864 21858 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table pre_rebuild in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:05:08.424052 22115 tablet_service.cc:1505] Processing CreateTablet for tablet 36078dffd0dd482ab7d31b254cabb67d (DEFAULT_TABLE table=pre_rebuild [id=2d902aeeadaa4d9cb786fde9d89382af]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:05:08.424052 22248 tablet_service.cc:1505] Processing CreateTablet for tablet 36078dffd0dd482ab7d31b254cabb67d (DEFAULT_TABLE table=pre_rebuild [id=2d902aeeadaa4d9cb786fde9d89382af]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:05:08.425097 22248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36078dffd0dd482ab7d31b254cabb67d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:05:08.425097 22115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36078dffd0dd482ab7d31b254cabb67d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:05:08.427801 21983 tablet_service.cc:1505] Processing CreateTablet for tablet 36078dffd0dd482ab7d31b254cabb67d (DEFAULT_TABLE table=pre_rebuild [id=2d902aeeadaa4d9cb786fde9d89382af]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:05:08.428606 21983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36078dffd0dd482ab7d31b254cabb67d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:05:08.432344 22337 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: Bootstrap starting.
I20251214 21:05:08.432780 22338 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: Bootstrap starting.
I20251214 21:05:08.433405 22339 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Bootstrap starting.
I20251214 21:05:08.434499 22337 tablet_bootstrap.cc:654] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: Neither blocks nor log segments found. Creating new log.
I20251214 21:05:08.434828 22338 tablet_bootstrap.cc:654] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: Neither blocks nor log segments found. Creating new log.
I20251214 21:05:08.435320 22337 log.cc:826] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: Log is configured to *not* fsync() on all Append() calls
I20251214 21:05:08.435410 22339 tablet_bootstrap.cc:654] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Neither blocks nor log segments found. Creating new log.
I20251214 21:05:08.435444 22338 log.cc:826] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: Log is configured to *not* fsync() on all Append() calls
I20251214 21:05:08.436122 22339 log.cc:826] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Log is configured to *not* fsync() on all Append() calls
I20251214 21:05:08.437040 22338 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: No bootstrap required, opened a new log
I20251214 21:05:08.437040 22337 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: No bootstrap required, opened a new log
I20251214 21:05:08.437223 22337 ts_tablet_manager.cc:1403] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20251214 21:05:08.437223 22338 ts_tablet_manager.cc:1403] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20251214 21:05:08.437486 22339 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: No bootstrap required, opened a new log
I20251214 21:05:08.437646 22339 ts_tablet_manager.cc:1403] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20251214 21:05:08.440088 22339 raft_consensus.cc:359] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:08.440281 22339 raft_consensus.cc:385] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:05:08.440335 22339 raft_consensus.cc:740] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2076abbfbfbe48c08435ce85afd0fd34, State: Initialized, Role: FOLLOWER
I20251214 21:05:08.440251 22337 raft_consensus.cc:359] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:08.440250 22338 raft_consensus.cc:359] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:08.440469 22338 raft_consensus.cc:385] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:05:08.440476 22337 raft_consensus.cc:385] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:05:08.440526 22337 raft_consensus.cc:740] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e1b7c5a377e473593468aa005781b8f, State: Initialized, Role: FOLLOWER
I20251214 21:05:08.440534 22338 raft_consensus.cc:740] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d5b42d0e3b04c6dac537647db49a7c7, State: Initialized, Role: FOLLOWER
I20251214 21:05:08.440832 22339 consensus_queue.cc:260] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:08.440953 22338 consensus_queue.cc:260] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:08.440954 22337 consensus_queue.cc:260] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:08.441521 22050 heartbeater.cc:499] Master 127.16.120.62:33629 was elected leader, sending a full tablet report...
I20251214 21:05:08.441702 22339 ts_tablet_manager.cc:1434] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20251214 21:05:08.441761 22338 ts_tablet_manager.cc:1434] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20251214 21:05:08.442132 22315 heartbeater.cc:499] Master 127.16.120.62:33629 was elected leader, sending a full tablet report...
I20251214 21:05:08.442406 22182 heartbeater.cc:499] Master 127.16.120.62:33629 was elected leader, sending a full tablet report...
I20251214 21:05:08.442890 22337 ts_tablet_manager.cc:1434] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20251214 21:05:08.458859 22183 tablet.cc:2378] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251214 21:05:08.534227 22051 tablet.cc:2378] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:05:08.540374 22344 raft_consensus.cc:493] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:05:08.540547 22344 raft_consensus.cc:515] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:08.541676 22344 leader_election.cc:290] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2076abbfbfbe48c08435ce85afd0fd34 (127.16.120.1:45025), 2e1b7c5a377e473593468aa005781b8f (127.16.120.2:45083)
I20251214 21:05:08.545388 22003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "36078dffd0dd482ab7d31b254cabb67d" candidate_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2076abbfbfbe48c08435ce85afd0fd34" is_pre_election: true
I20251214 21:05:08.545706 22003 raft_consensus.cc:2468] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d5b42d0e3b04c6dac537647db49a7c7 in term 0.
I20251214 21:05:08.545928 22135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "36078dffd0dd482ab7d31b254cabb67d" candidate_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e1b7c5a377e473593468aa005781b8f" is_pre_election: true
I20251214 21:05:08.546172 22135 raft_consensus.cc:2468] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d5b42d0e3b04c6dac537647db49a7c7 in term 0.
I20251214 21:05:08.546310 22202 leader_election.cc:304] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2076abbfbfbe48c08435ce85afd0fd34, 8d5b42d0e3b04c6dac537647db49a7c7; no voters:
I20251214 21:05:08.546618 22344 raft_consensus.cc:2804] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:05:08.546705 22344 raft_consensus.cc:493] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:05:08.546751 22344 raft_consensus.cc:3060] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:05:08.547606 22344 raft_consensus.cc:515] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:08.547962 22344 leader_election.cc:290] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [CANDIDATE]: Term 1 election: Requested vote from peers 2076abbfbfbe48c08435ce85afd0fd34 (127.16.120.1:45025), 2e1b7c5a377e473593468aa005781b8f (127.16.120.2:45083)
I20251214 21:05:08.548287 22003 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "36078dffd0dd482ab7d31b254cabb67d" candidate_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2076abbfbfbe48c08435ce85afd0fd34"
I20251214 21:05:08.548334 22135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "36078dffd0dd482ab7d31b254cabb67d" candidate_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e1b7c5a377e473593468aa005781b8f"
I20251214 21:05:08.548394 22003 raft_consensus.cc:3060] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:05:08.548456 22135 raft_consensus.cc:3060] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:05:08.549263 22135 raft_consensus.cc:2468] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d5b42d0e3b04c6dac537647db49a7c7 in term 1.
I20251214 21:05:08.549273 22003 raft_consensus.cc:2468] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d5b42d0e3b04c6dac537647db49a7c7 in term 1.
I20251214 21:05:08.549587 22204 leader_election.cc:304] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2076abbfbfbe48c08435ce85afd0fd34, 2e1b7c5a377e473593468aa005781b8f, 8d5b42d0e3b04c6dac537647db49a7c7; no voters:
I20251214 21:05:08.549791 22344 raft_consensus.cc:2804] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:05:08.550024 22344 raft_consensus.cc:697] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 1 LEADER]: Becoming Leader. State: Replica: 8d5b42d0e3b04c6dac537647db49a7c7, State: Running, Role: LEADER
I20251214 21:05:08.550314 22344 consensus_queue.cc:237] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:08.553500 21858 catalog_manager.cc:5654] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d5b42d0e3b04c6dac537647db49a7c7 (127.16.120.3). New cstate: current_term: 1 leader_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } health_report { overall_health: UNKNOWN } } }
I20251214 21:05:08.594223 22003 raft_consensus.cc:1275] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 1 FOLLOWER]: Refusing update from remote peer 8d5b42d0e3b04c6dac537647db49a7c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:05:08.594314 22135 raft_consensus.cc:1275] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 1 FOLLOWER]: Refusing update from remote peer 8d5b42d0e3b04c6dac537647db49a7c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:05:08.594833 22347 consensus_queue.cc:1048] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:05:08.595003 22344 consensus_queue.cc:1048] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:05:08.606047 22356 mvcc.cc:204] Tried to move back new op lower bound from 7232496880000081920 to 7232496879824809984. Current Snapshot: MvccSnapshot[applied={T|T < 7232496879994687488}]
I20251214 21:05:09.444381 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 21829
W20251214 21:05:09.598052 22380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:09.598312 22380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:09.601908 22380 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
W20251214 21:05:09.605726 22315 heartbeater.cc:646] Failed to heartbeat to 127.16.120.62:33629 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.120.62:33629: connect: Connection refused (error 111)
W20251214 21:05:09.607937 22050 heartbeater.cc:646] Failed to heartbeat to 127.16.120.62:33629 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.120.62:33629: connect: Connection refused (error 111)
W20251214 21:05:09.609197 22182 heartbeater.cc:646] Failed to heartbeat to 127.16.120.62:33629 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.120.62:33629: connect: Connection refused (error 111)
I20251214 21:05:09.635972 22380 minidump.cc:252] Setting minidump size limit to 20M
I20251214 21:05:09.637007 22380 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:09.637787 22380 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:09.642333 22406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:09.642302 22409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:09.642488 22380 server_base.cc:1047] running on GCE node
W20251214 21:05:09.642302 22407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:09.643105 22380 hybrid_clock.cc:584] initializing the hybrid clock with 'system' time source
I20251214 21:05:09.643288 22380 hybrid_clock.cc:648] HybridClock initialized: now 1765746309643283 us; error 75261 us; skew 500 ppm
I20251214 21:05:09.644776 22380 webserver.cc:492] Webserver started at http://0.0.0.0:36429/ using document root <none> and password file <none>
I20251214 21:05:09.645291 22380 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:09.645356 22380 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:09.645515 22380 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251214 21:05:09.647279 22380 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data/instance:
uuid: "cca8878ec7794fa2a761a1da6d1af84f"
format_stamp: "Formatted at 2025-12-14 21:05:09 on dist-test-slave-8rzr"
I20251214 21:05:09.647754 22380 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal/instance:
uuid: "cca8878ec7794fa2a761a1da6d1af84f"
format_stamp: "Formatted at 2025-12-14 21:05:09 on dist-test-slave-8rzr"
I20251214 21:05:09.650874 22380 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251214 21:05:09.652858 22414 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:09.653576 22380 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:05:09.653712 22380 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal
uuid: "cca8878ec7794fa2a761a1da6d1af84f"
format_stamp: "Formatted at 2025-12-14 21:05:09 on dist-test-slave-8rzr"
I20251214 21:05:09.653798 22380 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:09.985309 22380 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:09.985965 22380 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:09.986127 22380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:09.988010 22380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:05:09.992677 22380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f: Bootstrap starting.
I20251214 21:05:09.994580 22380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f: Neither blocks nor log segments found. Creating new log.
I20251214 21:05:09.995558 22380 log.cc:826] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f: Log is configured to *not* fsync() on all Append() calls
I20251214 21:05:09.997254 22380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f: No bootstrap required, opened a new log
I20251214 21:05:09.999652 22380 raft_consensus.cc:359] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca8878ec7794fa2a761a1da6d1af84f" member_type: VOTER }
I20251214 21:05:09.999817 22380 raft_consensus.cc:385] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:05:09.999869 22380 raft_consensus.cc:740] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca8878ec7794fa2a761a1da6d1af84f, State: Initialized, Role: FOLLOWER
I20251214 21:05:10.000293 22380 consensus_queue.cc:260] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca8878ec7794fa2a761a1da6d1af84f" member_type: VOTER }
I20251214 21:05:10.000425 22380 raft_consensus.cc:399] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:05:10.000486 22380 raft_consensus.cc:493] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:05:10.000577 22380 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:05:10.001305 22380 raft_consensus.cc:515] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca8878ec7794fa2a761a1da6d1af84f" member_type: VOTER }
I20251214 21:05:10.001624 22380 leader_election.cc:304] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cca8878ec7794fa2a761a1da6d1af84f; no voters:
I20251214 21:05:10.001907 22380 leader_election.cc:290] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [CANDIDATE]: Term 1 election: Requested vote from peers
I20251214 21:05:10.002032 22422 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:05:10.002234 22422 raft_consensus.cc:697] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 1 LEADER]: Becoming Leader. State: Replica: cca8878ec7794fa2a761a1da6d1af84f, State: Running, Role: LEADER
I20251214 21:05:10.002535 22422 consensus_queue.cc:237] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca8878ec7794fa2a761a1da6d1af84f" member_type: VOTER }
I20251214 21:05:10.004113 22423 sys_catalog.cc:455] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cca8878ec7794fa2a761a1da6d1af84f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca8878ec7794fa2a761a1da6d1af84f" member_type: VOTER } }
I20251214 21:05:10.004137 22424 sys_catalog.cc:455] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [sys.catalog]: SysCatalogTable state changed. Reason: New leader cca8878ec7794fa2a761a1da6d1af84f. Latest consensus state: current_term: 1 leader_uuid: "cca8878ec7794fa2a761a1da6d1af84f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca8878ec7794fa2a761a1da6d1af84f" member_type: VOTER } }
I20251214 21:05:10.004247 22423 sys_catalog.cc:458] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [sys.catalog]: This master's current role is: LEADER
I20251214 21:05:10.004305 22424 sys_catalog.cc:458] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [sys.catalog]: This master's current role is: LEADER
I20251214 21:05:10.008800 22380 tablet_replica.cc:333] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f: stopping tablet replica
I20251214 21:05:10.009016 22380 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 1 LEADER]: Raft consensus shutting down.
I20251214 21:05:10.009150 22380 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251214 21:05:10.010243 22380 master.cc:561] Master@0.0.0.0:7051 shutting down...
W20251214 21:05:10.010510 22380 acceptor_pool.cc:194] Could not shut down acceptor socket on 0.0.0.0:7051: Network error: shutdown error: Transport endpoint is not connected (error 107)
I20251214 21:05:10.021729 22380 master.cc:583] Master@0.0.0.0:7051 shutdown complete.
I20251214 21:05:10.031843 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 21921
I20251214 21:05:10.037292 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 22053
I20251214 21:05:10.042774 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 22185
I20251214 21:05:10.048990 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:33629
--webserver_interface=127.16.120.62
--webserver_port=46303
--builtin_ntp_servers=127.16.120.20:41109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.120.62:33629 with env {}
W20251214 21:05:10.153906 22428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:10.154138 22428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:10.154196 22428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:10.157419 22428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251214 21:05:10.157490 22428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:10.157518 22428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251214 21:05:10.157541 22428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251214 21:05:10.161288 22428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.120.62:33629
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.120.62:33629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.120.62
--webserver_port=46303
--never_fsync=true
--heap_profile_path=/tmp/kudu.22428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:10.162415 22428 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:10.163520 22428 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:10.169184 22436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:10.169207 22434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:10.169184 22433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:10.169531 22428 server_base.cc:1047] running on GCE node
I20251214 21:05:10.170058 22428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:10.170975 22428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:10.172127 22428 hybrid_clock.cc:648] HybridClock initialized: now 1765746310172109 us; error 36 us; skew 500 ppm
I20251214 21:05:10.173959 22428 webserver.cc:492] Webserver started at http://127.16.120.62:46303/ using document root <none> and password file <none>
I20251214 21:05:10.174515 22428 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:10.174577 22428 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:10.177971 22428 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.001s sys 0.003s
I20251214 21:05:10.179862 22442 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:10.180861 22428 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:05:10.180960 22428 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal
uuid: "cca8878ec7794fa2a761a1da6d1af84f"
format_stamp: "Formatted at 2025-12-14 21:05:09 on dist-test-slave-8rzr"
I20251214 21:05:10.181353 22428 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:10.191213 22428 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:10.191913 22428 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:10.192111 22428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:10.199242 22428 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.62:33629
I20251214 21:05:10.199239 22494 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.62:33629 every 8 connection(s)
I20251214 21:05:10.200316 22428 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data/info.pb
I20251214 21:05:10.204275 22495 sys_catalog.cc:263] Verifying existing consensus state
I20251214 21:05:10.204660 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 22428
I20251214 21:05:10.205039 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.1:45025
--local_ip_for_outbound_sockets=127.16.120.1
--tserver_master_addrs=127.16.120.62:33629
--webserver_port=42721
--webserver_interface=127.16.120.1
--builtin_ntp_servers=127.16.120.20:41109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251214 21:05:10.207988 22495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f: Bootstrap starting.
I20251214 21:05:10.212301 22495 log.cc:826] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f: Log is configured to *not* fsync() on all Append() calls
I20251214 21:05:10.217454 22495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:05:10.217801 22495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f: Bootstrap complete.
I20251214 21:05:10.220523 22495 raft_consensus.cc:359] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca8878ec7794fa2a761a1da6d1af84f" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 33629 } }
I20251214 21:05:10.220732 22495 raft_consensus.cc:740] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca8878ec7794fa2a761a1da6d1af84f, State: Initialized, Role: FOLLOWER
I20251214 21:05:10.221167 22495 consensus_queue.cc:260] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca8878ec7794fa2a761a1da6d1af84f" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 33629 } }
I20251214 21:05:10.221285 22495 raft_consensus.cc:399] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251214 21:05:10.221344 22495 raft_consensus.cc:493] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251214 21:05:10.221431 22495 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:05:10.222242 22495 raft_consensus.cc:515] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca8878ec7794fa2a761a1da6d1af84f" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 33629 } }
I20251214 21:05:10.222545 22495 leader_election.cc:304] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cca8878ec7794fa2a761a1da6d1af84f; no voters:
I20251214 21:05:10.222808 22495 leader_election.cc:290] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [CANDIDATE]: Term 2 election: Requested vote from peers
I20251214 21:05:10.222949 22499 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:05:10.223129 22499 raft_consensus.cc:697] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [term 2 LEADER]: Becoming Leader. State: Replica: cca8878ec7794fa2a761a1da6d1af84f, State: Running, Role: LEADER
I20251214 21:05:10.223410 22499 consensus_queue.cc:237] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca8878ec7794fa2a761a1da6d1af84f" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 33629 } }
I20251214 21:05:10.223948 22495 sys_catalog.cc:565] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [sys.catalog]: configured and running, proceeding with master startup.
I20251214 21:05:10.224336 22499 sys_catalog.cc:455] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "cca8878ec7794fa2a761a1da6d1af84f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca8878ec7794fa2a761a1da6d1af84f" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 33629 } } }
I20251214 21:05:10.224464 22499 sys_catalog.cc:458] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [sys.catalog]: This master's current role is: LEADER
I20251214 21:05:10.224658 22499 sys_catalog.cc:455] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [sys.catalog]: SysCatalogTable state changed. Reason: New leader cca8878ec7794fa2a761a1da6d1af84f. Latest consensus state: current_term: 2 leader_uuid: "cca8878ec7794fa2a761a1da6d1af84f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca8878ec7794fa2a761a1da6d1af84f" member_type: VOTER last_known_addr { host: "127.16.120.62" port: 33629 } } }
I20251214 21:05:10.224745 22499 sys_catalog.cc:458] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f [sys.catalog]: This master's current role is: LEADER
I20251214 21:05:10.225029 22503 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251214 21:05:10.228636 22503 catalog_manager.cc:679] Loaded metadata for table pre_rebuild [id=cd723f32e41945eb8fce75c11dc5fc7f]
I20251214 21:05:10.229842 22503 tablet_loader.cc:96] loaded metadata for tablet 36078dffd0dd482ab7d31b254cabb67d (table pre_rebuild [id=cd723f32e41945eb8fce75c11dc5fc7f])
I20251214 21:05:10.229986 22503 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251214 21:05:10.233175 22503 catalog_manager.cc:1357] Generated new cluster ID: 8d9c6fb2db794b69a129e07426c4a82f
I20251214 21:05:10.233222 22503 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251214 21:05:10.263670 22503 catalog_manager.cc:1380] Generated new certificate authority record
I20251214 21:05:10.264691 22503 catalog_manager.cc:1514] Loading token signing keys...
I20251214 21:05:10.273277 22503 catalog_manager.cc:6027] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f: Generated new TSK 0
I20251214 21:05:10.273981 22503 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20251214 21:05:10.329623 22497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:10.329897 22497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:10.329960 22497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:10.333324 22497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:10.333432 22497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.1
I20251214 21:05:10.337201 22497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.1:45025
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.120.1
--webserver_port=42721
--tserver_master_addrs=127.16.120.62:33629
--never_fsync=true
--heap_profile_path=/tmp/kudu.22497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.1
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:10.338258 22497 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:10.339352 22497 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:10.345764 22523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:10.345789 22522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:10.345963 22497 server_base.cc:1047] running on GCE node
W20251214 21:05:10.345793 22525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:10.346367 22497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:10.346899 22497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:10.348057 22497 hybrid_clock.cc:648] HybridClock initialized: now 1765746310348036 us; error 39 us; skew 500 ppm
I20251214 21:05:10.349740 22497 webserver.cc:492] Webserver started at http://127.16.120.1:42721/ using document root <none> and password file <none>
I20251214 21:05:10.350292 22497 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:10.350373 22497 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:10.353557 22497 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20251214 21:05:10.355464 22531 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:10.356451 22497 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20251214 21:05:10.356542 22497 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/wal
uuid: "2076abbfbfbe48c08435ce85afd0fd34"
format_stamp: "Formatted at 2025-12-14 21:05:07 on dist-test-slave-8rzr"
I20251214 21:05:10.356936 22497 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:10.395262 22497 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:10.395970 22497 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:10.396143 22497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:10.396751 22497 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:05:10.398124 22538 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251214 21:05:10.402549 22497 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251214 21:05:10.402619 22497 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20251214 21:05:10.402684 22497 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251214 21:05:10.404187 22497 ts_tablet_manager.cc:616] Registered 1 tablets
I20251214 21:05:10.404235 22497 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20251214 21:05:10.404611 22538 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Bootstrap starting.
I20251214 21:05:10.415467 22497 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.1:45025
I20251214 21:05:10.416576 22497 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data/info.pb
I20251214 21:05:10.416926 22646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.1:45025 every 8 connection(s)
I20251214 21:05:10.421532 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 22497
I20251214 21:05:10.422032 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.2:45083
--local_ip_for_outbound_sockets=127.16.120.2
--tserver_master_addrs=127.16.120.62:33629
--webserver_port=38187
--webserver_interface=127.16.120.2
--builtin_ntp_servers=127.16.120.20:41109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251214 21:05:10.432040 22647 heartbeater.cc:344] Connected to a master server at 127.16.120.62:33629
I20251214 21:05:10.432297 22647 heartbeater.cc:461] Registering TS with master...
I20251214 21:05:10.432860 22647 heartbeater.cc:507] Master 127.16.120.62:33629 requested a full tablet report, sending...
I20251214 21:05:10.435166 22459 ts_manager.cc:194] Registered new tserver with Master: 2076abbfbfbe48c08435ce85afd0fd34 (127.16.120.1:45025)
I20251214 21:05:10.437180 22459 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.1:32769
I20251214 21:05:10.446082 22538 log.cc:826] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Log is configured to *not* fsync() on all Append() calls
W20251214 21:05:10.556115 22651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:10.556349 22651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:10.556411 22651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:10.559777 22651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:10.559911 22651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.2
I20251214 21:05:10.563920 22651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.2:45083
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.120.2
--webserver_port=38187
--tserver_master_addrs=127.16.120.62:33629
--never_fsync=true
--heap_profile_path=/tmp/kudu.22651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.2
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:10.564981 22651 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:10.566110 22651 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:10.572755 22658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:10.572824 22651 server_base.cc:1047] running on GCE node
W20251214 21:05:10.572794 22657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:10.572896 22660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:10.573349 22651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:10.573931 22651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:10.575088 22651 hybrid_clock.cc:648] HybridClock initialized: now 1765746310575070 us; error 36 us; skew 500 ppm
I20251214 21:05:10.576804 22651 webserver.cc:492] Webserver started at http://127.16.120.2:38187/ using document root <none> and password file <none>
I20251214 21:05:10.577332 22651 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:10.577395 22651 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:10.580598 22651 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:05:10.582429 22666 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:10.583410 22651 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:05:10.583501 22651 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/wal
uuid: "2e1b7c5a377e473593468aa005781b8f"
format_stamp: "Formatted at 2025-12-14 21:05:08 on dist-test-slave-8rzr"
I20251214 21:05:10.583884 22651 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:10.624852 22651 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:10.625523 22651 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:10.625699 22651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:10.626309 22651 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:05:10.627547 22673 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251214 21:05:10.630877 22651 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251214 21:05:10.630942 22651 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20251214 21:05:10.630995 22651 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251214 21:05:10.632473 22651 ts_tablet_manager.cc:616] Registered 1 tablets
I20251214 21:05:10.632527 22651 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20251214 21:05:10.632869 22673 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: Bootstrap starting.
I20251214 21:05:10.643849 22651 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.2:45083
I20251214 21:05:10.644130 22782 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.2:45083 every 8 connection(s)
I20251214 21:05:10.645059 22651 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data/info.pb
I20251214 21:05:10.651055 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 22651
I20251214 21:05:10.651517 16864 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
/tmp/dist-test-taskh3C4vt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.120.3:35177
--local_ip_for_outbound_sockets=127.16.120.3
--tserver_master_addrs=127.16.120.62:33629
--webserver_port=40763
--webserver_interface=127.16.120.3
--builtin_ntp_servers=127.16.120.20:41109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251214 21:05:10.656380 22783 heartbeater.cc:344] Connected to a master server at 127.16.120.62:33629
I20251214 21:05:10.656662 22783 heartbeater.cc:461] Registering TS with master...
I20251214 21:05:10.657330 22783 heartbeater.cc:507] Master 127.16.120.62:33629 requested a full tablet report, sending...
I20251214 21:05:10.659296 22459 ts_manager.cc:194] Registered new tserver with Master: 2e1b7c5a377e473593468aa005781b8f (127.16.120.2:45083)
I20251214 21:05:10.660322 22459 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.2:39077
I20251214 21:05:10.671866 22673 log.cc:826] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: Log is configured to *not* fsync() on all Append() calls
I20251214 21:05:10.785352 22538 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Bootstrap replayed 1/1 log segments. Stats: ops{read=207 overwritten=0 applied=207 ignored=0} inserts{seen=10300 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:05:10.785765 22538 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Bootstrap complete.
I20251214 21:05:10.786826 22538 ts_tablet_manager.cc:1403] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Time spent bootstrapping tablet: real 0.383s user 0.363s sys 0.016s
I20251214 21:05:10.788957 22538 raft_consensus.cc:359] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:10.789280 22538 raft_consensus.cc:740] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2076abbfbfbe48c08435ce85afd0fd34, State: Initialized, Role: FOLLOWER
I20251214 21:05:10.789726 22538 consensus_queue.cc:260] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 207, Last appended: 1.207, Last appended by leader: 207, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:10.790436 22647 heartbeater.cc:499] Master 127.16.120.62:33629 was elected leader, sending a full tablet report...
I20251214 21:05:10.790594 22538 ts_tablet_manager.cc:1434] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
W20251214 21:05:10.806012 22786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251214 21:05:10.806279 22786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251214 21:05:10.806345 22786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251214 21:05:10.810837 22786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251214 21:05:10.811007 22786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.120.3
I20251214 21:05:10.816251 22786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.120.20:41109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.120.3:35177
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.120.3
--webserver_port=40763
--tserver_master_addrs=127.16.120.62:33629
--never_fsync=true
--heap_profile_path=/tmp/kudu.22786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.120.3
--log_dir=/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type DEBUG
built by None at 14 Dec 2025 20:43:14 UTC on 24a791456cd2
build id 9514
I20251214 21:05:10.817693 22786 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251214 21:05:10.819188 22786 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251214 21:05:10.827353 22793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:10.827347 22794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251214 21:05:10.827379 22796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251214 21:05:10.827759 22786 server_base.cc:1047] running on GCE node
I20251214 21:05:10.828123 22786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251214 21:05:10.828722 22786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251214 21:05:10.829890 22786 hybrid_clock.cc:648] HybridClock initialized: now 1765746310829869 us; error 41 us; skew 500 ppm
I20251214 21:05:10.831676 22786 webserver.cc:492] Webserver started at http://127.16.120.3:40763/ using document root <none> and password file <none>
I20251214 21:05:10.832231 22786 fs_manager.cc:362] Metadata directory not provided
I20251214 21:05:10.832295 22786 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251214 21:05:10.835848 22786 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20251214 21:05:10.838021 22802 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251214 21:05:10.839145 22786 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251214 21:05:10.839257 22786 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data,/tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/wal
uuid: "8d5b42d0e3b04c6dac537647db49a7c7"
format_stamp: "Formatted at 2025-12-14 21:05:08 on dist-test-slave-8rzr"
I20251214 21:05:10.839663 22786 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251214 21:05:10.855151 22786 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251214 21:05:10.855780 22786 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251214 21:05:10.855940 22786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251214 21:05:10.856460 22786 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251214 21:05:10.857622 22809 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251214 21:05:10.861853 22786 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251214 21:05:10.861914 22786 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20251214 21:05:10.861981 22786 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251214 21:05:10.863365 22786 ts_tablet_manager.cc:616] Registered 1 tablets
I20251214 21:05:10.863408 22786 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20251214 21:05:10.863763 22809 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: Bootstrap starting.
I20251214 21:05:10.873744 22786 rpc_server.cc:307] RPC server started. Bound to: 127.16.120.3:35177
I20251214 21:05:10.873780 22917 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.120.3:35177 every 8 connection(s)
I20251214 21:05:10.874778 22786 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data/info.pb
I20251214 21:05:10.881516 16864 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu as pid 22786
I20251214 21:05:10.884387 22918 heartbeater.cc:344] Connected to a master server at 127.16.120.62:33629
I20251214 21:05:10.884635 22918 heartbeater.cc:461] Registering TS with master...
I20251214 21:05:10.885457 22918 heartbeater.cc:507] Master 127.16.120.62:33629 requested a full tablet report, sending...
I20251214 21:05:10.887528 22459 ts_manager.cc:194] Registered new tserver with Master: 8d5b42d0e3b04c6dac537647db49a7c7 (127.16.120.3:35177)
I20251214 21:05:10.888255 22459 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.120.3:38527
I20251214 21:05:10.889420 16864 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251214 21:05:10.905267 22809 log.cc:826] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: Log is configured to *not* fsync() on all Append() calls
I20251214 21:05:11.037681 22673 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: Bootstrap replayed 1/1 log segments. Stats: ops{read=207 overwritten=0 applied=207 ignored=0} inserts{seen=10300 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:05:11.038105 22673 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: Bootstrap complete.
I20251214 21:05:11.039070 22673 ts_tablet_manager.cc:1403] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: Time spent bootstrapping tablet: real 0.406s user 0.381s sys 0.024s
I20251214 21:05:11.041159 22673 raft_consensus.cc:359] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:11.041476 22673 raft_consensus.cc:740] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e1b7c5a377e473593468aa005781b8f, State: Initialized, Role: FOLLOWER
I20251214 21:05:11.041954 22673 consensus_queue.cc:260] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 207, Last appended: 1.207, Last appended by leader: 207, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:11.042656 22783 heartbeater.cc:499] Master 127.16.120.62:33629 was elected leader, sending a full tablet report...
I20251214 21:05:11.042810 22673 ts_tablet_manager.cc:1434] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20251214 21:05:11.214308 22809 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=207 overwritten=0 applied=207 ignored=0} inserts{seen=10300 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251214 21:05:11.214733 22809 tablet_bootstrap.cc:492] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: Bootstrap complete.
I20251214 21:05:11.215723 22809 ts_tablet_manager.cc:1403] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: Time spent bootstrapping tablet: real 0.352s user 0.348s sys 0.002s
I20251214 21:05:11.217821 22809 raft_consensus.cc:359] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:11.218200 22809 raft_consensus.cc:740] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d5b42d0e3b04c6dac537647db49a7c7, State: Initialized, Role: FOLLOWER
I20251214 21:05:11.218643 22809 consensus_queue.cc:260] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 207, Last appended: 1.207, Last appended by leader: 207, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:11.219326 22918 heartbeater.cc:499] Master 127.16.120.62:33629 was elected leader, sending a full tablet report...
I20251214 21:05:11.219487 22809 ts_tablet_manager.cc:1434] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20251214 21:05:11.927754 22931 raft_consensus.cc:493] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:05:11.927937 22931 raft_consensus.cc:515] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:11.929158 22931 leader_election.cc:290] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8d5b42d0e3b04c6dac537647db49a7c7 (127.16.120.3:35177), 2e1b7c5a377e473593468aa005781b8f (127.16.120.2:45083)
I20251214 21:05:11.934026 22872 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "36078dffd0dd482ab7d31b254cabb67d" candidate_uuid: "2076abbfbfbe48c08435ce85afd0fd34" candidate_term: 2 candidate_status { last_received { term: 1 index: 207 } } ignore_live_leader: false dest_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" is_pre_election: true
I20251214 21:05:11.934026 22737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "36078dffd0dd482ab7d31b254cabb67d" candidate_uuid: "2076abbfbfbe48c08435ce85afd0fd34" candidate_term: 2 candidate_status { last_received { term: 1 index: 207 } } ignore_live_leader: false dest_uuid: "2e1b7c5a377e473593468aa005781b8f" is_pre_election: true
I20251214 21:05:11.934285 22872 raft_consensus.cc:2468] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2076abbfbfbe48c08435ce85afd0fd34 in term 1.
I20251214 21:05:11.934284 22737 raft_consensus.cc:2468] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2076abbfbfbe48c08435ce85afd0fd34 in term 1.
I20251214 21:05:11.934994 22535 leader_election.cc:304] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2076abbfbfbe48c08435ce85afd0fd34, 2e1b7c5a377e473593468aa005781b8f; no voters:
I20251214 21:05:11.935323 22931 raft_consensus.cc:2804] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251214 21:05:11.935431 22931 raft_consensus.cc:493] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:05:11.935472 22931 raft_consensus.cc:3060] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:05:11.937338 22931 raft_consensus.cc:515] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:11.937675 22931 leader_election.cc:290] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [CANDIDATE]: Term 2 election: Requested vote from peers 8d5b42d0e3b04c6dac537647db49a7c7 (127.16.120.3:35177), 2e1b7c5a377e473593468aa005781b8f (127.16.120.2:45083)
I20251214 21:05:11.938047 22872 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "36078dffd0dd482ab7d31b254cabb67d" candidate_uuid: "2076abbfbfbe48c08435ce85afd0fd34" candidate_term: 2 candidate_status { last_received { term: 1 index: 207 } } ignore_live_leader: false dest_uuid: "8d5b42d0e3b04c6dac537647db49a7c7"
I20251214 21:05:11.938074 22737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "36078dffd0dd482ab7d31b254cabb67d" candidate_uuid: "2076abbfbfbe48c08435ce85afd0fd34" candidate_term: 2 candidate_status { last_received { term: 1 index: 207 } } ignore_live_leader: false dest_uuid: "2e1b7c5a377e473593468aa005781b8f"
I20251214 21:05:11.938160 22872 raft_consensus.cc:3060] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:05:11.938195 22737 raft_consensus.cc:3060] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 1 FOLLOWER]: Advancing to term 2
I20251214 21:05:11.939700 22737 raft_consensus.cc:2468] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2076abbfbfbe48c08435ce85afd0fd34 in term 2.
I20251214 21:05:11.939715 22872 raft_consensus.cc:2468] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2076abbfbfbe48c08435ce85afd0fd34 in term 2.
I20251214 21:05:11.940022 22534 leader_election.cc:304] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2076abbfbfbe48c08435ce85afd0fd34, 8d5b42d0e3b04c6dac537647db49a7c7; no voters:
I20251214 21:05:11.940200 22931 raft_consensus.cc:2804] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 2 FOLLOWER]: Leader election won for term 2
I20251214 21:05:11.940382 22931 raft_consensus.cc:697] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 2 LEADER]: Becoming Leader. State: Replica: 2076abbfbfbe48c08435ce85afd0fd34, State: Running, Role: LEADER
I20251214 21:05:11.940666 22931 consensus_queue.cc:237] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 207, Committed index: 207, Last appended: 1.207, Last appended by leader: 207, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:11.943440 22459 catalog_manager.cc:5654] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 reported cstate change: term changed from 0 to 2, leader changed from <none> to 2076abbfbfbe48c08435ce85afd0fd34 (127.16.120.1), VOTER 2076abbfbfbe48c08435ce85afd0fd34 (127.16.120.1) added, VOTER 2e1b7c5a377e473593468aa005781b8f (127.16.120.2) added, VOTER 8d5b42d0e3b04c6dac537647db49a7c7 (127.16.120.3) added. New cstate: current_term: 2 leader_uuid: "2076abbfbfbe48c08435ce85afd0fd34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } health_report { overall_health: UNKNOWN } } }
I20251214 21:05:12.357434 22872 raft_consensus.cc:1275] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 2 FOLLOWER]: Refusing update from remote peer 2076abbfbfbe48c08435ce85afd0fd34: Log matching property violated. Preceding OpId in replica: term: 1 index: 207. Preceding OpId from leader: term: 2 index: 208. (index mismatch)
I20251214 21:05:12.358214 22931 consensus_queue.cc:1048] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 208, Last known committed idx: 207, Time since last communication: 0.000s
I20251214 21:05:12.362675 22737 raft_consensus.cc:1275] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 2 FOLLOWER]: Refusing update from remote peer 2076abbfbfbe48c08435ce85afd0fd34: Log matching property violated. Preceding OpId in replica: term: 1 index: 207. Preceding OpId from leader: term: 2 index: 208. (index mismatch)
I20251214 21:05:12.363260 22931 consensus_queue.cc:1048] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 208, Last known committed idx: 207, Time since last communication: 0.000s
I20251214 21:05:12.370855 22601 consensus_queue.cc:237] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 208, Committed index: 208, Last appended: 2.208, Last appended by leader: 207, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } }
I20251214 21:05:12.371903 22872 raft_consensus.cc:1275] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 2 FOLLOWER]: Refusing update from remote peer 2076abbfbfbe48c08435ce85afd0fd34: Log matching property violated. Preceding OpId in replica: term: 2 index: 208. Preceding OpId from leader: term: 2 index: 209. (index mismatch)
I20251214 21:05:12.372249 22931 consensus_queue.cc:1048] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 209, Last known committed idx: 208, Time since last communication: 0.000s
I20251214 21:05:12.373910 22936 raft_consensus.cc:2955] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 2 LEADER]: Committing config change with OpId 2.209: config changed from index -1 to 209, VOTER 2e1b7c5a377e473593468aa005781b8f (127.16.120.2) evicted. New config: { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } }
I20251214 21:05:12.374243 22872 raft_consensus.cc:2955] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 2 FOLLOWER]: Committing config change with OpId 2.209: config changed from index -1 to 209, VOTER 2e1b7c5a377e473593468aa005781b8f (127.16.120.2) evicted. New config: { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } }
I20251214 21:05:12.376183 22444 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 36078dffd0dd482ab7d31b254cabb67d with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:05:12.376471 22459 catalog_manager.cc:5654] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 reported cstate change: config changed from index -1 to 209, VOTER 2e1b7c5a377e473593468aa005781b8f (127.16.120.2) evicted. New cstate: current_term: 2 leader_uuid: "2076abbfbfbe48c08435ce85afd0fd34" committed_config { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } }
I20251214 21:05:12.379264 22601 consensus_queue.cc:237] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 209, Committed index: 209, Last appended: 2.209, Last appended by leader: 207, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 210 OBSOLETE_local: false peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } }
I20251214 21:05:12.379762 22931 raft_consensus.cc:2955] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 2 LEADER]: Committing config change with OpId 2.210: config changed from index 209 to 210, VOTER 8d5b42d0e3b04c6dac537647db49a7c7 (127.16.120.3) evicted. New config: { opid_index: 210 OBSOLETE_local: false peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } }
I20251214 21:05:12.380990 22444 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 36078dffd0dd482ab7d31b254cabb67d with cas_config_opid_index 209: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251214 21:05:12.381559 22459 catalog_manager.cc:5654] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 reported cstate change: config changed from index 209 to 210, VOTER 8d5b42d0e3b04c6dac537647db49a7c7 (127.16.120.3) evicted. New cstate: current_term: 2 leader_uuid: "2076abbfbfbe48c08435ce85afd0fd34" committed_config { opid_index: 210 OBSOLETE_local: false peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } health_report { overall_health: HEALTHY } } }
I20251214 21:05:12.383064 22716 tablet_service.cc:1552] Processing DeleteTablet for tablet 36078dffd0dd482ab7d31b254cabb67d with delete_type TABLET_DATA_TOMBSTONED (TS 2e1b7c5a377e473593468aa005781b8f not found in new config with opid_index 209) from {username='slave'} at 127.0.0.1:51474
I20251214 21:05:12.383631 22951 tablet_replica.cc:333] stopping tablet replica
I20251214 21:05:12.383937 22951 raft_consensus.cc:2243] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:05:12.384188 22951 raft_consensus.cc:2272] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:05:12.385471 22951 ts_tablet_manager.cc:1916] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:05:12.387153 22852 tablet_service.cc:1552] Processing DeleteTablet for tablet 36078dffd0dd482ab7d31b254cabb67d with delete_type TABLET_DATA_TOMBSTONED (TS 8d5b42d0e3b04c6dac537647db49a7c7 not found in new config with opid_index 210) from {username='slave'} at 127.0.0.1:55650
I20251214 21:05:12.387655 22952 tablet_replica.cc:333] stopping tablet replica
I20251214 21:05:12.387943 22952 raft_consensus.cc:2243] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251214 21:05:12.388077 22951 ts_tablet_manager.cc:1929] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.208
I20251214 21:05:12.388159 22951 log.cc:1199] T 36078dffd0dd482ab7d31b254cabb67d P 2e1b7c5a377e473593468aa005781b8f: Deleting WAL directory at /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/wal/wals/36078dffd0dd482ab7d31b254cabb67d
I20251214 21:05:12.388216 22952 raft_consensus.cc:2272] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:05:12.388824 22446 catalog_manager.cc:4985] TS 2e1b7c5a377e473593468aa005781b8f (127.16.120.2:45083): tablet 36078dffd0dd482ab7d31b254cabb67d (table pre_rebuild [id=cd723f32e41945eb8fce75c11dc5fc7f]) successfully deleted
I20251214 21:05:12.389523 22952 ts_tablet_manager.cc:1916] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251214 21:05:12.391566 22952 ts_tablet_manager.cc:1929] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.209
I20251214 21:05:12.391640 22952 log.cc:1199] T 36078dffd0dd482ab7d31b254cabb67d P 8d5b42d0e3b04c6dac537647db49a7c7: Deleting WAL directory at /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/wal/wals/36078dffd0dd482ab7d31b254cabb67d
I20251214 21:05:12.392166 22445 catalog_manager.cc:4985] TS 8d5b42d0e3b04c6dac537647db49a7c7 (127.16.120.3:35177): tablet 36078dffd0dd482ab7d31b254cabb67d (table pre_rebuild [id=cd723f32e41945eb8fce75c11dc5fc7f]) successfully deleted
W20251214 21:05:12.461812 16864 scanner-internal.cc:458] Time spent opening tablet: real 1.561s user 0.003s sys 0.000s
I20251214 21:05:12.565546 22581 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251214 21:05:12.567742 22852 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:12.575071 22716 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
cca8878ec7794fa2a761a1da6d1af84f | 127.16.120.62:33629 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.16.120.20:41109 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
2076abbfbfbe48c08435ce85afd0fd34 | 127.16.120.1:45025 | HEALTHY | <none> | 1 | 0
2e1b7c5a377e473593468aa005781b8f | 127.16.120.2:45083 | HEALTHY | <none> | 0 | 0
8d5b42d0e3b04c6dac537647db49a7c7 | 127.16.120.3:35177 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.16.120.1 | experimental | 127.16.120.1:45025
local_ip_for_outbound_sockets | 127.16.120.2 | experimental | 127.16.120.2:45083
local_ip_for_outbound_sockets | 127.16.120.3 | experimental | 127.16.120.3:35177
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data/info.pb | hidden | 127.16.120.1:45025
server_dump_info_path | /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data/info.pb | hidden | 127.16.120.2:45083
server_dump_info_path | /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data/info.pb | hidden | 127.16.120.3:35177
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.16.120.20:41109 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-------------+----+---------+---------------+---------+------------+------------------+-------------
pre_rebuild | 1 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 0
Median | 0
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 1
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20251214 21:05:12.601562 16864 log_verifier.cc:126] Checking tablet 36078dffd0dd482ab7d31b254cabb67d
I20251214 21:05:12.634219 16864 log_verifier.cc:177] Verified matching terms for 210 ops in tablet 36078dffd0dd482ab7d31b254cabb67d
I20251214 21:05:12.635231 22458 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60586:
table { table_name: "pre_rebuild" } modify_external_catalogs: true
I20251214 21:05:12.635380 22458 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60586:
table { table_name: "pre_rebuild" } modify_external_catalogs: true
I20251214 21:05:12.637857 22458 catalog_manager.cc:5941] T 00000000000000000000000000000000 P cca8878ec7794fa2a761a1da6d1af84f: Sending DeleteTablet for 1 replicas of tablet 36078dffd0dd482ab7d31b254cabb67d
I20251214 21:05:12.638581 16864 test_util.cc:276] Using random seed: -642092943
I20251214 21:05:12.638617 22581 tablet_service.cc:1552] Processing DeleteTablet for tablet 36078dffd0dd482ab7d31b254cabb67d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-14 21:05:12 UTC) from {username='slave'} at 127.0.0.1:45862
I20251214 21:05:12.639156 22981 tablet_replica.cc:333] stopping tablet replica
I20251214 21:05:12.639508 22981 raft_consensus.cc:2243] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 2 LEADER]: Raft consensus shutting down.
I20251214 21:05:12.639710 22981 raft_consensus.cc:2272] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251214 21:05:12.641798 22981 ts_tablet_manager.cc:1916] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251214 21:05:12.645262 22981 ts_tablet_manager.cc:1929] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.210
I20251214 21:05:12.645375 22981 log.cc:1199] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Deleting WAL directory at /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/wal/wals/36078dffd0dd482ab7d31b254cabb67d
I20251214 21:05:12.645797 22981 ts_tablet_manager.cc:1950] T 36078dffd0dd482ab7d31b254cabb67d P 2076abbfbfbe48c08435ce85afd0fd34: Deleting consensus metadata
I20251214 21:05:12.646909 22444 catalog_manager.cc:4985] TS 2076abbfbfbe48c08435ce85afd0fd34 (127.16.120.1:45025): tablet 36078dffd0dd482ab7d31b254cabb67d (table pre_rebuild [id=cd723f32e41945eb8fce75c11dc5fc7f]) successfully deleted
I20251214 21:05:12.649057 22458 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53252:
name: "post_rebuild"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251214 21:05:12.650550 22458 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table post_rebuild in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251214 21:05:12.656666 22581 tablet_service.cc:1505] Processing CreateTablet for tablet 897cd72bfe634bfcbd33e90aa1bbdce2 (DEFAULT_TABLE table=post_rebuild [id=bb63940f86f149ecb7fb683f7d98ad22]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:05:12.657088 22852 tablet_service.cc:1505] Processing CreateTablet for tablet 897cd72bfe634bfcbd33e90aa1bbdce2 (DEFAULT_TABLE table=post_rebuild [id=bb63940f86f149ecb7fb683f7d98ad22]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:05:12.657088 22716 tablet_service.cc:1505] Processing CreateTablet for tablet 897cd72bfe634bfcbd33e90aa1bbdce2 (DEFAULT_TABLE table=post_rebuild [id=bb63940f86f149ecb7fb683f7d98ad22]), partition=RANGE (key) PARTITION UNBOUNDED
I20251214 21:05:12.657213 22581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897cd72bfe634bfcbd33e90aa1bbdce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:05:12.657620 22852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897cd72bfe634bfcbd33e90aa1bbdce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:05:12.657620 22716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897cd72bfe634bfcbd33e90aa1bbdce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251214 21:05:12.659395 22987 tablet_bootstrap.cc:492] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34: Bootstrap starting.
I20251214 21:05:12.660077 22989 tablet_bootstrap.cc:492] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2e1b7c5a377e473593468aa005781b8f: Bootstrap starting.
I20251214 21:05:12.660442 22987 tablet_bootstrap.cc:654] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34: Neither blocks nor log segments found. Creating new log.
I20251214 21:05:12.660909 22989 tablet_bootstrap.cc:654] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2e1b7c5a377e473593468aa005781b8f: Neither blocks nor log segments found. Creating new log.
I20251214 21:05:12.661440 22987 tablet_bootstrap.cc:492] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34: No bootstrap required, opened a new log
I20251214 21:05:12.661536 22987 ts_tablet_manager.cc:1403] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:05:12.661599 22988 tablet_bootstrap.cc:492] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 8d5b42d0e3b04c6dac537647db49a7c7: Bootstrap starting.
I20251214 21:05:12.662012 22989 tablet_bootstrap.cc:492] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2e1b7c5a377e473593468aa005781b8f: No bootstrap required, opened a new log
I20251214 21:05:12.661978 22987 raft_consensus.cc:359] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:12.662077 22987 raft_consensus.cc:385] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:05:12.662094 22989 ts_tablet_manager.cc:1403] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2e1b7c5a377e473593468aa005781b8f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251214 21:05:12.662124 22987 raft_consensus.cc:740] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2076abbfbfbe48c08435ce85afd0fd34, State: Initialized, Role: FOLLOWER
I20251214 21:05:12.662271 22987 consensus_queue.cc:260] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:12.662463 22988 tablet_bootstrap.cc:654] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 8d5b42d0e3b04c6dac537647db49a7c7: Neither blocks nor log segments found. Creating new log.
I20251214 21:05:12.662631 22987 ts_tablet_manager.cc:1434] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:05:12.662590 22989 raft_consensus.cc:359] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2e1b7c5a377e473593468aa005781b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:12.662846 22989 raft_consensus.cc:385] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2e1b7c5a377e473593468aa005781b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:05:12.662895 22989 raft_consensus.cc:740] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2e1b7c5a377e473593468aa005781b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e1b7c5a377e473593468aa005781b8f, State: Initialized, Role: FOLLOWER
I20251214 21:05:12.663015 22989 consensus_queue.cc:260] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2e1b7c5a377e473593468aa005781b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:12.663277 22989 ts_tablet_manager.cc:1434] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2e1b7c5a377e473593468aa005781b8f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251214 21:05:12.663543 22988 tablet_bootstrap.cc:492] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 8d5b42d0e3b04c6dac537647db49a7c7: No bootstrap required, opened a new log
I20251214 21:05:12.663602 22988 ts_tablet_manager.cc:1403] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 8d5b42d0e3b04c6dac537647db49a7c7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251214 21:05:12.664103 22988 raft_consensus.cc:359] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 8d5b42d0e3b04c6dac537647db49a7c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:12.664206 22988 raft_consensus.cc:385] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 8d5b42d0e3b04c6dac537647db49a7c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251214 21:05:12.664248 22988 raft_consensus.cc:740] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 8d5b42d0e3b04c6dac537647db49a7c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d5b42d0e3b04c6dac537647db49a7c7, State: Initialized, Role: FOLLOWER
I20251214 21:05:12.664369 22988 consensus_queue.cc:260] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 8d5b42d0e3b04c6dac537647db49a7c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:12.664615 22988 ts_tablet_manager.cc:1434] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 8d5b42d0e3b04c6dac537647db49a7c7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20251214 21:05:12.671000 22648 tablet.cc:2378] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251214 21:05:12.750487 22931 raft_consensus.cc:493] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251214 21:05:12.750628 22931 raft_consensus.cc:515] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:12.751061 22931 leader_election.cc:290] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d5b42d0e3b04c6dac537647db49a7c7 (127.16.120.3:35177), 2e1b7c5a377e473593468aa005781b8f (127.16.120.2:45083)
I20251214 21:05:12.751488 22872 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "897cd72bfe634bfcbd33e90aa1bbdce2" candidate_uuid: "2076abbfbfbe48c08435ce85afd0fd34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" is_pre_election: true
I20251214 21:05:12.751513 22737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "897cd72bfe634bfcbd33e90aa1bbdce2" candidate_uuid: "2076abbfbfbe48c08435ce85afd0fd34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e1b7c5a377e473593468aa005781b8f" is_pre_election: true
I20251214 21:05:12.751634 22872 raft_consensus.cc:2468] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 8d5b42d0e3b04c6dac537647db49a7c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2076abbfbfbe48c08435ce85afd0fd34 in term 0.
I20251214 21:05:12.751654 22737 raft_consensus.cc:2468] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2e1b7c5a377e473593468aa005781b8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2076abbfbfbe48c08435ce85afd0fd34 in term 0.
I20251214 21:05:12.751930 22535 leader_election.cc:304] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2076abbfbfbe48c08435ce85afd0fd34, 2e1b7c5a377e473593468aa005781b8f; no voters:
I20251214 21:05:12.752095 22931 raft_consensus.cc:2804] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251214 21:05:12.752152 22931 raft_consensus.cc:493] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251214 21:05:12.752192 22931 raft_consensus.cc:3060] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:05:12.752978 22931 raft_consensus.cc:515] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:12.753266 22931 leader_election.cc:290] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [CANDIDATE]: Term 1 election: Requested vote from peers 8d5b42d0e3b04c6dac537647db49a7c7 (127.16.120.3:35177), 2e1b7c5a377e473593468aa005781b8f (127.16.120.2:45083)
I20251214 21:05:12.753592 22872 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "897cd72bfe634bfcbd33e90aa1bbdce2" candidate_uuid: "2076abbfbfbe48c08435ce85afd0fd34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d5b42d0e3b04c6dac537647db49a7c7"
I20251214 21:05:12.753620 22737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "897cd72bfe634bfcbd33e90aa1bbdce2" candidate_uuid: "2076abbfbfbe48c08435ce85afd0fd34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e1b7c5a377e473593468aa005781b8f"
I20251214 21:05:12.753724 22872 raft_consensus.cc:3060] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 8d5b42d0e3b04c6dac537647db49a7c7 [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:05:12.753734 22737 raft_consensus.cc:3060] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2e1b7c5a377e473593468aa005781b8f [term 0 FOLLOWER]: Advancing to term 1
I20251214 21:05:12.754595 22872 raft_consensus.cc:2468] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 8d5b42d0e3b04c6dac537647db49a7c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2076abbfbfbe48c08435ce85afd0fd34 in term 1.
I20251214 21:05:12.754652 22737 raft_consensus.cc:2468] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2e1b7c5a377e473593468aa005781b8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2076abbfbfbe48c08435ce85afd0fd34 in term 1.
I20251214 21:05:12.754870 22534 leader_election.cc:304] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2076abbfbfbe48c08435ce85afd0fd34, 8d5b42d0e3b04c6dac537647db49a7c7; no voters:
I20251214 21:05:12.755033 22931 raft_consensus.cc:2804] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [term 1 FOLLOWER]: Leader election won for term 1
I20251214 21:05:12.755113 22931 raft_consensus.cc:697] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [term 1 LEADER]: Becoming Leader. State: Replica: 2076abbfbfbe48c08435ce85afd0fd34, State: Running, Role: LEADER
I20251214 21:05:12.755249 22931 consensus_queue.cc:237] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } } peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } }
I20251214 21:05:12.756752 22459 catalog_manager.cc:5654] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2076abbfbfbe48c08435ce85afd0fd34 (127.16.120.1). New cstate: current_term: 1 leader_uuid: "2076abbfbfbe48c08435ce85afd0fd34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2076abbfbfbe48c08435ce85afd0fd34" member_type: VOTER last_known_addr { host: "127.16.120.1" port: 45025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 } health_report { overall_health: UNKNOWN } } }
I20251214 21:05:12.805532 22737 raft_consensus.cc:1275] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2e1b7c5a377e473593468aa005781b8f [term 1 FOLLOWER]: Refusing update from remote peer 2076abbfbfbe48c08435ce85afd0fd34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:05:12.805668 22872 raft_consensus.cc:1275] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 8d5b42d0e3b04c6dac537647db49a7c7 [term 1 FOLLOWER]: Refusing update from remote peer 2076abbfbfbe48c08435ce85afd0fd34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251214 21:05:12.806034 22931 consensus_queue.cc:1048] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e1b7c5a377e473593468aa005781b8f" member_type: VOTER last_known_addr { host: "127.16.120.2" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:05:12.806208 22936 consensus_queue.cc:1048] T 897cd72bfe634bfcbd33e90aa1bbdce2 P 2076abbfbfbe48c08435ce85afd0fd34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d5b42d0e3b04c6dac537647db49a7c7" member_type: VOTER last_known_addr { host: "127.16.120.3" port: 35177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251214 21:05:12.810542 22944 mvcc.cc:204] Tried to move back new op lower bound from 7232496897250521088 to 7232496897046749184. Current Snapshot: MvccSnapshot[applied={T|T < 7232496897247145984}]
I20251214 21:05:12.811964 22950 mvcc.cc:204] Tried to move back new op lower bound from 7232496897250521088 to 7232496897046749184. Current Snapshot: MvccSnapshot[applied={T|T < 7232496897247145984}]
I20251214 21:05:13.583209 22581 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251214 21:05:13.583657 22716 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251214 21:05:13.583909 22852 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
cca8878ec7794fa2a761a1da6d1af84f | 127.16.120.62:33629 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.16.120.20:41109 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
2076abbfbfbe48c08435ce85afd0fd34 | 127.16.120.1:45025 | HEALTHY | <none> | 1 | 0
2e1b7c5a377e473593468aa005781b8f | 127.16.120.2:45083 | HEALTHY | <none> | 0 | 0
8d5b42d0e3b04c6dac537647db49a7c7 | 127.16.120.3:35177 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.16.120.1 | experimental | 127.16.120.1:45025
local_ip_for_outbound_sockets | 127.16.120.2 | experimental | 127.16.120.2:45083
local_ip_for_outbound_sockets | 127.16.120.3 | experimental | 127.16.120.3:35177
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-0/data/info.pb | hidden | 127.16.120.1:45025
server_dump_info_path | /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-1/data/info.pb | hidden | 127.16.120.2:45083
server_dump_info_path | /tmp/dist-test-taskh3C4vt/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765746286170956-16864-0/minicluster-data/ts-2/data/info.pb | hidden | 127.16.120.3:35177
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.16.120.20:41109 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
--------------+----+---------+---------------+---------+------------+------------------+-------------
post_rebuild | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20251214 21:05:13.607504 16864 log_verifier.cc:126] Checking tablet 36078dffd0dd482ab7d31b254cabb67d
I20251214 21:05:13.607592 16864 log_verifier.cc:177] Verified matching terms for 0 ops in tablet 36078dffd0dd482ab7d31b254cabb67d
I20251214 21:05:13.607618 16864 log_verifier.cc:126] Checking tablet 897cd72bfe634bfcbd33e90aa1bbdce2
I20251214 21:05:13.697911 16864 log_verifier.cc:177] Verified matching terms for 207 ops in tablet 897cd72bfe634bfcbd33e90aa1bbdce2
I20251214 21:05:13.700917 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 22497
I20251214 21:05:13.707440 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 22651
I20251214 21:05:13.712849 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 22786
I20251214 21:05:13.718212 16864 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskh3C4vt/build/debug/bin/kudu with pid 22428
2025-12-14T21:05:13Z chronyd exiting
[ OK ] IsSecure/SecureClusterAdminCliParamTest.TestRebuildMaster/0 (6135 ms)
[----------] 1 test from IsSecure/SecureClusterAdminCliParamTest (6135 ms total)
[----------] Global test environment tear-down
[==========] 9 tests from 5 test suites ran. (27558 ms total)
[ PASSED ] 8 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] AdminCliTest.TestRebuildTables
1 FAILED TEST