Note: This is test shard 6 of 8.
[==========] Running 9 tests from 5 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from AdminCliTest
[ RUN ] AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20251212 09:11:00.444391 29802 test_util.cc:276] Using random seed: -1545922343
I20251212 09:11:00.449590 29802 ts_itest-base.cc:115] Starting cluster with:
I20251212 09:11:00.449637 29802 ts_itest-base.cc:116] --------------
I20251212 09:11:00.449649 29802 ts_itest-base.cc:117] 4 tablet servers
I20251212 09:11:00.449662 29802 ts_itest-base.cc:118] 3 replicas per TS
I20251212 09:11:00.449672 29802 ts_itest-base.cc:119] --------------
2025-12-12T09:11:00Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-12T09:11:00Z Disabled control of system clock
I20251212 09:11:00.457231 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:46575
--webserver_interface=127.29.26.190
--webserver_port=0
--builtin_ntp_servers=127.29.26.148:36375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.26.190:46575 with env {}
W20251212 09:11:00.535399 29814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:00.535545 29814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:00.535564 29814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:00.537014 29814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251212 09:11:00.537053 29814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:00.537067 29814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251212 09:11:00.537079 29814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251212 09:11:00.538595 29814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:36375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.26.190:46575
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:46575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.29.26.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.29814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:00.538764 29814 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:00.538944 29814 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:00.541752 29822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:00.541800 29814 server_base.cc:1047] running on GCE node
W20251212 09:11:00.541868 29819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:00.541757 29820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:00.542222 29814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:00.542455 29814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:00.543588 29814 hybrid_clock.cc:648] HybridClock initialized: now 1765530660543570 us; error 32 us; skew 500 ppm
I20251212 09:11:00.544729 29814 webserver.cc:492] Webserver started at http://127.29.26.190:44707/ using document root <none> and password file <none>
I20251212 09:11:00.544916 29814 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:00.544979 29814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:00.545089 29814 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:00.545912 29814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "9ae9043f512243549de97c4fa310883b"
format_stamp: "Formatted at 2025-12-12 09:11:00 on dist-test-slave-qqr7"
I20251212 09:11:00.546214 29814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "9ae9043f512243549de97c4fa310883b"
format_stamp: "Formatted at 2025-12-12 09:11:00 on dist-test-slave-qqr7"
I20251212 09:11:00.547334 29814 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251212 09:11:00.548055 29828 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:00.548235 29814 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251212 09:11:00.548306 29814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
uuid: "9ae9043f512243549de97c4fa310883b"
format_stamp: "Formatted at 2025-12-12 09:11:00 on dist-test-slave-qqr7"
I20251212 09:11:00.548364 29814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:00.568733 29814 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:00.569037 29814 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:00.569155 29814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:00.572785 29814 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.190:46575
I20251212 09:11:00.572815 29880 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.190:46575 every 8 connection(s)
I20251212 09:11:00.573145 29814 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251212 09:11:00.573758 29881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:00.576115 29881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b: Bootstrap starting.
I20251212 09:11:00.576699 29881 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:00.576960 29881 log.cc:826] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:00.577498 29881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b: No bootstrap required, opened a new log
I20251212 09:11:00.578639 29881 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae9043f512243549de97c4fa310883b" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 46575 } }
I20251212 09:11:00.578756 29881 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:00.578788 29881 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae9043f512243549de97c4fa310883b, State: Initialized, Role: FOLLOWER
I20251212 09:11:00.578912 29881 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae9043f512243549de97c4fa310883b" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 46575 } }
I20251212 09:11:00.578966 29881 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:00.578989 29881 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:00.579038 29881 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:00.579499 29881 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae9043f512243549de97c4fa310883b" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 46575 } }
I20251212 09:11:00.579602 29881 leader_election.cc:304] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ae9043f512243549de97c4fa310883b; no voters:
I20251212 09:11:00.579731 29881 leader_election.cc:290] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [CANDIDATE]: Term 1 election: Requested vote from peers
I20251212 09:11:00.579777 29884 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:00.579907 29884 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 1 LEADER]: Becoming Leader. State: Replica: 9ae9043f512243549de97c4fa310883b, State: Running, Role: LEADER
I20251212 09:11:00.579974 29881 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [sys.catalog]: configured and running, proceeding with master startup.
I20251212 09:11:00.580034 29884 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae9043f512243549de97c4fa310883b" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 46575 } }
I20251212 09:11:00.580384 29886 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ae9043f512243549de97c4fa310883b. Latest consensus state: current_term: 1 leader_uuid: "9ae9043f512243549de97c4fa310883b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae9043f512243549de97c4fa310883b" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 46575 } } }
I20251212 09:11:00.580365 29885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ae9043f512243549de97c4fa310883b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae9043f512243549de97c4fa310883b" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 46575 } } }
I20251212 09:11:00.580483 29886 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:00.580572 29885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:00.580845 29892 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251212 09:11:00.580972 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 29814
I20251212 09:11:00.581074 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251212 09:11:00.581265 29892 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251212 09:11:00.583447 29892 catalog_manager.cc:1357] Generated new cluster ID: 24dfb2dc2d1347c2a34154311336554e
I20251212 09:11:00.583508 29892 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251212 09:11:00.587669 29892 catalog_manager.cc:1380] Generated new certificate authority record
I20251212 09:11:00.588174 29892 catalog_manager.cc:1514] Loading token signing keys...
I20251212 09:11:00.594529 29892 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b: Generated new TSK 0
I20251212 09:11:00.594684 29892 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251212 09:11:00.596109 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.129:0
--local_ip_for_outbound_sockets=127.29.26.129
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:46575
--builtin_ntp_servers=127.29.26.148:36375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251212 09:11:00.674106 29905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:00.674273 29905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:00.674293 29905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:00.675694 29905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:00.675748 29905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.129
I20251212 09:11:00.677233 29905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:36375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:46575
--never_fsync=true
--heap_profile_path=/tmp/kudu.29905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.129
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:00.677429 29905 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:00.677649 29905 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:00.680155 29911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:00.680239 29905 server_base.cc:1047] running on GCE node
W20251212 09:11:00.680186 29913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:00.680366 29910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:00.680564 29905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:00.680822 29905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:00.681962 29905 hybrid_clock.cc:648] HybridClock initialized: now 1765530660681945 us; error 31 us; skew 500 ppm
I20251212 09:11:00.683290 29905 webserver.cc:492] Webserver started at http://127.29.26.129:40663/ using document root <none> and password file <none>
I20251212 09:11:00.683504 29905 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:00.683554 29905 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:00.683679 29905 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:00.684734 29905 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "aedd51aeeabb4698869d429446ae2e38"
format_stamp: "Formatted at 2025-12-12 09:11:00 on dist-test-slave-qqr7"
I20251212 09:11:00.685072 29905 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "aedd51aeeabb4698869d429446ae2e38"
format_stamp: "Formatted at 2025-12-12 09:11:00 on dist-test-slave-qqr7"
I20251212 09:11:00.687214 29905 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20251212 09:11:00.688202 29919 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:00.688469 29905 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:00.688577 29905 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "aedd51aeeabb4698869d429446ae2e38"
format_stamp: "Formatted at 2025-12-12 09:11:00 on dist-test-slave-qqr7"
I20251212 09:11:00.688642 29905 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:00.715214 29905 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:00.715452 29905 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:00.715552 29905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:00.715767 29905 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:00.716090 29905 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:00.716125 29905 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:00.716159 29905 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:00.716187 29905 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:00.721789 29905 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.129:45189
I20251212 09:11:00.721848 30032 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.129:45189 every 8 connection(s)
I20251212 09:11:00.722174 29905 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251212 09:11:00.726712 30033 heartbeater.cc:344] Connected to a master server at 127.29.26.190:46575
I20251212 09:11:00.726816 30033 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:00.727031 30033 heartbeater.cc:507] Master 127.29.26.190:46575 requested a full tablet report, sending...
I20251212 09:11:00.727486 29845 ts_manager.cc:194] Registered new tserver with Master: aedd51aeeabb4698869d429446ae2e38 (127.29.26.129:45189)
I20251212 09:11:00.728148 29845 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.129:33791
I20251212 09:11:00.730733 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 29905
I20251212 09:11:00.730813 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251212 09:11:00.731833 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.130:0
--local_ip_for_outbound_sockets=127.29.26.130
--webserver_interface=127.29.26.130
--webserver_port=0
--tserver_master_addrs=127.29.26.190:46575
--builtin_ntp_servers=127.29.26.148:36375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251212 09:11:00.812302 30036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:00.812463 30036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:00.812482 30036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:00.813804 30036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:00.813850 30036 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.130
I20251212 09:11:00.815259 30036 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:36375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.29.26.130
--webserver_port=0
--tserver_master_addrs=127.29.26.190:46575
--never_fsync=true
--heap_profile_path=/tmp/kudu.30036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.130
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:00.815438 30036 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:00.815625 30036 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:00.818356 30042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:00.818456 30041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:00.818511 30036 server_base.cc:1047] running on GCE node
W20251212 09:11:00.818359 30044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:00.818770 30036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:00.819026 30036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:00.820209 30036 hybrid_clock.cc:648] HybridClock initialized: now 1765530660820191 us; error 33 us; skew 500 ppm
I20251212 09:11:00.821475 30036 webserver.cc:492] Webserver started at http://127.29.26.130:43749/ using document root <none> and password file <none>
I20251212 09:11:00.821667 30036 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:00.821710 30036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:00.821812 30036 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:00.822667 30036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "5242b95842e04aed93681cba4955dc7d"
format_stamp: "Formatted at 2025-12-12 09:11:00 on dist-test-slave-qqr7"
I20251212 09:11:00.822949 30036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "5242b95842e04aed93681cba4955dc7d"
format_stamp: "Formatted at 2025-12-12 09:11:00 on dist-test-slave-qqr7"
I20251212 09:11:00.824254 30036 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20251212 09:11:00.825002 30050 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:00.825202 30036 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:00.825268 30036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "5242b95842e04aed93681cba4955dc7d"
format_stamp: "Formatted at 2025-12-12 09:11:00 on dist-test-slave-qqr7"
I20251212 09:11:00.825323 30036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:00.835343 30036 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:00.835554 30036 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:00.835654 30036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:00.835816 30036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:00.836094 30036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:00.836128 30036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:00.836160 30036 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:00.836180 30036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:00.841789 30036 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.130:36805
I20251212 09:11:00.841838 30163 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.130:36805 every 8 connection(s)
I20251212 09:11:00.842160 30036 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251212 09:11:00.846378 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 30036
I20251212 09:11:00.846462 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251212 09:11:00.846729 30164 heartbeater.cc:344] Connected to a master server at 127.29.26.190:46575
I20251212 09:11:00.846819 30164 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:00.847074 30164 heartbeater.cc:507] Master 127.29.26.190:46575 requested a full tablet report, sending...
I20251212 09:11:00.847417 29845 ts_manager.cc:194] Registered new tserver with Master: 5242b95842e04aed93681cba4955dc7d (127.29.26.130:36805)
I20251212 09:11:00.847468 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.131:0
--local_ip_for_outbound_sockets=127.29.26.131
--webserver_interface=127.29.26.131
--webserver_port=0
--tserver_master_addrs=127.29.26.190:46575
--builtin_ntp_servers=127.29.26.148:36375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251212 09:11:00.847925 29845 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.130:35347
W20251212 09:11:00.926673 30167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:00.926838 30167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:00.926858 30167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:00.928242 30167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:00.928290 30167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.131
I20251212 09:11:00.929905 30167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:36375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.29.26.131
--webserver_port=0
--tserver_master_addrs=127.29.26.190:46575
--never_fsync=true
--heap_profile_path=/tmp/kudu.30167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.131
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:00.930119 30167 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:00.930348 30167 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:00.932895 30173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:00.932920 30175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:00.932957 30167 server_base.cc:1047] running on GCE node
W20251212 09:11:00.933138 30172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:00.933354 30167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:00.933552 30167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:00.934671 30167 hybrid_clock.cc:648] HybridClock initialized: now 1765530660934662 us; error 30 us; skew 500 ppm
I20251212 09:11:00.935742 30167 webserver.cc:492] Webserver started at http://127.29.26.131:45983/ using document root <none> and password file <none>
I20251212 09:11:00.935916 30167 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:00.935993 30167 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:00.936100 30167 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:00.936923 30167 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "87bb558a8119434ab926b546699b0b73"
format_stamp: "Formatted at 2025-12-12 09:11:00 on dist-test-slave-qqr7"
I20251212 09:11:00.937213 30167 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "87bb558a8119434ab926b546699b0b73"
format_stamp: "Formatted at 2025-12-12 09:11:00 on dist-test-slave-qqr7"
I20251212 09:11:00.938318 30167 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:00.938956 30181 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:00.939126 30167 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:00.939194 30167 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "87bb558a8119434ab926b546699b0b73"
format_stamp: "Formatted at 2025-12-12 09:11:00 on dist-test-slave-qqr7"
I20251212 09:11:00.939253 30167 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:00.969517 30167 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:00.969775 30167 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:00.969887 30167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:00.970096 30167 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:00.970422 30167 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:00.970453 30167 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:00.970487 30167 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:00.970515 30167 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:00.975895 30167 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.131:42503
I20251212 09:11:00.975971 30294 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.131:42503 every 8 connection(s)
I20251212 09:11:00.976244 30167 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251212 09:11:00.982131 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 30167
I20251212 09:11:00.982214 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251212 09:11:00.983366 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.132:0
--local_ip_for_outbound_sockets=127.29.26.132
--webserver_interface=127.29.26.132
--webserver_port=0
--tserver_master_addrs=127.29.26.190:46575
--builtin_ntp_servers=127.29.26.148:36375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251212 09:11:00.984148 30295 heartbeater.cc:344] Connected to a master server at 127.29.26.190:46575
I20251212 09:11:00.984251 30295 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:00.984450 30295 heartbeater.cc:507] Master 127.29.26.190:46575 requested a full tablet report, sending...
I20251212 09:11:00.984802 29845 ts_manager.cc:194] Registered new tserver with Master: 87bb558a8119434ab926b546699b0b73 (127.29.26.131:42503)
I20251212 09:11:00.985177 29845 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.131:40705
W20251212 09:11:01.061260 30298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:01.061424 30298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:01.061443 30298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:01.062852 30298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:01.062907 30298 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.132
I20251212 09:11:01.064378 30298 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:36375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.29.26.132
--webserver_port=0
--tserver_master_addrs=127.29.26.190:46575
--never_fsync=true
--heap_profile_path=/tmp/kudu.30298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.132
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:01.064599 30298 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:01.064839 30298 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:01.067461 30306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:01.067466 30304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:01.067606 30298 server_base.cc:1047] running on GCE node
W20251212 09:11:01.067508 30303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:01.067830 30298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:01.068054 30298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:01.069185 30298 hybrid_clock.cc:648] HybridClock initialized: now 1765530661069171 us; error 27 us; skew 500 ppm
I20251212 09:11:01.070274 30298 webserver.cc:492] Webserver started at http://127.29.26.132:36511/ using document root <none> and password file <none>
I20251212 09:11:01.070465 30298 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:01.070508 30298 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:01.070619 30298 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:01.071435 30298 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "f46f26cfce6c42b0a42d89edb7c29a90"
format_stamp: "Formatted at 2025-12-12 09:11:01 on dist-test-slave-qqr7"
I20251212 09:11:01.071724 30298 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "f46f26cfce6c42b0a42d89edb7c29a90"
format_stamp: "Formatted at 2025-12-12 09:11:01 on dist-test-slave-qqr7"
I20251212 09:11:01.072917 30298 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251212 09:11:01.073608 30312 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:01.073758 30298 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251212 09:11:01.073827 30298 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "f46f26cfce6c42b0a42d89edb7c29a90"
format_stamp: "Formatted at 2025-12-12 09:11:01 on dist-test-slave-qqr7"
I20251212 09:11:01.073882 30298 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:01.092402 30298 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:01.092743 30298 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:01.092859 30298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:01.093072 30298 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:01.093375 30298 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:01.093408 30298 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:01.093443 30298 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:01.093468 30298 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:01.099058 30298 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.132:38705
I20251212 09:11:01.099102 30426 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.132:38705 every 8 connection(s)
I20251212 09:11:01.099385 30298 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20251212 09:11:01.103631 30427 heartbeater.cc:344] Connected to a master server at 127.29.26.190:46575
I20251212 09:11:01.103732 30427 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:01.103931 30427 heartbeater.cc:507] Master 127.29.26.190:46575 requested a full tablet report, sending...
I20251212 09:11:01.104270 29845 ts_manager.cc:194] Registered new tserver with Master: f46f26cfce6c42b0a42d89edb7c29a90 (127.29.26.132:38705)
I20251212 09:11:01.104629 29845 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.132:52957
I20251212 09:11:01.107779 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 30298
I20251212 09:11:01.107851 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20251212 09:11:01.108875 29802 external_mini_cluster.cc:949] 4 TS(s) registered with all masters
I20251212 09:11:01.114790 29845 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41808:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20251212 09:11:01.122596 30229 tablet_service.cc:1505] Processing CreateTablet for tablet 186fcf0dfc304bb687605965125ec039 (DEFAULT_TABLE table=TestTable [id=b782cac30df44561aadeb5e755f9a139]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:01.122881 30229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186fcf0dfc304bb687605965125ec039. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:01.122867 30098 tablet_service.cc:1505] Processing CreateTablet for tablet 186fcf0dfc304bb687605965125ec039 (DEFAULT_TABLE table=TestTable [id=b782cac30df44561aadeb5e755f9a139]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:01.123142 30098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186fcf0dfc304bb687605965125ec039. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:01.125352 30444 tablet_bootstrap.cc:492] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d: Bootstrap starting.
I20251212 09:11:01.125722 30445 tablet_bootstrap.cc:492] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73: Bootstrap starting.
I20251212 09:11:01.125775 29967 tablet_service.cc:1505] Processing CreateTablet for tablet 186fcf0dfc304bb687605965125ec039 (DEFAULT_TABLE table=TestTable [id=b782cac30df44561aadeb5e755f9a139]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:01.126071 29967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186fcf0dfc304bb687605965125ec039. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:01.126133 30444 tablet_bootstrap.cc:654] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:01.126293 30445 tablet_bootstrap.cc:654] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:01.126461 30444 log.cc:826] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:01.126561 30445 log.cc:826] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:01.127161 30445 tablet_bootstrap.cc:492] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73: No bootstrap required, opened a new log
I20251212 09:11:01.127228 30445 ts_tablet_manager.cc:1403] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251212 09:11:01.128281 30445 raft_consensus.cc:359] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "5242b95842e04aed93681cba4955dc7d" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36805 } }
I20251212 09:11:01.128369 30448 tablet_bootstrap.cc:492] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38: Bootstrap starting.
I20251212 09:11:01.128441 30445 raft_consensus.cc:385] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:01.128505 30445 raft_consensus.cc:740] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87bb558a8119434ab926b546699b0b73, State: Initialized, Role: FOLLOWER
I20251212 09:11:01.128623 30445 consensus_queue.cc:260] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "5242b95842e04aed93681cba4955dc7d" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36805 } }
I20251212 09:11:01.128886 30445 ts_tablet_manager.cc:1434] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251212 09:11:01.128990 30448 tablet_bootstrap.cc:654] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:01.129004 30444 tablet_bootstrap.cc:492] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d: No bootstrap required, opened a new log
I20251212 09:11:01.129012 30295 heartbeater.cc:499] Master 127.29.26.190:46575 was elected leader, sending a full tablet report...
I20251212 09:11:01.129061 30444 ts_tablet_manager.cc:1403] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251212 09:11:01.129292 30448 log.cc:826] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:01.130272 30448 tablet_bootstrap.cc:492] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38: No bootstrap required, opened a new log
I20251212 09:11:01.130337 30448 ts_tablet_manager.cc:1403] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251212 09:11:01.130630 30444 raft_consensus.cc:359] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "5242b95842e04aed93681cba4955dc7d" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36805 } }
I20251212 09:11:01.130764 30444 raft_consensus.cc:385] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:01.130805 30444 raft_consensus.cc:740] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5242b95842e04aed93681cba4955dc7d, State: Initialized, Role: FOLLOWER
I20251212 09:11:01.130893 30444 consensus_queue.cc:260] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "5242b95842e04aed93681cba4955dc7d" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36805 } }
I20251212 09:11:01.131105 30444 ts_tablet_manager.cc:1434] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:01.131138 30164 heartbeater.cc:499] Master 127.29.26.190:46575 was elected leader, sending a full tablet report...
I20251212 09:11:01.131721 30448 raft_consensus.cc:359] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "5242b95842e04aed93681cba4955dc7d" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36805 } }
I20251212 09:11:01.131844 30448 raft_consensus.cc:385] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:01.131877 30448 raft_consensus.cc:740] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aedd51aeeabb4698869d429446ae2e38, State: Initialized, Role: FOLLOWER
I20251212 09:11:01.132030 30448 consensus_queue.cc:260] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "5242b95842e04aed93681cba4955dc7d" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36805 } }
I20251212 09:11:01.132264 30448 ts_tablet_manager.cc:1434] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:01.132315 30033 heartbeater.cc:499] Master 127.29.26.190:46575 was elected leader, sending a full tablet report...
W20251212 09:11:01.222815 30034 tablet.cc:2378] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251212 09:11:01.226758 30296 tablet.cc:2378] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251212 09:11:01.332420 30451 raft_consensus.cc:493] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251212 09:11:01.332545 30451 raft_consensus.cc:515] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "5242b95842e04aed93681cba4955dc7d" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36805 } }
I20251212 09:11:01.332937 30451 leader_election.cc:290] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aedd51aeeabb4698869d429446ae2e38 (127.29.26.129:45189), 87bb558a8119434ab926b546699b0b73 (127.29.26.131:42503)
I20251212 09:11:01.335525 30249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "186fcf0dfc304bb687605965125ec039" candidate_uuid: "5242b95842e04aed93681cba4955dc7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87bb558a8119434ab926b546699b0b73" is_pre_election: true
I20251212 09:11:01.335597 29987 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "186fcf0dfc304bb687605965125ec039" candidate_uuid: "5242b95842e04aed93681cba4955dc7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aedd51aeeabb4698869d429446ae2e38" is_pre_election: true
I20251212 09:11:01.335660 30249 raft_consensus.cc:2468] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5242b95842e04aed93681cba4955dc7d in term 0.
I20251212 09:11:01.335758 29987 raft_consensus.cc:2468] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5242b95842e04aed93681cba4955dc7d in term 0.
I20251212 09:11:01.335867 30051 leader_election.cc:304] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5242b95842e04aed93681cba4955dc7d, 87bb558a8119434ab926b546699b0b73; no voters:
I20251212 09:11:01.335985 30451 raft_consensus.cc:2804] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251212 09:11:01.336045 30451 raft_consensus.cc:493] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251212 09:11:01.336068 30451 raft_consensus.cc:3060] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:01.342020 30451 raft_consensus.cc:515] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "5242b95842e04aed93681cba4955dc7d" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36805 } }
I20251212 09:11:01.342270 30451 leader_election.cc:290] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [CANDIDATE]: Term 1 election: Requested vote from peers aedd51aeeabb4698869d429446ae2e38 (127.29.26.129:45189), 87bb558a8119434ab926b546699b0b73 (127.29.26.131:42503)
I20251212 09:11:01.342486 29987 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "186fcf0dfc304bb687605965125ec039" candidate_uuid: "5242b95842e04aed93681cba4955dc7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aedd51aeeabb4698869d429446ae2e38"
I20251212 09:11:01.342545 30249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "186fcf0dfc304bb687605965125ec039" candidate_uuid: "5242b95842e04aed93681cba4955dc7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87bb558a8119434ab926b546699b0b73"
I20251212 09:11:01.342569 29987 raft_consensus.cc:3060] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:01.342639 30249 raft_consensus.cc:3060] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 0 FOLLOWER]: Advancing to term 1
W20251212 09:11:01.342810 30165 tablet.cc:2378] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251212 09:11:01.343449 29987 raft_consensus.cc:2468] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5242b95842e04aed93681cba4955dc7d in term 1.
I20251212 09:11:01.343648 30054 leader_election.cc:304] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5242b95842e04aed93681cba4955dc7d, aedd51aeeabb4698869d429446ae2e38; no voters:
I20251212 09:11:01.343748 30451 raft_consensus.cc:2804] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:01.343931 30451 raft_consensus.cc:697] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [term 1 LEADER]: Becoming Leader. State: Replica: 5242b95842e04aed93681cba4955dc7d, State: Running, Role: LEADER
I20251212 09:11:01.344058 30451 consensus_queue.cc:237] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "5242b95842e04aed93681cba4955dc7d" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36805 } }
I20251212 09:11:01.344166 30249 raft_consensus.cc:2468] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5242b95842e04aed93681cba4955dc7d in term 1.
I20251212 09:11:01.344797 29845 catalog_manager.cc:5654] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d reported cstate change: term changed from 0 to 1, leader changed from <none> to 5242b95842e04aed93681cba4955dc7d (127.29.26.130). New cstate: current_term: 1 leader_uuid: "5242b95842e04aed93681cba4955dc7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5242b95842e04aed93681cba4955dc7d" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36805 } health_report { overall_health: HEALTHY } } }
I20251212 09:11:01.402614 29802 external_mini_cluster.cc:949] 4 TS(s) registered with all masters
I20251212 09:11:01.403188 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver aedd51aeeabb4698869d429446ae2e38 to finish bootstrapping
I20251212 09:11:01.406559 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 5242b95842e04aed93681cba4955dc7d to finish bootstrapping
I20251212 09:11:01.409582 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 87bb558a8119434ab926b546699b0b73 to finish bootstrapping
I20251212 09:11:01.412549 29802 kudu-admin-test.cc:709] Waiting for Master to see the current replicas...
I20251212 09:11:01.413254 29802 kudu-admin-test.cc:716] Tablet locations:
tablet_locations {
tablet_id: "186fcf0dfc304bb687605965125ec039"
DEPRECATED_stale: false
partition {
partition_key_start: ""
partition_key_end: ""
}
interned_replicas {
ts_info_idx: 0
role: FOLLOWER
}
interned_replicas {
ts_info_idx: 1
role: FOLLOWER
}
interned_replicas {
ts_info_idx: 2
role: LEADER
}
}
ts_infos {
permanent_uuid: "aedd51aeeabb4698869d429446ae2e38"
rpc_addresses {
host: "127.29.26.129"
port: 45189
}
}
ts_infos {
permanent_uuid: "87bb558a8119434ab926b546699b0b73"
rpc_addresses {
host: "127.29.26.131"
port: 42503
}
}
ts_infos {
permanent_uuid: "5242b95842e04aed93681cba4955dc7d"
rpc_addresses {
host: "127.29.26.130"
port: 36805
}
}
I20251212 09:11:01.739987 30451 consensus_queue.cc:1048] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251212 09:11:01.742067 30454 consensus_queue.cc:1048] T 186fcf0dfc304bb687605965125ec039 P 5242b95842e04aed93681cba4955dc7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251212 09:11:01.751111 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 30036
I20251212 09:11:01.755999 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 29814
I20251212 09:11:01.761525 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:46575
--webserver_interface=127.29.26.190
--webserver_port=44707
--builtin_ntp_servers=127.29.26.148:36375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.26.190:46575 with env {}
W20251212 09:11:01.839498 30465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:01.839672 30465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:01.839704 30465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:01.841195 30465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251212 09:11:01.841239 30465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:01.841261 30465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251212 09:11:01.841282 30465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251212 09:11:01.842831 30465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:36375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.26.190:46575
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:46575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.29.26.190
--webserver_port=44707
--never_fsync=true
--heap_profile_path=/tmp/kudu.30465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:01.843086 30465 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:01.843364 30465 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:01.845945 30470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:01.845899 30471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:01.846046 30465 server_base.cc:1047] running on GCE node
W20251212 09:11:01.845899 30473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:01.846335 30465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:01.846562 30465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:01.847692 30465 hybrid_clock.cc:648] HybridClock initialized: now 1765530661847680 us; error 29 us; skew 500 ppm
I20251212 09:11:01.848832 30465 webserver.cc:492] Webserver started at http://127.29.26.190:44707/ using document root <none> and password file <none>
I20251212 09:11:01.849071 30465 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:01.849133 30465 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:01.850389 30465 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:01.851141 30479 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:01.851295 30465 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:01.851362 30465 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
uuid: "9ae9043f512243549de97c4fa310883b"
format_stamp: "Formatted at 2025-12-12 09:11:00 on dist-test-slave-qqr7"
I20251212 09:11:01.851611 30465 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:01.864354 30465 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:01.864637 30465 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:01.864785 30465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:01.868628 30465 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.190:46575
I20251212 09:11:01.868705 30531 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.190:46575 every 8 connection(s)
I20251212 09:11:01.869028 30465 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251212 09:11:01.870102 30532 sys_catalog.cc:263] Verifying existing consensus state
I20251212 09:11:01.870652 30532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b: Bootstrap starting.
I20251212 09:11:01.875602 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 30465
I20251212 09:11:01.875728 29802 kudu-admin-test.cc:735] Forcing unsafe config change on tserver aedd51aeeabb4698869d429446ae2e38
I20251212 09:11:01.878749 30532 log.cc:826] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:01.880383 30532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251212 09:11:01.880630 30532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b: Bootstrap complete.
I20251212 09:11:01.882516 30532 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae9043f512243549de97c4fa310883b" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 46575 } }
I20251212 09:11:01.882695 30532 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae9043f512243549de97c4fa310883b, State: Initialized, Role: FOLLOWER
I20251212 09:11:01.882853 30532 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae9043f512243549de97c4fa310883b" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 46575 } }
I20251212 09:11:01.882926 30532 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:01.882974 30532 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:01.883023 30532 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 1 FOLLOWER]: Advancing to term 2
I20251212 09:11:01.883942 30532 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae9043f512243549de97c4fa310883b" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 46575 } }
I20251212 09:11:01.884040 30532 leader_election.cc:304] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ae9043f512243549de97c4fa310883b; no voters:
I20251212 09:11:01.884215 30532 leader_election.cc:290] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [CANDIDATE]: Term 2 election: Requested vote from peers
I20251212 09:11:01.884263 30536 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 2 FOLLOWER]: Leader election won for term 2
I20251212 09:11:01.884372 30536 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [term 2 LEADER]: Becoming Leader. State: Replica: 9ae9043f512243549de97c4fa310883b, State: Running, Role: LEADER
I20251212 09:11:01.884449 30532 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [sys.catalog]: configured and running, proceeding with master startup.
I20251212 09:11:01.884449 30536 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae9043f512243549de97c4fa310883b" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 46575 } }
I20251212 09:11:01.884754 30536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ae9043f512243549de97c4fa310883b. Latest consensus state: current_term: 2 leader_uuid: "9ae9043f512243549de97c4fa310883b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae9043f512243549de97c4fa310883b" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 46575 } } }
I20251212 09:11:01.884819 30536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:01.885004 30540 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251212 09:11:01.884783 30537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9ae9043f512243549de97c4fa310883b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae9043f512243549de97c4fa310883b" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 46575 } } }
I20251212 09:11:01.885200 30537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:01.885625 30540 catalog_manager.cc:679] Loaded metadata for table TestTable [id=b782cac30df44561aadeb5e755f9a139]
I20251212 09:11:01.885861 30540 tablet_loader.cc:96] loaded metadata for tablet 186fcf0dfc304bb687605965125ec039 (table TestTable [id=b782cac30df44561aadeb5e755f9a139])
I20251212 09:11:01.885955 30540 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251212 09:11:01.886090 30540 catalog_manager.cc:1269] Loaded cluster ID: 24dfb2dc2d1347c2a34154311336554e
I20251212 09:11:01.886307 30540 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251212 09:11:01.887256 30540 catalog_manager.cc:1514] Loading token signing keys...
I20251212 09:11:01.887410 30540 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 9ae9043f512243549de97c4fa310883b: Loaded TSK: 0
I20251212 09:11:01.887611 30540 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20251212 09:11:01.968346 30534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:01.968534 30534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:01.969964 30534 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20251212 09:11:01.982384 29987 tablet_service.cc:2003] Received UnsafeChangeConfig RPC: dest_uuid: "aedd51aeeabb4698869d429446ae2e38"
tablet_id: "186fcf0dfc304bb687605965125ec039"
caller_id: "kudu-tools"
new_config {
peers {
permanent_uuid: "87bb558a8119434ab926b546699b0b73"
}
peers {
permanent_uuid: "aedd51aeeabb4698869d429446ae2e38"
}
}
from {username='slave'} at 127.0.0.1:34946
W20251212 09:11:01.982555 29987 raft_consensus.cc:2218] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 1 FOLLOWER]: PROCEEDING WITH UNSAFE CONFIG CHANGE ON THIS SERVER, COMMITTED CONFIG: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "5242b95842e04aed93681cba4955dc7d" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36805 } }NEW CONFIG: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } unsafe_config_change: true
I20251212 09:11:01.982640 29987 raft_consensus.cc:3060] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 1 FOLLOWER]: Advancing to term 2
I20251212 09:11:01.988334 30496 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" instance_seqno: 1765530660720369) as {username='slave'} at 127.29.26.129:52101; Asking this server to re-register.
I20251212 09:11:01.988732 30033 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:01.988802 30033 heartbeater.cc:507] Master 127.29.26.190:46575 requested a full tablet report, sending...
I20251212 09:11:01.989120 30496 ts_manager.cc:194] Registered new tserver with Master: aedd51aeeabb4698869d429446ae2e38 (127.29.26.129:45189)
I20251212 09:11:02.105365 30427 heartbeater.cc:499] Master 127.29.26.190:46575 was elected leader, sending a full tablet report...
I20251212 09:11:02.108215 30496 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "f46f26cfce6c42b0a42d89edb7c29a90" instance_seqno: 1765530661097633) as {username='slave'} at 127.29.26.132:43979; Asking this server to re-register.
I20251212 09:11:02.108462 30427 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:02.108547 30427 heartbeater.cc:507] Master 127.29.26.190:46575 requested a full tablet report, sending...
I20251212 09:11:02.108765 30496 ts_manager.cc:194] Registered new tserver with Master: f46f26cfce6c42b0a42d89edb7c29a90 (127.29.26.132:38705)
I20251212 09:11:02.746260 30496 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "87bb558a8119434ab926b546699b0b73" instance_seqno: 1765530660974510) as {username='slave'} at 127.29.26.131:32795; Asking this server to re-register.
I20251212 09:11:02.746516 30295 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:02.746603 30295 heartbeater.cc:507] Master 127.29.26.190:46575 requested a full tablet report, sending...
I20251212 09:11:02.746850 30496 ts_manager.cc:194] Registered new tserver with Master: 87bb558a8119434ab926b546699b0b73 (127.29.26.131:42503)
I20251212 09:11:03.243698 30576 raft_consensus.cc:493] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5242b95842e04aed93681cba4955dc7d)
I20251212 09:11:03.243800 30576 raft_consensus.cc:515] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "5242b95842e04aed93681cba4955dc7d" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36805 } }
I20251212 09:11:03.244146 30576 leader_election.cc:290] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aedd51aeeabb4698869d429446ae2e38 (127.29.26.129:45189), 5242b95842e04aed93681cba4955dc7d (127.29.26.130:36805)
W20251212 09:11:03.244499 30184 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.26.130:36805: connect: Connection refused (error 111)
W20251212 09:11:03.244928 30184 leader_election.cc:336] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5242b95842e04aed93681cba4955dc7d (127.29.26.130:36805): Network error: Client connection negotiation failed: client connection to 127.29.26.130:36805: connect: Connection refused (error 111)
I20251212 09:11:03.246909 29987 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "186fcf0dfc304bb687605965125ec039" candidate_uuid: "87bb558a8119434ab926b546699b0b73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aedd51aeeabb4698869d429446ae2e38" is_pre_election: true
I20251212 09:11:03.247160 30185 leader_election.cc:304] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87bb558a8119434ab926b546699b0b73; no voters: 5242b95842e04aed93681cba4955dc7d, aedd51aeeabb4698869d429446ae2e38
I20251212 09:11:03.247293 30576 raft_consensus.cc:2749] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251212 09:11:03.483846 30580 raft_consensus.cc:493] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader kudu-tools)
I20251212 09:11:03.483947 30580 raft_consensus.cc:515] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } unsafe_config_change: true
I20251212 09:11:03.484201 30580 leader_election.cc:290] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87bb558a8119434ab926b546699b0b73 (127.29.26.131:42503)
I20251212 09:11:03.487002 30249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "186fcf0dfc304bb687605965125ec039" candidate_uuid: "aedd51aeeabb4698869d429446ae2e38" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87bb558a8119434ab926b546699b0b73" is_pre_election: true
I20251212 09:11:03.487089 30249 raft_consensus.cc:2468] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aedd51aeeabb4698869d429446ae2e38 in term 1.
I20251212 09:11:03.487284 29920 leader_election.cc:304] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 87bb558a8119434ab926b546699b0b73, aedd51aeeabb4698869d429446ae2e38; no voters:
I20251212 09:11:03.487394 30580 raft_consensus.cc:2804] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251212 09:11:03.487444 30580 raft_consensus.cc:493] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 2 FOLLOWER]: Starting leader election (detected failure of leader kudu-tools)
I20251212 09:11:03.487464 30580 raft_consensus.cc:3060] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 2 FOLLOWER]: Advancing to term 3
I20251212 09:11:03.488111 30580 raft_consensus.cc:515] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } unsafe_config_change: true
I20251212 09:11:03.488207 30580 leader_election.cc:290] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [CANDIDATE]: Term 3 election: Requested vote from peers 87bb558a8119434ab926b546699b0b73 (127.29.26.131:42503)
I20251212 09:11:03.488359 30249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "186fcf0dfc304bb687605965125ec039" candidate_uuid: "aedd51aeeabb4698869d429446ae2e38" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87bb558a8119434ab926b546699b0b73"
I20251212 09:11:03.488417 30249 raft_consensus.cc:3060] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 1 FOLLOWER]: Advancing to term 3
I20251212 09:11:03.488971 30249 raft_consensus.cc:2468] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aedd51aeeabb4698869d429446ae2e38 in term 3.
I20251212 09:11:03.489130 29920 leader_election.cc:304] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 87bb558a8119434ab926b546699b0b73, aedd51aeeabb4698869d429446ae2e38; no voters:
I20251212 09:11:03.489212 30580 raft_consensus.cc:2804] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 3 FOLLOWER]: Leader election won for term 3
I20251212 09:11:03.489312 30580 raft_consensus.cc:697] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 3 LEADER]: Becoming Leader. State: Replica: aedd51aeeabb4698869d429446ae2e38, State: Running, Role: LEADER
I20251212 09:11:03.489390 30580 consensus_queue.cc:237] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } unsafe_config_change: true
I20251212 09:11:03.490034 30496 catalog_manager.cc:5654] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 reported cstate change: term changed from 1 to 3, leader changed from 5242b95842e04aed93681cba4955dc7d (127.29.26.130) to aedd51aeeabb4698869d429446ae2e38 (127.29.26.129), now has a pending config: VOTER aedd51aeeabb4698869d429446ae2e38 (127.29.26.129), VOTER 87bb558a8119434ab926b546699b0b73 (127.29.26.131). New cstate: current_term: 3 leader_uuid: "aedd51aeeabb4698869d429446ae2e38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5242b95842e04aed93681cba4955dc7d" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36805 } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } unsafe_config_change: true }
I20251212 09:11:03.957856 30249 raft_consensus.cc:1275] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 3 FOLLOWER]: Refusing update from remote peer aedd51aeeabb4698869d429446ae2e38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20251212 09:11:03.958214 30580 consensus_queue.cc:1048] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20251212 09:11:03.959195 30583 raft_consensus.cc:2955] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 3 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, VOTER 5242b95842e04aed93681cba4955dc7d (127.29.26.130) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } unsafe_config_change: true }
I20251212 09:11:03.959384 30249 raft_consensus.cc:2955] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 3 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, VOTER 5242b95842e04aed93681cba4955dc7d (127.29.26.130) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } unsafe_config_change: true }
I20251212 09:11:03.960418 30496 catalog_manager.cc:5654] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 reported cstate change: config changed from index -1 to 2, VOTER 5242b95842e04aed93681cba4955dc7d (127.29.26.130) evicted, no longer has a pending config: VOTER aedd51aeeabb4698869d429446ae2e38 (127.29.26.129), VOTER 87bb558a8119434ab926b546699b0b73 (127.29.26.131). New cstate: current_term: 3 leader_uuid: "aedd51aeeabb4698869d429446ae2e38" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } health_report { overall_health: HEALTHY } } unsafe_config_change: true }
W20251212 09:11:03.961163 30496 catalog_manager.cc:5846] Failed to send DeleteTablet RPC for tablet 186fcf0dfc304bb687605965125ec039 on TS 5242b95842e04aed93681cba4955dc7d: Not found: failed to reset TS proxy: Could not find TS for UUID 5242b95842e04aed93681cba4955dc7d
I20251212 09:11:03.964231 29987 consensus_queue.cc:237] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "f46f26cfce6c42b0a42d89edb7c29a90" member_type: NON_VOTER last_known_addr { host: "127.29.26.132" port: 38705 } attrs { promote: true } } unsafe_config_change: true
I20251212 09:11:03.964812 30249 raft_consensus.cc:1275] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 3 FOLLOWER]: Refusing update from remote peer aedd51aeeabb4698869d429446ae2e38: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20251212 09:11:03.965027 30583 consensus_queue.cc:1048] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20251212 09:11:03.965633 30580 raft_consensus.cc:2955] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, NON_VOTER f46f26cfce6c42b0a42d89edb7c29a90 (127.29.26.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "f46f26cfce6c42b0a42d89edb7c29a90" member_type: NON_VOTER last_known_addr { host: "127.29.26.132" port: 38705 } attrs { promote: true } } unsafe_config_change: true }
I20251212 09:11:03.965823 30249 raft_consensus.cc:2955] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, NON_VOTER f46f26cfce6c42b0a42d89edb7c29a90 (127.29.26.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "f46f26cfce6c42b0a42d89edb7c29a90" member_type: NON_VOTER last_known_addr { host: "127.29.26.132" port: 38705 } attrs { promote: true } } unsafe_config_change: true }
I20251212 09:11:03.966816 30496 catalog_manager.cc:5654] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 reported cstate change: config changed from index 2 to 4, NON_VOTER f46f26cfce6c42b0a42d89edb7c29a90 (127.29.26.132) added. New cstate: current_term: 3 leader_uuid: "aedd51aeeabb4698869d429446ae2e38" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f46f26cfce6c42b0a42d89edb7c29a90" member_type: NON_VOTER last_known_addr { host: "127.29.26.132" port: 38705 } attrs { promote: true } health_report { overall_health: UNKNOWN } } unsafe_config_change: true }
I20251212 09:11:03.967052 30483 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 186fcf0dfc304bb687605965125ec039 with cas_config_opid_index 2: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
W20251212 09:11:03.967978 29920 consensus_peers.cc:597] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 -> Peer f46f26cfce6c42b0a42d89edb7c29a90 (127.29.26.132:38705): Couldn't send request to peer f46f26cfce6c42b0a42d89edb7c29a90. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 186fcf0dfc304bb687605965125ec039. This is attempt 1: this message will repeat every 5th retry.
W20251212 09:11:04.013342 30481 catalog_manager.cc:4767] Async tablet task DeleteTablet RPC for tablet 186fcf0dfc304bb687605965125ec039 on TS 5242b95842e04aed93681cba4955dc7d failed: Not found: failed to reset TS proxy: Could not find TS for UUID 5242b95842e04aed93681cba4955dc7d
I20251212 09:11:04.384939 30597 ts_tablet_manager.cc:933] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90: Initiating tablet copy from peer aedd51aeeabb4698869d429446ae2e38 (127.29.26.129:45189)
I20251212 09:11:04.385296 30597 tablet_copy_client.cc:323] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90: tablet copy: Beginning tablet copy session from remote peer at address 127.29.26.129:45189
I20251212 09:11:04.387996 30007 tablet_copy_service.cc:140] P aedd51aeeabb4698869d429446ae2e38: Received BeginTabletCopySession request for tablet 186fcf0dfc304bb687605965125ec039 from peer f46f26cfce6c42b0a42d89edb7c29a90 ({username='slave'} at 127.29.26.132:33625)
I20251212 09:11:04.388065 30007 tablet_copy_service.cc:161] P aedd51aeeabb4698869d429446ae2e38: Beginning new tablet copy session on tablet 186fcf0dfc304bb687605965125ec039 from peer f46f26cfce6c42b0a42d89edb7c29a90 at {username='slave'} at 127.29.26.132:33625: session id = f46f26cfce6c42b0a42d89edb7c29a90-186fcf0dfc304bb687605965125ec039
I20251212 09:11:04.388583 30007 tablet_copy_source_session.cc:215] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38: Tablet Copy: opened 0 blocks and 1 log segments
I20251212 09:11:04.389350 30597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186fcf0dfc304bb687605965125ec039. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:04.391242 30597 tablet_copy_client.cc:806] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90: tablet copy: Starting download of 0 data blocks...
I20251212 09:11:04.391355 30597 tablet_copy_client.cc:670] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90: tablet copy: Starting download of 1 WAL segments...
I20251212 09:11:04.392136 30597 tablet_copy_client.cc:538] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251212 09:11:04.392818 30597 tablet_bootstrap.cc:492] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90: Bootstrap starting.
I20251212 09:11:04.393966 30597 log.cc:826] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:04.394815 30597 tablet_bootstrap.cc:492] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251212 09:11:04.395004 30597 tablet_bootstrap.cc:492] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90: Bootstrap complete.
I20251212 09:11:04.395103 30597 ts_tablet_manager.cc:1403] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:04.396265 30597 raft_consensus.cc:359] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "f46f26cfce6c42b0a42d89edb7c29a90" member_type: NON_VOTER last_known_addr { host: "127.29.26.132" port: 38705 } attrs { promote: true } } unsafe_config_change: true
I20251212 09:11:04.396394 30597 raft_consensus.cc:740] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: f46f26cfce6c42b0a42d89edb7c29a90, State: Initialized, Role: LEARNER
I20251212 09:11:04.396440 30597 consensus_queue.cc:260] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "f46f26cfce6c42b0a42d89edb7c29a90" member_type: NON_VOTER last_known_addr { host: "127.29.26.132" port: 38705 } attrs { promote: true } } unsafe_config_change: true
I20251212 09:11:04.396651 30597 ts_tablet_manager.cc:1434] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:04.396997 30007 tablet_copy_service.cc:342] P aedd51aeeabb4698869d429446ae2e38: Request end of tablet copy session f46f26cfce6c42b0a42d89edb7c29a90-186fcf0dfc304bb687605965125ec039 received from {username='slave'} at 127.29.26.132:33625
I20251212 09:11:04.397065 30007 tablet_copy_service.cc:434] P aedd51aeeabb4698869d429446ae2e38: ending tablet copy session f46f26cfce6c42b0a42d89edb7c29a90-186fcf0dfc304bb687605965125ec039 on tablet 186fcf0dfc304bb687605965125ec039 with peer f46f26cfce6c42b0a42d89edb7c29a90
I20251212 09:11:04.948983 30381 raft_consensus.cc:1217] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4] Dedup: 3.4->[]
W20251212 09:11:05.180199 30481 catalog_manager.cc:4767] Async tablet task DeleteTablet RPC for tablet 186fcf0dfc304bb687605965125ec039 on TS 5242b95842e04aed93681cba4955dc7d failed: Not found: failed to reset TS proxy: Could not find TS for UUID 5242b95842e04aed93681cba4955dc7d
I20251212 09:11:05.455808 30602 raft_consensus.cc:1064] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38: attempting to promote NON_VOTER f46f26cfce6c42b0a42d89edb7c29a90 to VOTER
I20251212 09:11:05.456043 30602 consensus_queue.cc:237] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "f46f26cfce6c42b0a42d89edb7c29a90" member_type: VOTER last_known_addr { host: "127.29.26.132" port: 38705 } attrs { promote: false } } unsafe_config_change: true
I20251212 09:11:05.456540 30381 raft_consensus.cc:1275] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90 [term 3 LEARNER]: Refusing update from remote peer aedd51aeeabb4698869d429446ae2e38: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251212 09:11:05.456553 30249 raft_consensus.cc:1275] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 3 FOLLOWER]: Refusing update from remote peer aedd51aeeabb4698869d429446ae2e38: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20251212 09:11:05.456780 30606 consensus_queue.cc:1048] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f46f26cfce6c42b0a42d89edb7c29a90" member_type: VOTER last_known_addr { host: "127.29.26.132" port: 38705 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251212 09:11:05.456933 30604 consensus_queue.cc:1048] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20251212 09:11:05.457711 30606 raft_consensus.cc:2955] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f46f26cfce6c42b0a42d89edb7c29a90 (127.29.26.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "f46f26cfce6c42b0a42d89edb7c29a90" member_type: VOTER last_known_addr { host: "127.29.26.132" port: 38705 } attrs { promote: false } } unsafe_config_change: true }
I20251212 09:11:05.457800 30249 raft_consensus.cc:2955] T 186fcf0dfc304bb687605965125ec039 P 87bb558a8119434ab926b546699b0b73 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f46f26cfce6c42b0a42d89edb7c29a90 (127.29.26.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "f46f26cfce6c42b0a42d89edb7c29a90" member_type: VOTER last_known_addr { host: "127.29.26.132" port: 38705 } attrs { promote: false } } unsafe_config_change: true }
I20251212 09:11:05.457877 30381 raft_consensus.cc:2955] T 186fcf0dfc304bb687605965125ec039 P f46f26cfce6c42b0a42d89edb7c29a90 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f46f26cfce6c42b0a42d89edb7c29a90 (127.29.26.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } } peers { permanent_uuid: "f46f26cfce6c42b0a42d89edb7c29a90" member_type: VOTER last_known_addr { host: "127.29.26.132" port: 38705 } attrs { promote: false } } unsafe_config_change: true }
I20251212 09:11:05.458909 30495 catalog_manager.cc:5654] T 186fcf0dfc304bb687605965125ec039 P aedd51aeeabb4698869d429446ae2e38 reported cstate change: config changed from index 4 to 5, f46f26cfce6c42b0a42d89edb7c29a90 (127.29.26.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "aedd51aeeabb4698869d429446ae2e38" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aedd51aeeabb4698869d429446ae2e38" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 45189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87bb558a8119434ab926b546699b0b73" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f46f26cfce6c42b0a42d89edb7c29a90" member_type: VOTER last_known_addr { host: "127.29.26.132" port: 38705 } attrs { promote: false } health_report { overall_health: HEALTHY } } unsafe_config_change: true }
I20251212 09:11:05.519865 29802 kudu-admin-test.cc:751] Waiting for Master to see new config...
I20251212 09:11:05.524308 29802 kudu-admin-test.cc:756] Tablet locations:
tablet_locations {
tablet_id: "186fcf0dfc304bb687605965125ec039"
DEPRECATED_stale: false
partition {
partition_key_start: ""
partition_key_end: ""
}
interned_replicas {
ts_info_idx: 0
role: LEADER
}
interned_replicas {
ts_info_idx: 1
role: FOLLOWER
}
interned_replicas {
ts_info_idx: 2
role: FOLLOWER
}
}
ts_infos {
permanent_uuid: "aedd51aeeabb4698869d429446ae2e38"
rpc_addresses {
host: "127.29.26.129"
port: 45189
}
}
ts_infos {
permanent_uuid: "87bb558a8119434ab926b546699b0b73"
rpc_addresses {
host: "127.29.26.131"
port: 42503
}
}
ts_infos {
permanent_uuid: "f46f26cfce6c42b0a42d89edb7c29a90"
rpc_addresses {
host: "127.29.26.132"
port: 38705
}
}
I20251212 09:11:05.524756 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 29905
I20251212 09:11:05.529749 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 30167
I20251212 09:11:05.535542 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 30298
I20251212 09:11:05.539837 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 30465
2025-12-12T09:11:05Z chronyd exiting
[ OK ] AdminCliTest.TestUnsafeChangeConfigForConfigWithTwoNodes (5116 ms)
[ RUN ] AdminCliTest.TestGracefulSpecificLeaderStepDown
I20251212 09:11:05.560516 29802 test_util.cc:276] Using random seed: -1540806207
I20251212 09:11:05.561089 29802 ts_itest-base.cc:115] Starting cluster with:
I20251212 09:11:05.561126 29802 ts_itest-base.cc:116] --------------
I20251212 09:11:05.561138 29802 ts_itest-base.cc:117] 3 tablet servers
I20251212 09:11:05.561149 29802 ts_itest-base.cc:118] 3 replicas per TS
I20251212 09:11:05.561159 29802 ts_itest-base.cc:119] --------------
2025-12-12T09:11:05Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-12T09:11:05Z Disabled control of system clock
I20251212 09:11:05.567741 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:39209
--webserver_interface=127.29.26.190
--webserver_port=0
--builtin_ntp_servers=127.29.26.148:39085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.26.190:39209
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20251212 09:11:05.643757 30624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:05.643924 30624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:05.643956 30624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:05.645363 30624 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251212 09:11:05.645404 30624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:05.645426 30624 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251212 09:11:05.645443 30624 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251212 09:11:05.646919 30624 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:39085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.29.26.190:39209
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:39209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.29.26.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.30624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:05.647168 30624 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:05.647401 30624 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:05.649725 30630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:05.649718 30632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:05.649718 30629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:05.649889 30624 server_base.cc:1047] running on GCE node
I20251212 09:11:05.650211 30624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:05.650418 30624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:05.651556 30624 hybrid_clock.cc:648] HybridClock initialized: now 1765530665651543 us; error 26 us; skew 500 ppm
I20251212 09:11:05.652715 30624 webserver.cc:492] Webserver started at http://127.29.26.190:40969/ using document root <none> and password file <none>
I20251212 09:11:05.652920 30624 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:05.652982 30624 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:05.653101 30624 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:05.653946 30624 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "5260e2316e0741c195fb101f742c17e1"
format_stamp: "Formatted at 2025-12-12 09:11:05 on dist-test-slave-qqr7"
I20251212 09:11:05.654235 30624 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "5260e2316e0741c195fb101f742c17e1"
format_stamp: "Formatted at 2025-12-12 09:11:05 on dist-test-slave-qqr7"
I20251212 09:11:05.655357 30624 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251212 09:11:05.655997 30638 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:05.656162 30624 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251212 09:11:05.656234 30624 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
uuid: "5260e2316e0741c195fb101f742c17e1"
format_stamp: "Formatted at 2025-12-12 09:11:05 on dist-test-slave-qqr7"
I20251212 09:11:05.656289 30624 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:05.683758 30624 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:05.684079 30624 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:05.684193 30624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:05.687770 30624 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.190:39209
I20251212 09:11:05.687819 30690 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.190:39209 every 8 connection(s)
I20251212 09:11:05.688122 30624 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251212 09:11:05.688738 30691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:05.690872 30691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1: Bootstrap starting.
I20251212 09:11:05.691431 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 30624
I20251212 09:11:05.691478 30691 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:05.691522 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251212 09:11:05.691771 30691 log.cc:826] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:05.692545 30691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1: No bootstrap required, opened a new log
I20251212 09:11:05.693768 30691 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5260e2316e0741c195fb101f742c17e1" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 39209 } }
I20251212 09:11:05.693881 30691 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:05.693902 30691 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5260e2316e0741c195fb101f742c17e1, State: Initialized, Role: FOLLOWER
I20251212 09:11:05.693990 30691 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5260e2316e0741c195fb101f742c17e1" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 39209 } }
I20251212 09:11:05.694051 30691 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:05.694074 30691 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:05.694123 30691 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:05.694746 30691 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5260e2316e0741c195fb101f742c17e1" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 39209 } }
I20251212 09:11:05.694854 30691 leader_election.cc:304] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5260e2316e0741c195fb101f742c17e1; no voters:
I20251212 09:11:05.695026 30691 leader_election.cc:290] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251212 09:11:05.695122 30696 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:05.695253 30691 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [sys.catalog]: configured and running, proceeding with master startup.
I20251212 09:11:05.695302 30696 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [term 1 LEADER]: Becoming Leader. State: Replica: 5260e2316e0741c195fb101f742c17e1, State: Running, Role: LEADER
I20251212 09:11:05.695386 30696 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5260e2316e0741c195fb101f742c17e1" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 39209 } }
I20251212 09:11:05.695685 30696 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5260e2316e0741c195fb101f742c17e1. Latest consensus state: current_term: 1 leader_uuid: "5260e2316e0741c195fb101f742c17e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5260e2316e0741c195fb101f742c17e1" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 39209 } } }
I20251212 09:11:05.695757 30696 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:05.695976 30697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5260e2316e0741c195fb101f742c17e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5260e2316e0741c195fb101f742c17e1" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 39209 } } }
I20251212 09:11:05.696075 30697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1 [sys.catalog]: This master's current role is: LEADER
W20251212 09:11:05.697546 30712 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251212 09:11:05.697599 30712 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251212 09:11:05.697686 30702 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251212 09:11:05.697844 30702 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251212 09:11:05.699056 30702 catalog_manager.cc:1357] Generated new cluster ID: 00c66aca379948118b012bb5e28159f5
I20251212 09:11:05.699101 30702 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251212 09:11:05.718698 30702 catalog_manager.cc:1380] Generated new certificate authority record
I20251212 09:11:05.719226 30702 catalog_manager.cc:1514] Loading token signing keys...
I20251212 09:11:05.722941 30702 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 5260e2316e0741c195fb101f742c17e1: Generated new TSK 0
I20251212 09:11:05.723114 30702 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251212 09:11:05.725730 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.129:0
--local_ip_for_outbound_sockets=127.29.26.129
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39209
--builtin_ntp_servers=127.29.26.148:39085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20251212 09:11:05.825456 30715 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20251212 09:11:05.825644 30715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:05.825659 30715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:05.825675 30715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:05.827102 30715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:05.827158 30715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.129
I20251212 09:11:05.828761 30715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:39085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39209
--never_fsync=true
--heap_profile_path=/tmp/kudu.30715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.129
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:05.829026 30715 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:05.829274 30715 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251212 09:11:05.834196 30715 server_base.cc:1047] running on GCE node
W20251212 09:11:05.834219 30723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:05.835016 30720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:05.835048 30721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:05.835392 30715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:05.835652 30715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:05.836807 30715 hybrid_clock.cc:648] HybridClock initialized: now 1765530665836783 us; error 39 us; skew 500 ppm
I20251212 09:11:05.838268 30715 webserver.cc:492] Webserver started at http://127.29.26.129:37661/ using document root <none> and password file <none>
I20251212 09:11:05.838519 30715 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:05.838575 30715 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:05.838703 30715 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:05.839814 30715 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "185f6f3df26f44f6bf35d86586707816"
format_stamp: "Formatted at 2025-12-12 09:11:05 on dist-test-slave-qqr7"
I20251212 09:11:05.840186 30715 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "185f6f3df26f44f6bf35d86586707816"
format_stamp: "Formatted at 2025-12-12 09:11:05 on dist-test-slave-qqr7"
I20251212 09:11:05.841734 30715 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20251212 09:11:05.842664 30729 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:05.842873 30715 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251212 09:11:05.842952 30715 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "185f6f3df26f44f6bf35d86586707816"
format_stamp: "Formatted at 2025-12-12 09:11:05 on dist-test-slave-qqr7"
I20251212 09:11:05.843042 30715 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:05.886524 30715 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:05.886838 30715 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:05.886963 30715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:05.887243 30715 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:05.887635 30715 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:05.887682 30715 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:05.887728 30715 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:05.887759 30715 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:05.895320 30715 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.129:40111
I20251212 09:11:05.895387 30842 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.129:40111 every 8 connection(s)
I20251212 09:11:05.895741 30715 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251212 09:11:05.900398 30843 heartbeater.cc:344] Connected to a master server at 127.29.26.190:39209
I20251212 09:11:05.900483 30843 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:05.900712 30843 heartbeater.cc:507] Master 127.29.26.190:39209 requested a full tablet report, sending...
I20251212 09:11:05.901149 30655 ts_manager.cc:194] Registered new tserver with Master: 185f6f3df26f44f6bf35d86586707816 (127.29.26.129:40111)
I20251212 09:11:05.901769 30655 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.129:41851
I20251212 09:11:05.902354 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 30715
I20251212 09:11:05.902438 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251212 09:11:05.903563 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.130:0
--local_ip_for_outbound_sockets=127.29.26.130
--webserver_interface=127.29.26.130
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39209
--builtin_ntp_servers=127.29.26.148:39085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20251212 09:11:06.014526 30846 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20251212 09:11:06.014699 30846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:06.014715 30846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:06.014734 30846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:06.016103 30846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:06.016156 30846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.130
I20251212 09:11:06.017669 30846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:39085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.29.26.130
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39209
--never_fsync=true
--heap_profile_path=/tmp/kudu.30846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.130
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:06.017864 30846 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:06.018060 30846 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:06.020776 30851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:06.020874 30846 server_base.cc:1047] running on GCE node
W20251212 09:11:06.020793 30854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:06.020785 30852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:06.021175 30846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:06.021369 30846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:06.022509 30846 hybrid_clock.cc:648] HybridClock initialized: now 1765530666022499 us; error 31 us; skew 500 ppm
I20251212 09:11:06.023676 30846 webserver.cc:492] Webserver started at http://127.29.26.130:38939/ using document root <none> and password file <none>
I20251212 09:11:06.023864 30846 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:06.023905 30846 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:06.023998 30846 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:06.024878 30846 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "7e22d44a6a7c4230a8bc4e6846233194"
format_stamp: "Formatted at 2025-12-12 09:11:06 on dist-test-slave-qqr7"
I20251212 09:11:06.025164 30846 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "7e22d44a6a7c4230a8bc4e6846233194"
format_stamp: "Formatted at 2025-12-12 09:11:06 on dist-test-slave-qqr7"
I20251212 09:11:06.026278 30846 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:06.026927 30860 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:06.027073 30846 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:06.027136 30846 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "7e22d44a6a7c4230a8bc4e6846233194"
format_stamp: "Formatted at 2025-12-12 09:11:06 on dist-test-slave-qqr7"
I20251212 09:11:06.027194 30846 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:06.053792 30846 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:06.054072 30846 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:06.054188 30846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:06.054395 30846 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:06.054718 30846 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:06.054752 30846 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:06.054790 30846 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:06.054816 30846 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:06.060351 30846 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.130:38149
I20251212 09:11:06.060407 30973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.130:38149 every 8 connection(s)
I20251212 09:11:06.060711 30846 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251212 09:11:06.069131 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 30846
I20251212 09:11:06.069219 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251212 09:11:06.069409 30974 heartbeater.cc:344] Connected to a master server at 127.29.26.190:39209
I20251212 09:11:06.069517 30974 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:06.069773 30974 heartbeater.cc:507] Master 127.29.26.190:39209 requested a full tablet report, sending...
I20251212 09:11:06.070149 30655 ts_manager.cc:194] Registered new tserver with Master: 7e22d44a6a7c4230a8bc4e6846233194 (127.29.26.130:38149)
I20251212 09:11:06.070283 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.131:0
--local_ip_for_outbound_sockets=127.29.26.131
--webserver_interface=127.29.26.131
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39209
--builtin_ntp_servers=127.29.26.148:39085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20251212 09:11:06.070643 30655 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.130:38759
W20251212 09:11:06.148864 30977 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20251212 09:11:06.149047 30977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:06.149062 30977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:06.149081 30977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:06.150485 30977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:06.150533 30977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.131
I20251212 09:11:06.152047 30977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:39085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.29.26.131
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39209
--never_fsync=true
--heap_profile_path=/tmp/kudu.30977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.131
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:06.152258 30977 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:06.152453 30977 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:06.155094 30982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:06.155099 30983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:06.155252 30985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:06.155268 30977 server_base.cc:1047] running on GCE node
I20251212 09:11:06.155480 30977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:06.155680 30977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:06.156803 30977 hybrid_clock.cc:648] HybridClock initialized: now 1765530666156785 us; error 35 us; skew 500 ppm
I20251212 09:11:06.157913 30977 webserver.cc:492] Webserver started at http://127.29.26.131:38475/ using document root <none> and password file <none>
I20251212 09:11:06.158111 30977 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:06.158154 30977 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:06.158267 30977 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:06.159107 30977 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "2372e0f31e464443b84994449dfa3195"
format_stamp: "Formatted at 2025-12-12 09:11:06 on dist-test-slave-qqr7"
I20251212 09:11:06.159384 30977 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "2372e0f31e464443b84994449dfa3195"
format_stamp: "Formatted at 2025-12-12 09:11:06 on dist-test-slave-qqr7"
I20251212 09:11:06.160524 30977 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251212 09:11:06.161293 30991 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:06.161438 30977 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251212 09:11:06.161502 30977 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "2372e0f31e464443b84994449dfa3195"
format_stamp: "Formatted at 2025-12-12 09:11:06 on dist-test-slave-qqr7"
I20251212 09:11:06.161562 30977 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:06.189224 30977 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:06.189478 30977 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:06.189576 30977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:06.189782 30977 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:06.190094 30977 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:06.190124 30977 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:06.190148 30977 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:06.190176 30977 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:06.195637 30977 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.131:37195
I20251212 09:11:06.195685 31104 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.131:37195 every 8 connection(s)
I20251212 09:11:06.195989 30977 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251212 09:11:06.200313 31105 heartbeater.cc:344] Connected to a master server at 127.29.26.190:39209
I20251212 09:11:06.200410 31105 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:06.200649 31105 heartbeater.cc:507] Master 127.29.26.190:39209 requested a full tablet report, sending...
I20251212 09:11:06.201045 30655 ts_manager.cc:194] Registered new tserver with Master: 2372e0f31e464443b84994449dfa3195 (127.29.26.131:37195)
I20251212 09:11:06.201423 30655 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.131:33883
I20251212 09:11:06.204759 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 30977
I20251212 09:11:06.204824 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestGracefulSpecificLeaderStepDown.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251212 09:11:06.205722 29802 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251212 09:11:06.211226 30655 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40452:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20251212 09:11:06.212481 30655 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251212 09:11:06.218406 31039 tablet_service.cc:1505] Processing CreateTablet for tablet 25b1d640396e442fbc8e7da59c5ac10f (DEFAULT_TABLE table=TestTable [id=c4eb1384eaaa41b3ba62fc8b6cfd25b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:06.218721 31039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b1d640396e442fbc8e7da59c5ac10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:06.219352 30777 tablet_service.cc:1505] Processing CreateTablet for tablet 25b1d640396e442fbc8e7da59c5ac10f (DEFAULT_TABLE table=TestTable [id=c4eb1384eaaa41b3ba62fc8b6cfd25b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:06.219523 30908 tablet_service.cc:1505] Processing CreateTablet for tablet 25b1d640396e442fbc8e7da59c5ac10f (DEFAULT_TABLE table=TestTable [id=c4eb1384eaaa41b3ba62fc8b6cfd25b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:06.219641 30777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b1d640396e442fbc8e7da59c5ac10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:06.219770 30908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b1d640396e442fbc8e7da59c5ac10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:06.221077 31119 tablet_bootstrap.cc:492] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195: Bootstrap starting.
I20251212 09:11:06.221699 31119 tablet_bootstrap.cc:654] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:06.221972 31119 log.cc:826] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:06.222266 31121 tablet_bootstrap.cc:492] T 25b1d640396e442fbc8e7da59c5ac10f P 185f6f3df26f44f6bf35d86586707816: Bootstrap starting.
I20251212 09:11:06.222841 31121 tablet_bootstrap.cc:654] T 25b1d640396e442fbc8e7da59c5ac10f P 185f6f3df26f44f6bf35d86586707816: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:06.223086 31121 log.cc:826] T 25b1d640396e442fbc8e7da59c5ac10f P 185f6f3df26f44f6bf35d86586707816: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:06.223498 31120 tablet_bootstrap.cc:492] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194: Bootstrap starting.
I20251212 09:11:06.223668 31121 tablet_bootstrap.cc:492] T 25b1d640396e442fbc8e7da59c5ac10f P 185f6f3df26f44f6bf35d86586707816: No bootstrap required, opened a new log
I20251212 09:11:06.223678 31119 tablet_bootstrap.cc:492] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195: No bootstrap required, opened a new log
I20251212 09:11:06.223729 31121 ts_tablet_manager.cc:1403] T 25b1d640396e442fbc8e7da59c5ac10f P 185f6f3df26f44f6bf35d86586707816: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:06.223742 31119 ts_tablet_manager.cc:1403] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251212 09:11:06.224079 31120 tablet_bootstrap.cc:654] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:06.224354 31120 log.cc:826] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:06.225006 31120 tablet_bootstrap.cc:492] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194: No bootstrap required, opened a new log
I20251212 09:11:06.225068 31120 ts_tablet_manager.cc:1403] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251212 09:11:06.225036 31121 raft_consensus.cc:359] T 25b1d640396e442fbc8e7da59c5ac10f P 185f6f3df26f44f6bf35d86586707816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e22d44a6a7c4230a8bc4e6846233194" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 38149 } } peers { permanent_uuid: "2372e0f31e464443b84994449dfa3195" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 37195 } } peers { permanent_uuid: "185f6f3df26f44f6bf35d86586707816" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40111 } }
I20251212 09:11:06.225181 31121 raft_consensus.cc:740] T 25b1d640396e442fbc8e7da59c5ac10f P 185f6f3df26f44f6bf35d86586707816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185f6f3df26f44f6bf35d86586707816, State: Initialized, Role: FOLLOWER
I20251212 09:11:06.225260 31121 consensus_queue.cc:260] T 25b1d640396e442fbc8e7da59c5ac10f P 185f6f3df26f44f6bf35d86586707816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e22d44a6a7c4230a8bc4e6846233194" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 38149 } } peers { permanent_uuid: "2372e0f31e464443b84994449dfa3195" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 37195 } } peers { permanent_uuid: "185f6f3df26f44f6bf35d86586707816" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40111 } }
I20251212 09:11:06.225399 31119 raft_consensus.cc:359] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e22d44a6a7c4230a8bc4e6846233194" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 38149 } } peers { permanent_uuid: "2372e0f31e464443b84994449dfa3195" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 37195 } } peers { permanent_uuid: "185f6f3df26f44f6bf35d86586707816" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40111 } }
I20251212 09:11:06.225487 31121 ts_tablet_manager.cc:1434] T 25b1d640396e442fbc8e7da59c5ac10f P 185f6f3df26f44f6bf35d86586707816: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251212 09:11:06.225517 31119 raft_consensus.cc:740] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2372e0f31e464443b84994449dfa3195, State: Initialized, Role: FOLLOWER
I20251212 09:11:06.225562 31119 consensus_queue.cc:260] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e22d44a6a7c4230a8bc4e6846233194" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 38149 } } peers { permanent_uuid: "2372e0f31e464443b84994449dfa3195" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 37195 } } peers { permanent_uuid: "185f6f3df26f44f6bf35d86586707816" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40111 } }
I20251212 09:11:06.225595 30843 heartbeater.cc:499] Master 127.29.26.190:39209 was elected leader, sending a full tablet report...
I20251212 09:11:06.225759 31119 ts_tablet_manager.cc:1434] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:06.225880 31105 heartbeater.cc:499] Master 127.29.26.190:39209 was elected leader, sending a full tablet report...
I20251212 09:11:06.226513 31120 raft_consensus.cc:359] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e22d44a6a7c4230a8bc4e6846233194" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 38149 } } peers { permanent_uuid: "2372e0f31e464443b84994449dfa3195" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 37195 } } peers { permanent_uuid: "185f6f3df26f44f6bf35d86586707816" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40111 } }
I20251212 09:11:06.226629 31120 raft_consensus.cc:740] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e22d44a6a7c4230a8bc4e6846233194, State: Initialized, Role: FOLLOWER
I20251212 09:11:06.226691 31120 consensus_queue.cc:260] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e22d44a6a7c4230a8bc4e6846233194" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 38149 } } peers { permanent_uuid: "2372e0f31e464443b84994449dfa3195" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 37195 } } peers { permanent_uuid: "185f6f3df26f44f6bf35d86586707816" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40111 } }
I20251212 09:11:06.226958 31120 ts_tablet_manager.cc:1434] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:06.227098 30974 heartbeater.cc:499] Master 127.29.26.190:39209 was elected leader, sending a full tablet report...
I20251212 09:11:06.230095 29802 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251212 09:11:06.230473 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 185f6f3df26f44f6bf35d86586707816 to finish bootstrapping
I20251212 09:11:06.233901 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 7e22d44a6a7c4230a8bc4e6846233194 to finish bootstrapping
I20251212 09:11:06.236783 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 2372e0f31e464443b84994449dfa3195 to finish bootstrapping
I20251212 09:11:06.247289 30928 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "25b1d640396e442fbc8e7da59c5ac10f"
dest_uuid: "7e22d44a6a7c4230a8bc4e6846233194"
from {username='slave'} at 127.0.0.1:44276
I20251212 09:11:06.247421 30928 raft_consensus.cc:493] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20251212 09:11:06.247493 30928 raft_consensus.cc:3060] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:06.248468 30928 raft_consensus.cc:515] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e22d44a6a7c4230a8bc4e6846233194" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 38149 } } peers { permanent_uuid: "2372e0f31e464443b84994449dfa3195" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 37195 } } peers { permanent_uuid: "185f6f3df26f44f6bf35d86586707816" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40111 } }
I20251212 09:11:06.248795 30928 leader_election.cc:290] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [CANDIDATE]: Term 1 election: Requested vote from peers 2372e0f31e464443b84994449dfa3195 (127.29.26.131:37195), 185f6f3df26f44f6bf35d86586707816 (127.29.26.129:40111)
I20251212 09:11:06.249970 29802 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20251212 09:11:06.251559 30797 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25b1d640396e442fbc8e7da59c5ac10f" candidate_uuid: "7e22d44a6a7c4230a8bc4e6846233194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "185f6f3df26f44f6bf35d86586707816"
I20251212 09:11:06.251675 30797 raft_consensus.cc:3060] T 25b1d640396e442fbc8e7da59c5ac10f P 185f6f3df26f44f6bf35d86586707816 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:06.252645 30797 raft_consensus.cc:2468] T 25b1d640396e442fbc8e7da59c5ac10f P 185f6f3df26f44f6bf35d86586707816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e22d44a6a7c4230a8bc4e6846233194 in term 1.
I20251212 09:11:06.252858 30862 leader_election.cc:304] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185f6f3df26f44f6bf35d86586707816, 7e22d44a6a7c4230a8bc4e6846233194; no voters:
I20251212 09:11:06.252903 31059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25b1d640396e442fbc8e7da59c5ac10f" candidate_uuid: "7e22d44a6a7c4230a8bc4e6846233194" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2372e0f31e464443b84994449dfa3195"
I20251212 09:11:06.253008 31059 raft_consensus.cc:3060] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:06.253010 31127 raft_consensus.cc:2804] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:06.253187 31127 raft_consensus.cc:697] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 1 LEADER]: Becoming Leader. State: Replica: 7e22d44a6a7c4230a8bc4e6846233194, State: Running, Role: LEADER
I20251212 09:11:06.253301 31127 consensus_queue.cc:237] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e22d44a6a7c4230a8bc4e6846233194" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 38149 } } peers { permanent_uuid: "2372e0f31e464443b84994449dfa3195" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 37195 } } peers { permanent_uuid: "185f6f3df26f44f6bf35d86586707816" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40111 } }
I20251212 09:11:06.254024 31059 raft_consensus.cc:2468] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e22d44a6a7c4230a8bc4e6846233194 in term 1.
I20251212 09:11:06.254097 30655 catalog_manager.cc:5654] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e22d44a6a7c4230a8bc4e6846233194 (127.29.26.130). New cstate: current_term: 1 leader_uuid: "7e22d44a6a7c4230a8bc4e6846233194" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e22d44a6a7c4230a8bc4e6846233194" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 38149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2372e0f31e464443b84994449dfa3195" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 37195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "185f6f3df26f44f6bf35d86586707816" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40111 } health_report { overall_health: UNKNOWN } } }
W20251212 09:11:06.311251 30975 tablet.cc:2378] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251212 09:11:06.351298 29802 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0 0.0
W20251212 09:11:06.397039 30844 tablet.cc:2378] T 25b1d640396e442fbc8e7da59c5ac10f P 185f6f3df26f44f6bf35d86586707816: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251212 09:11:06.446512 31106 tablet.cc:2378] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251212 09:11:06.552829 29802 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0 0.0
I20251212 09:11:06.835795 31133 consensus_queue.cc:1048] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2372e0f31e464443b84994449dfa3195" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 37195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251212 09:11:06.837795 31138 consensus_queue.cc:1048] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [LEADER]: Connected to new peer: Peer: permanent_uuid: "185f6f3df26f44f6bf35d86586707816" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251212 09:11:06.947693 30928 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "25b1d640396e442fbc8e7da59c5ac10f"
dest_uuid: "7e22d44a6a7c4230a8bc4e6846233194"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:44282
I20251212 09:11:06.947788 30928 raft_consensus.cc:606] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 1 LEADER]: Received request to transfer leadership
I20251212 09:11:07.344507 31160 raft_consensus.cc:993] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194: : Instructing follower 2372e0f31e464443b84994449dfa3195 to start an election
I20251212 09:11:07.344596 31160 raft_consensus.cc:1081] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 1 LEADER]: Signalling peer 2372e0f31e464443b84994449dfa3195 to start an election
I20251212 09:11:07.344839 31059 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "25b1d640396e442fbc8e7da59c5ac10f"
dest_uuid: "2372e0f31e464443b84994449dfa3195"
from {username='slave'} at 127.29.26.130:40089
I20251212 09:11:07.344952 31059 raft_consensus.cc:493] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251212 09:11:07.344983 31059 raft_consensus.cc:3060] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195 [term 1 FOLLOWER]: Advancing to term 2
I20251212 09:11:07.345583 31059 raft_consensus.cc:515] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e22d44a6a7c4230a8bc4e6846233194" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 38149 } } peers { permanent_uuid: "2372e0f31e464443b84994449dfa3195" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 37195 } } peers { permanent_uuid: "185f6f3df26f44f6bf35d86586707816" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40111 } }
I20251212 09:11:07.345839 31059 leader_election.cc:290] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195 [CANDIDATE]: Term 2 election: Requested vote from peers 7e22d44a6a7c4230a8bc4e6846233194 (127.29.26.130:38149), 185f6f3df26f44f6bf35d86586707816 (127.29.26.129:40111)
I20251212 09:11:07.348389 30797 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25b1d640396e442fbc8e7da59c5ac10f" candidate_uuid: "2372e0f31e464443b84994449dfa3195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "185f6f3df26f44f6bf35d86586707816"
I20251212 09:11:07.348438 30928 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25b1d640396e442fbc8e7da59c5ac10f" candidate_uuid: "2372e0f31e464443b84994449dfa3195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e22d44a6a7c4230a8bc4e6846233194"
I20251212 09:11:07.348490 30797 raft_consensus.cc:3060] T 25b1d640396e442fbc8e7da59c5ac10f P 185f6f3df26f44f6bf35d86586707816 [term 1 FOLLOWER]: Advancing to term 2
I20251212 09:11:07.348517 30928 raft_consensus.cc:3055] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 1 LEADER]: Stepping down as leader of term 1
I20251212 09:11:07.348551 30928 raft_consensus.cc:740] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e22d44a6a7c4230a8bc4e6846233194, State: Running, Role: LEADER
I20251212 09:11:07.348598 30928 consensus_queue.cc:260] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e22d44a6a7c4230a8bc4e6846233194" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 38149 } } peers { permanent_uuid: "2372e0f31e464443b84994449dfa3195" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 37195 } } peers { permanent_uuid: "185f6f3df26f44f6bf35d86586707816" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40111 } }
I20251212 09:11:07.348732 30928 raft_consensus.cc:3060] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 1 FOLLOWER]: Advancing to term 2
I20251212 09:11:07.349274 30797 raft_consensus.cc:2468] T 25b1d640396e442fbc8e7da59c5ac10f P 185f6f3df26f44f6bf35d86586707816 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2372e0f31e464443b84994449dfa3195 in term 2.
I20251212 09:11:07.349455 30928 raft_consensus.cc:2468] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2372e0f31e464443b84994449dfa3195 in term 2.
I20251212 09:11:07.349462 30993 leader_election.cc:304] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 185f6f3df26f44f6bf35d86586707816, 2372e0f31e464443b84994449dfa3195; no voters:
I20251212 09:11:07.349654 31165 raft_consensus.cc:2804] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195 [term 2 FOLLOWER]: Leader election won for term 2
I20251212 09:11:07.349781 31165 raft_consensus.cc:697] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195 [term 2 LEADER]: Becoming Leader. State: Replica: 2372e0f31e464443b84994449dfa3195, State: Running, Role: LEADER
I20251212 09:11:07.349856 31165 consensus_queue.cc:237] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e22d44a6a7c4230a8bc4e6846233194" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 38149 } } peers { permanent_uuid: "2372e0f31e464443b84994449dfa3195" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 37195 } } peers { permanent_uuid: "185f6f3df26f44f6bf35d86586707816" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40111 } }
I20251212 09:11:07.350420 30655 catalog_manager.cc:5654] T 25b1d640396e442fbc8e7da59c5ac10f P 2372e0f31e464443b84994449dfa3195 reported cstate change: term changed from 1 to 2, leader changed from 7e22d44a6a7c4230a8bc4e6846233194 (127.29.26.130) to 2372e0f31e464443b84994449dfa3195 (127.29.26.131). New cstate: current_term: 2 leader_uuid: "2372e0f31e464443b84994449dfa3195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e22d44a6a7c4230a8bc4e6846233194" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 38149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2372e0f31e464443b84994449dfa3195" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 37195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "185f6f3df26f44f6bf35d86586707816" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40111 } health_report { overall_health: UNKNOWN } } }
I20251212 09:11:07.618381 30928 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "25b1d640396e442fbc8e7da59c5ac10f"
dest_uuid: "7e22d44a6a7c4230a8bc4e6846233194"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:44284
I20251212 09:11:07.618468 30928 raft_consensus.cc:606] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 2 FOLLOWER]: Received request to transfer leadership
I20251212 09:11:07.618489 30928 raft_consensus.cc:614] T 25b1d640396e442fbc8e7da59c5ac10f P 7e22d44a6a7c4230a8bc4e6846233194 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20251212 09:11:07.624173 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 30715
I20251212 09:11:07.628523 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 30846
I20251212 09:11:07.633184 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 30977
I20251212 09:11:07.637588 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 30624
2025-12-12T09:11:07Z chronyd exiting
[ OK ] AdminCliTest.TestGracefulSpecificLeaderStepDown (2096 ms)
[ RUN ] AdminCliTest.TestDescribeTableColumnFlags
I20251212 09:11:07.657277 29802 test_util.cc:276] Using random seed: -1538709448
I20251212 09:11:07.657794 29802 ts_itest-base.cc:115] Starting cluster with:
I20251212 09:11:07.657831 29802 ts_itest-base.cc:116] --------------
I20251212 09:11:07.657846 29802 ts_itest-base.cc:117] 3 tablet servers
I20251212 09:11:07.657864 29802 ts_itest-base.cc:118] 3 replicas per TS
I20251212 09:11:07.657891 29802 ts_itest-base.cc:119] --------------
2025-12-12T09:11:07Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-12T09:11:07Z Disabled control of system clock
I20251212 09:11:07.664809 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:40173
--webserver_interface=127.29.26.190
--webserver_port=0
--builtin_ntp_servers=127.29.26.148:42919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.26.190:40173 with env {}
W20251212 09:11:07.743232 31194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:07.743409 31194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:07.743427 31194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:07.744840 31194 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251212 09:11:07.744881 31194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:07.744894 31194 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251212 09:11:07.744906 31194 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251212 09:11:07.746351 31194 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:42919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.26.190:40173
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:40173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.29.26.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.31194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:07.746556 31194 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:07.746738 31194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:07.749080 31200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:07.749238 31194 server_base.cc:1047] running on GCE node
W20251212 09:11:07.749110 31199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:07.749177 31202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:07.749570 31194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:07.749768 31194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:07.750900 31194 hybrid_clock.cc:648] HybridClock initialized: now 1765530667750887 us; error 30 us; skew 500 ppm
I20251212 09:11:07.751996 31194 webserver.cc:492] Webserver started at http://127.29.26.190:34429/ using document root <none> and password file <none>
I20251212 09:11:07.752206 31194 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:07.752249 31194 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:07.752367 31194 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:07.753229 31194 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "660dc06deacc41709cf9a6ec1c23f731"
format_stamp: "Formatted at 2025-12-12 09:11:07 on dist-test-slave-qqr7"
I20251212 09:11:07.753513 31194 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "660dc06deacc41709cf9a6ec1c23f731"
format_stamp: "Formatted at 2025-12-12 09:11:07 on dist-test-slave-qqr7"
I20251212 09:11:07.754659 31194 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251212 09:11:07.755324 31208 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:07.755473 31194 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:07.755545 31194 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
uuid: "660dc06deacc41709cf9a6ec1c23f731"
format_stamp: "Formatted at 2025-12-12 09:11:07 on dist-test-slave-qqr7"
I20251212 09:11:07.755601 31194 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:07.776019 31194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:07.776340 31194 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:07.776464 31194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:07.780570 31194 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.190:40173
I20251212 09:11:07.780606 31260 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.190:40173 every 8 connection(s)
I20251212 09:11:07.780993 31194 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251212 09:11:07.781612 31261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:07.783815 31261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731: Bootstrap starting.
I20251212 09:11:07.784420 31261 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:07.784703 31261 log.cc:826] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:07.785365 31261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731: No bootstrap required, opened a new log
I20251212 09:11:07.786587 31261 raft_consensus.cc:359] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "660dc06deacc41709cf9a6ec1c23f731" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 40173 } }
I20251212 09:11:07.786713 31261 raft_consensus.cc:385] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:07.786733 31261 raft_consensus.cc:740] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 660dc06deacc41709cf9a6ec1c23f731, State: Initialized, Role: FOLLOWER
I20251212 09:11:07.786847 31261 consensus_queue.cc:260] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "660dc06deacc41709cf9a6ec1c23f731" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 40173 } }
I20251212 09:11:07.786912 31261 raft_consensus.cc:399] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:07.786940 31261 raft_consensus.cc:493] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:07.786972 31261 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:07.787456 31261 raft_consensus.cc:515] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "660dc06deacc41709cf9a6ec1c23f731" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 40173 } }
I20251212 09:11:07.787552 31261 leader_election.cc:304] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 660dc06deacc41709cf9a6ec1c23f731; no voters:
I20251212 09:11:07.787705 31261 leader_election.cc:290] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251212 09:11:07.787763 31264 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:07.787909 31264 raft_consensus.cc:697] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [term 1 LEADER]: Becoming Leader. State: Replica: 660dc06deacc41709cf9a6ec1c23f731, State: Running, Role: LEADER
I20251212 09:11:07.787910 31261 sys_catalog.cc:565] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [sys.catalog]: configured and running, proceeding with master startup.
I20251212 09:11:07.788035 31264 consensus_queue.cc:237] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "660dc06deacc41709cf9a6ec1c23f731" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 40173 } }
I20251212 09:11:07.788501 31266 sys_catalog.cc:455] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 660dc06deacc41709cf9a6ec1c23f731. Latest consensus state: current_term: 1 leader_uuid: "660dc06deacc41709cf9a6ec1c23f731" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "660dc06deacc41709cf9a6ec1c23f731" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 40173 } } }
I20251212 09:11:07.788632 31266 sys_catalog.cc:458] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:07.788504 31265 sys_catalog.cc:455] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "660dc06deacc41709cf9a6ec1c23f731" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "660dc06deacc41709cf9a6ec1c23f731" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 40173 } } }
I20251212 09:11:07.788826 31265 sys_catalog.cc:458] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731 [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:07.789021 31273 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251212 09:11:07.788937 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 31194
I20251212 09:11:07.789114 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251212 09:11:07.789455 31273 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251212 09:11:07.790845 31273 catalog_manager.cc:1357] Generated new cluster ID: 1081f48f92e6464f86b482aeec9c0b10
I20251212 09:11:07.790889 31273 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251212 09:11:07.796778 31273 catalog_manager.cc:1380] Generated new certificate authority record
I20251212 09:11:07.797528 31273 catalog_manager.cc:1514] Loading token signing keys...
I20251212 09:11:07.802796 31273 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 660dc06deacc41709cf9a6ec1c23f731: Generated new TSK 0
I20251212 09:11:07.802989 31273 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251212 09:11:07.806699 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.129:0
--local_ip_for_outbound_sockets=127.29.26.129
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:40173
--builtin_ntp_servers=127.29.26.148:42919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251212 09:11:07.890316 31285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:07.890525 31285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:07.890561 31285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:07.892046 31285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:07.892103 31285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.129
I20251212 09:11:07.893771 31285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:42919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:40173
--never_fsync=true
--heap_profile_path=/tmp/kudu.31285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.129
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:07.894001 31285 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:07.894241 31285 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:07.896847 31290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:07.896857 31291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:07.896893 31293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:07.896942 31285 server_base.cc:1047] running on GCE node
I20251212 09:11:07.897210 31285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:07.897421 31285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:07.898568 31285 hybrid_clock.cc:648] HybridClock initialized: now 1765530667898558 us; error 25 us; skew 500 ppm
I20251212 09:11:07.899888 31285 webserver.cc:492] Webserver started at http://127.29.26.129:35349/ using document root <none> and password file <none>
I20251212 09:11:07.900089 31285 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:07.900134 31285 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:07.900274 31285 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:07.901228 31285 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "bf312bffd2e8423aa318571636978cbd"
format_stamp: "Formatted at 2025-12-12 09:11:07 on dist-test-slave-qqr7"
I20251212 09:11:07.901533 31285 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "bf312bffd2e8423aa318571636978cbd"
format_stamp: "Formatted at 2025-12-12 09:11:07 on dist-test-slave-qqr7"
I20251212 09:11:07.902762 31285 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251212 09:11:07.903484 31299 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:07.903666 31285 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:07.903760 31285 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "bf312bffd2e8423aa318571636978cbd"
format_stamp: "Formatted at 2025-12-12 09:11:07 on dist-test-slave-qqr7"
I20251212 09:11:07.903829 31285 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:07.920073 31285 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:07.920377 31285 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:07.920513 31285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:07.920809 31285 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:07.921258 31285 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:07.921304 31285 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:07.921335 31285 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:07.921360 31285 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:07.928380 31285 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.129:40173
I20251212 09:11:07.928444 31412 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.129:40173 every 8 connection(s)
I20251212 09:11:07.928867 31285 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251212 09:11:07.931224 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 31285
I20251212 09:11:07.931310 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251212 09:11:07.932463 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.130:0
--local_ip_for_outbound_sockets=127.29.26.130
--webserver_interface=127.29.26.130
--webserver_port=0
--tserver_master_addrs=127.29.26.190:40173
--builtin_ntp_servers=127.29.26.148:42919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251212 09:11:07.934486 31413 heartbeater.cc:344] Connected to a master server at 127.29.26.190:40173
I20251212 09:11:07.934592 31413 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:07.934796 31413 heartbeater.cc:507] Master 127.29.26.190:40173 requested a full tablet report, sending...
I20251212 09:11:07.935297 31225 ts_manager.cc:194] Registered new tserver with Master: bf312bffd2e8423aa318571636978cbd (127.29.26.129:40173)
I20251212 09:11:07.936259 31225 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.129:44749
W20251212 09:11:08.012210 31416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:08.012389 31416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:08.012411 31416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:08.013909 31416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:08.013976 31416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.130
I20251212 09:11:08.015519 31416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:42919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.29.26.130
--webserver_port=0
--tserver_master_addrs=127.29.26.190:40173
--never_fsync=true
--heap_profile_path=/tmp/kudu.31416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.130
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:08.015758 31416 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:08.015985 31416 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:08.018682 31424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:08.018725 31421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:08.018733 31422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:08.018848 31416 server_base.cc:1047] running on GCE node
I20251212 09:11:08.019047 31416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:08.019266 31416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:08.020416 31416 hybrid_clock.cc:648] HybridClock initialized: now 1765530668020394 us; error 33 us; skew 500 ppm
I20251212 09:11:08.021643 31416 webserver.cc:492] Webserver started at http://127.29.26.130:45219/ using document root <none> and password file <none>
I20251212 09:11:08.021844 31416 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:08.021889 31416 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:08.022013 31416 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:08.022854 31416 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "1f38b9a3914d44438fa2a7d0725e16bc"
format_stamp: "Formatted at 2025-12-12 09:11:08 on dist-test-slave-qqr7"
I20251212 09:11:08.023159 31416 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "1f38b9a3914d44438fa2a7d0725e16bc"
format_stamp: "Formatted at 2025-12-12 09:11:08 on dist-test-slave-qqr7"
I20251212 09:11:08.024323 31416 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251212 09:11:08.025154 31430 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:08.025354 31416 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251212 09:11:08.025434 31416 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "1f38b9a3914d44438fa2a7d0725e16bc"
format_stamp: "Formatted at 2025-12-12 09:11:08 on dist-test-slave-qqr7"
I20251212 09:11:08.025502 31416 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:08.039885 31416 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:08.040170 31416 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:08.040289 31416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:08.040501 31416 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:08.040889 31416 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:08.040932 31416 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:08.040956 31416 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:08.040983 31416 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:08.046608 31416 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.130:43275
I20251212 09:11:08.046658 31543 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.130:43275 every 8 connection(s)
I20251212 09:11:08.046960 31416 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251212 09:11:08.047403 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 31416
I20251212 09:11:08.047485 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251212 09:11:08.048686 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.131:0
--local_ip_for_outbound_sockets=127.29.26.131
--webserver_interface=127.29.26.131
--webserver_port=0
--tserver_master_addrs=127.29.26.190:40173
--builtin_ntp_servers=127.29.26.148:42919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251212 09:11:08.051926 31544 heartbeater.cc:344] Connected to a master server at 127.29.26.190:40173
I20251212 09:11:08.052050 31544 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:08.052254 31544 heartbeater.cc:507] Master 127.29.26.190:40173 requested a full tablet report, sending...
I20251212 09:11:08.052614 31225 ts_manager.cc:194] Registered new tserver with Master: 1f38b9a3914d44438fa2a7d0725e16bc (127.29.26.130:43275)
I20251212 09:11:08.053014 31225 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.130:48279
W20251212 09:11:08.127583 31547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:08.127758 31547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:08.127795 31547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:08.129302 31547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:08.129370 31547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.131
I20251212 09:11:08.130916 31547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:42919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.29.26.131
--webserver_port=0
--tserver_master_addrs=127.29.26.190:40173
--never_fsync=true
--heap_profile_path=/tmp/kudu.31547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.131
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:08.131160 31547 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:08.131393 31547 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:08.134019 31553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:08.134034 31555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:08.134176 31547 server_base.cc:1047] running on GCE node
W20251212 09:11:08.134016 31552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:08.134415 31547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:08.134615 31547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:08.135748 31547 hybrid_clock.cc:648] HybridClock initialized: now 1765530668135728 us; error 35 us; skew 500 ppm
I20251212 09:11:08.136920 31547 webserver.cc:492] Webserver started at http://127.29.26.131:39599/ using document root <none> and password file <none>
I20251212 09:11:08.137135 31547 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:08.137181 31547 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:08.137310 31547 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:08.138162 31547 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "b0928c0205754195b08b99d89f289dda"
format_stamp: "Formatted at 2025-12-12 09:11:08 on dist-test-slave-qqr7"
I20251212 09:11:08.138464 31547 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "b0928c0205754195b08b99d89f289dda"
format_stamp: "Formatted at 2025-12-12 09:11:08 on dist-test-slave-qqr7"
I20251212 09:11:08.139613 31547 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20251212 09:11:08.140321 31561 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:08.140540 31547 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:08.140609 31547 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "b0928c0205754195b08b99d89f289dda"
format_stamp: "Formatted at 2025-12-12 09:11:08 on dist-test-slave-qqr7"
I20251212 09:11:08.140702 31547 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:08.165367 31547 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:08.165622 31547 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:08.165733 31547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:08.165953 31547 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:08.166321 31547 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:08.166355 31547 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:08.166395 31547 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:08.166425 31547 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:08.172013 31547 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.131:36611
I20251212 09:11:08.172083 31674 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.131:36611 every 8 connection(s)
I20251212 09:11:08.172376 31547 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251212 09:11:08.173254 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 31547
I20251212 09:11:08.173333 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestDescribeTableColumnFlags.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251212 09:11:08.177001 31675 heartbeater.cc:344] Connected to a master server at 127.29.26.190:40173
I20251212 09:11:08.177112 31675 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:08.177312 31675 heartbeater.cc:507] Master 127.29.26.190:40173 requested a full tablet report, sending...
I20251212 09:11:08.177639 31225 ts_manager.cc:194] Registered new tserver with Master: b0928c0205754195b08b99d89f289dda (127.29.26.131:36611)
I20251212 09:11:08.177999 31225 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.131:52009
I20251212 09:11:08.185638 29802 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251212 09:11:08.191614 31225 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44844:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20251212 09:11:08.193334 31225 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251212 09:11:08.199777 31347 tablet_service.cc:1505] Processing CreateTablet for tablet 8cf3abfd831644198121f41caaa513b8 (DEFAULT_TABLE table=TestTable [id=99303196726a476589e59f46393492bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:08.199837 31478 tablet_service.cc:1505] Processing CreateTablet for tablet 8cf3abfd831644198121f41caaa513b8 (DEFAULT_TABLE table=TestTable [id=99303196726a476589e59f46393492bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:08.199807 31609 tablet_service.cc:1505] Processing CreateTablet for tablet 8cf3abfd831644198121f41caaa513b8 (DEFAULT_TABLE table=TestTable [id=99303196726a476589e59f46393492bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:08.200094 31609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf3abfd831644198121f41caaa513b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:08.200094 31478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf3abfd831644198121f41caaa513b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:08.200095 31347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf3abfd831644198121f41caaa513b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:08.202363 31689 tablet_bootstrap.cc:492] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd: Bootstrap starting.
I20251212 09:11:08.202725 31690 tablet_bootstrap.cc:492] T 8cf3abfd831644198121f41caaa513b8 P b0928c0205754195b08b99d89f289dda: Bootstrap starting.
I20251212 09:11:08.203112 31689 tablet_bootstrap.cc:654] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:08.203338 31690 tablet_bootstrap.cc:654] T 8cf3abfd831644198121f41caaa513b8 P b0928c0205754195b08b99d89f289dda: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:08.203423 31689 log.cc:826] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:08.203599 31690 log.cc:826] T 8cf3abfd831644198121f41caaa513b8 P b0928c0205754195b08b99d89f289dda: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:08.203883 31691 tablet_bootstrap.cc:492] T 8cf3abfd831644198121f41caaa513b8 P 1f38b9a3914d44438fa2a7d0725e16bc: Bootstrap starting.
I20251212 09:11:08.204288 31690 tablet_bootstrap.cc:492] T 8cf3abfd831644198121f41caaa513b8 P b0928c0205754195b08b99d89f289dda: No bootstrap required, opened a new log
I20251212 09:11:08.204353 31690 ts_tablet_manager.cc:1403] T 8cf3abfd831644198121f41caaa513b8 P b0928c0205754195b08b99d89f289dda: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251212 09:11:08.204461 31691 tablet_bootstrap.cc:654] T 8cf3abfd831644198121f41caaa513b8 P 1f38b9a3914d44438fa2a7d0725e16bc: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:08.204746 31691 log.cc:826] T 8cf3abfd831644198121f41caaa513b8 P 1f38b9a3914d44438fa2a7d0725e16bc: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:08.205130 31689 tablet_bootstrap.cc:492] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd: No bootstrap required, opened a new log
I20251212 09:11:08.205199 31689 ts_tablet_manager.cc:1403] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251212 09:11:08.205442 31691 tablet_bootstrap.cc:492] T 8cf3abfd831644198121f41caaa513b8 P 1f38b9a3914d44438fa2a7d0725e16bc: No bootstrap required, opened a new log
I20251212 09:11:08.205510 31691 ts_tablet_manager.cc:1403] T 8cf3abfd831644198121f41caaa513b8 P 1f38b9a3914d44438fa2a7d0725e16bc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251212 09:11:08.205976 31690 raft_consensus.cc:359] T 8cf3abfd831644198121f41caaa513b8 P b0928c0205754195b08b99d89f289dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } }
I20251212 09:11:08.206117 31690 raft_consensus.cc:385] T 8cf3abfd831644198121f41caaa513b8 P b0928c0205754195b08b99d89f289dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:08.206144 31690 raft_consensus.cc:740] T 8cf3abfd831644198121f41caaa513b8 P b0928c0205754195b08b99d89f289dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0928c0205754195b08b99d89f289dda, State: Initialized, Role: FOLLOWER
I20251212 09:11:08.206246 31690 consensus_queue.cc:260] T 8cf3abfd831644198121f41caaa513b8 P b0928c0205754195b08b99d89f289dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } }
I20251212 09:11:08.206468 31690 ts_tablet_manager.cc:1434] T 8cf3abfd831644198121f41caaa513b8 P b0928c0205754195b08b99d89f289dda: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:08.206507 31675 heartbeater.cc:499] Master 127.29.26.190:40173 was elected leader, sending a full tablet report...
I20251212 09:11:08.206462 31689 raft_consensus.cc:359] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } }
I20251212 09:11:08.206579 31689 raft_consensus.cc:385] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:08.206605 31689 raft_consensus.cc:740] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf312bffd2e8423aa318571636978cbd, State: Initialized, Role: FOLLOWER
I20251212 09:11:08.206686 31689 consensus_queue.cc:260] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } }
I20251212 09:11:08.206928 31689 ts_tablet_manager.cc:1434] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:08.206974 31413 heartbeater.cc:499] Master 127.29.26.190:40173 was elected leader, sending a full tablet report...
I20251212 09:11:08.207011 31691 raft_consensus.cc:359] T 8cf3abfd831644198121f41caaa513b8 P 1f38b9a3914d44438fa2a7d0725e16bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } }
I20251212 09:11:08.207115 31691 raft_consensus.cc:385] T 8cf3abfd831644198121f41caaa513b8 P 1f38b9a3914d44438fa2a7d0725e16bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:08.207140 31691 raft_consensus.cc:740] T 8cf3abfd831644198121f41caaa513b8 P 1f38b9a3914d44438fa2a7d0725e16bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f38b9a3914d44438fa2a7d0725e16bc, State: Initialized, Role: FOLLOWER
I20251212 09:11:08.207551 31691 consensus_queue.cc:260] T 8cf3abfd831644198121f41caaa513b8 P 1f38b9a3914d44438fa2a7d0725e16bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } }
I20251212 09:11:08.207832 31691 ts_tablet_manager.cc:1434] T 8cf3abfd831644198121f41caaa513b8 P 1f38b9a3914d44438fa2a7d0725e16bc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:08.207902 31544 heartbeater.cc:499] Master 127.29.26.190:40173 was elected leader, sending a full tablet report...
W20251212 09:11:08.297441 31545 tablet.cc:2378] T 8cf3abfd831644198121f41caaa513b8 P 1f38b9a3914d44438fa2a7d0725e16bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251212 09:11:08.360177 31696 raft_consensus.cc:493] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251212 09:11:08.360309 31696 raft_consensus.cc:515] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } }
I20251212 09:11:08.360587 31696 leader_election.cc:290] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0928c0205754195b08b99d89f289dda (127.29.26.131:36611), 1f38b9a3914d44438fa2a7d0725e16bc (127.29.26.130:43275)
I20251212 09:11:08.364017 31629 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8cf3abfd831644198121f41caaa513b8" candidate_uuid: "bf312bffd2e8423aa318571636978cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0928c0205754195b08b99d89f289dda" is_pre_election: true
I20251212 09:11:08.364135 31498 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8cf3abfd831644198121f41caaa513b8" candidate_uuid: "bf312bffd2e8423aa318571636978cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" is_pre_election: true
I20251212 09:11:08.364192 31629 raft_consensus.cc:2468] T 8cf3abfd831644198121f41caaa513b8 P b0928c0205754195b08b99d89f289dda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf312bffd2e8423aa318571636978cbd in term 0.
I20251212 09:11:08.364290 31498 raft_consensus.cc:2468] T 8cf3abfd831644198121f41caaa513b8 P 1f38b9a3914d44438fa2a7d0725e16bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf312bffd2e8423aa318571636978cbd in term 0.
I20251212 09:11:08.364424 31302 leader_election.cc:304] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0928c0205754195b08b99d89f289dda, bf312bffd2e8423aa318571636978cbd; no voters:
I20251212 09:11:08.364599 31696 raft_consensus.cc:2804] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251212 09:11:08.364640 31696 raft_consensus.cc:493] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251212 09:11:08.364699 31696 raft_consensus.cc:3060] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:08.365325 31696 raft_consensus.cc:515] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } }
I20251212 09:11:08.365454 31696 leader_election.cc:290] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [CANDIDATE]: Term 1 election: Requested vote from peers b0928c0205754195b08b99d89f289dda (127.29.26.131:36611), 1f38b9a3914d44438fa2a7d0725e16bc (127.29.26.130:43275)
I20251212 09:11:08.365625 31629 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8cf3abfd831644198121f41caaa513b8" candidate_uuid: "bf312bffd2e8423aa318571636978cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0928c0205754195b08b99d89f289dda"
I20251212 09:11:08.365636 31498 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8cf3abfd831644198121f41caaa513b8" candidate_uuid: "bf312bffd2e8423aa318571636978cbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f38b9a3914d44438fa2a7d0725e16bc"
I20251212 09:11:08.365702 31629 raft_consensus.cc:3060] T 8cf3abfd831644198121f41caaa513b8 P b0928c0205754195b08b99d89f289dda [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:08.365705 31498 raft_consensus.cc:3060] T 8cf3abfd831644198121f41caaa513b8 P 1f38b9a3914d44438fa2a7d0725e16bc [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:08.366285 31629 raft_consensus.cc:2468] T 8cf3abfd831644198121f41caaa513b8 P b0928c0205754195b08b99d89f289dda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf312bffd2e8423aa318571636978cbd in term 1.
I20251212 09:11:08.366309 31498 raft_consensus.cc:2468] T 8cf3abfd831644198121f41caaa513b8 P 1f38b9a3914d44438fa2a7d0725e16bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf312bffd2e8423aa318571636978cbd in term 1.
I20251212 09:11:08.366458 31302 leader_election.cc:304] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0928c0205754195b08b99d89f289dda, bf312bffd2e8423aa318571636978cbd; no voters:
I20251212 09:11:08.366554 31696 raft_consensus.cc:2804] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:08.366709 31696 raft_consensus.cc:697] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [term 1 LEADER]: Becoming Leader. State: Replica: bf312bffd2e8423aa318571636978cbd, State: Running, Role: LEADER
I20251212 09:11:08.366809 31696 consensus_queue.cc:237] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } }
I20251212 09:11:08.367530 31225 catalog_manager.cc:5654] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd reported cstate change: term changed from 0 to 1, leader changed from <none> to bf312bffd2e8423aa318571636978cbd (127.29.26.129). New cstate: current_term: 1 leader_uuid: "bf312bffd2e8423aa318571636978cbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } health_report { overall_health: UNKNOWN } } }
I20251212 09:11:08.378818 29802 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251212 09:11:08.379307 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver bf312bffd2e8423aa318571636978cbd to finish bootstrapping
I20251212 09:11:08.382555 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 1f38b9a3914d44438fa2a7d0725e16bc to finish bootstrapping
I20251212 09:11:08.385776 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver b0928c0205754195b08b99d89f289dda to finish bootstrapping
I20251212 09:11:08.389391 31225 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44844:
name: "TestAnotherTable"
schema {
columns {
name: "foo"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "bar"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
comment: "comment for bar"
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "foo"
}
}
}
W20251212 09:11:08.389554 31225 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestAnotherTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251212 09:11:08.390883 31478 tablet_service.cc:1505] Processing CreateTablet for tablet d7f710bb04eb4444a3b08417236fae2b (DEFAULT_TABLE table=TestAnotherTable [id=dbc3cae7b2d74eb68127db724e607f12]), partition=RANGE (foo) PARTITION UNBOUNDED
I20251212 09:11:08.390908 31609 tablet_service.cc:1505] Processing CreateTablet for tablet d7f710bb04eb4444a3b08417236fae2b (DEFAULT_TABLE table=TestAnotherTable [id=dbc3cae7b2d74eb68127db724e607f12]), partition=RANGE (foo) PARTITION UNBOUNDED
I20251212 09:11:08.390902 31347 tablet_service.cc:1505] Processing CreateTablet for tablet d7f710bb04eb4444a3b08417236fae2b (DEFAULT_TABLE table=TestAnotherTable [id=dbc3cae7b2d74eb68127db724e607f12]), partition=RANGE (foo) PARTITION UNBOUNDED
I20251212 09:11:08.391006 31478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f710bb04eb4444a3b08417236fae2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:08.391031 31609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f710bb04eb4444a3b08417236fae2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:08.391034 31347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f710bb04eb4444a3b08417236fae2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:08.391860 31691 tablet_bootstrap.cc:492] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc: Bootstrap starting.
I20251212 09:11:08.392263 31690 tablet_bootstrap.cc:492] T d7f710bb04eb4444a3b08417236fae2b P b0928c0205754195b08b99d89f289dda: Bootstrap starting.
I20251212 09:11:08.392314 31691 tablet_bootstrap.cc:654] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:08.392755 31690 tablet_bootstrap.cc:654] T d7f710bb04eb4444a3b08417236fae2b P b0928c0205754195b08b99d89f289dda: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:08.392937 31689 tablet_bootstrap.cc:492] T d7f710bb04eb4444a3b08417236fae2b P bf312bffd2e8423aa318571636978cbd: Bootstrap starting.
I20251212 09:11:08.393093 31691 tablet_bootstrap.cc:492] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc: No bootstrap required, opened a new log
I20251212 09:11:08.393154 31691 ts_tablet_manager.cc:1403] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20251212 09:11:08.393327 31690 tablet_bootstrap.cc:492] T d7f710bb04eb4444a3b08417236fae2b P b0928c0205754195b08b99d89f289dda: No bootstrap required, opened a new log
I20251212 09:11:08.393379 31690 ts_tablet_manager.cc:1403] T d7f710bb04eb4444a3b08417236fae2b P b0928c0205754195b08b99d89f289dda: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20251212 09:11:08.393339 31691 raft_consensus.cc:359] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } }
I20251212 09:11:08.393410 31691 raft_consensus.cc:385] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:08.393455 31691 raft_consensus.cc:740] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f38b9a3914d44438fa2a7d0725e16bc, State: Initialized, Role: FOLLOWER
I20251212 09:11:08.393456 31689 tablet_bootstrap.cc:654] T d7f710bb04eb4444a3b08417236fae2b P bf312bffd2e8423aa318571636978cbd: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:08.393503 31691 consensus_queue.cc:260] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } }
I20251212 09:11:08.393549 31690 raft_consensus.cc:359] T d7f710bb04eb4444a3b08417236fae2b P b0928c0205754195b08b99d89f289dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } }
I20251212 09:11:08.393605 31691 ts_tablet_manager.cc:1434] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20251212 09:11:08.393622 31690 raft_consensus.cc:385] T d7f710bb04eb4444a3b08417236fae2b P b0928c0205754195b08b99d89f289dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:08.393651 31690 raft_consensus.cc:740] T d7f710bb04eb4444a3b08417236fae2b P b0928c0205754195b08b99d89f289dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0928c0205754195b08b99d89f289dda, State: Initialized, Role: FOLLOWER
I20251212 09:11:08.393719 31690 consensus_queue.cc:260] T d7f710bb04eb4444a3b08417236fae2b P b0928c0205754195b08b99d89f289dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } }
I20251212 09:11:08.393810 31690 ts_tablet_manager.cc:1434] T d7f710bb04eb4444a3b08417236fae2b P b0928c0205754195b08b99d89f289dda: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:08.394270 31689 tablet_bootstrap.cc:492] T d7f710bb04eb4444a3b08417236fae2b P bf312bffd2e8423aa318571636978cbd: No bootstrap required, opened a new log
I20251212 09:11:08.394323 31689 ts_tablet_manager.cc:1403] T d7f710bb04eb4444a3b08417236fae2b P bf312bffd2e8423aa318571636978cbd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:08.394505 31689 raft_consensus.cc:359] T d7f710bb04eb4444a3b08417236fae2b P bf312bffd2e8423aa318571636978cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } }
I20251212 09:11:08.394593 31689 raft_consensus.cc:385] T d7f710bb04eb4444a3b08417236fae2b P bf312bffd2e8423aa318571636978cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:08.394620 31689 raft_consensus.cc:740] T d7f710bb04eb4444a3b08417236fae2b P bf312bffd2e8423aa318571636978cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf312bffd2e8423aa318571636978cbd, State: Initialized, Role: FOLLOWER
I20251212 09:11:08.394688 31689 consensus_queue.cc:260] T d7f710bb04eb4444a3b08417236fae2b P bf312bffd2e8423aa318571636978cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } }
I20251212 09:11:08.394771 31689 ts_tablet_manager.cc:1434] T d7f710bb04eb4444a3b08417236fae2b P bf312bffd2e8423aa318571636978cbd: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
W20251212 09:11:08.422904 31676 tablet.cc:2378] T 8cf3abfd831644198121f41caaa513b8 P b0928c0205754195b08b99d89f289dda: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251212 09:11:08.429607 31414 tablet.cc:2378] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251212 09:11:08.458076 31697 raft_consensus.cc:493] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251212 09:11:08.458194 31697 raft_consensus.cc:515] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } }
I20251212 09:11:08.458549 31697 leader_election.cc:290] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf312bffd2e8423aa318571636978cbd (127.29.26.129:40173), b0928c0205754195b08b99d89f289dda (127.29.26.131:36611)
I20251212 09:11:08.461365 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f710bb04eb4444a3b08417236fae2b" candidate_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf312bffd2e8423aa318571636978cbd" is_pre_election: true
I20251212 09:11:08.461457 31629 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f710bb04eb4444a3b08417236fae2b" candidate_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0928c0205754195b08b99d89f289dda" is_pre_election: true
I20251212 09:11:08.461500 31367 raft_consensus.cc:2468] T d7f710bb04eb4444a3b08417236fae2b P bf312bffd2e8423aa318571636978cbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f38b9a3914d44438fa2a7d0725e16bc in term 0.
I20251212 09:11:08.461537 31629 raft_consensus.cc:2468] T d7f710bb04eb4444a3b08417236fae2b P b0928c0205754195b08b99d89f289dda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f38b9a3914d44438fa2a7d0725e16bc in term 0.
I20251212 09:11:08.461691 31434 leader_election.cc:304] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f38b9a3914d44438fa2a7d0725e16bc, bf312bffd2e8423aa318571636978cbd; no voters:
I20251212 09:11:08.461853 31697 raft_consensus.cc:2804] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251212 09:11:08.461894 31697 raft_consensus.cc:493] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251212 09:11:08.461913 31697 raft_consensus.cc:3060] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:08.462468 31697 raft_consensus.cc:515] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } }
I20251212 09:11:08.462594 31697 leader_election.cc:290] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [CANDIDATE]: Term 1 election: Requested vote from peers bf312bffd2e8423aa318571636978cbd (127.29.26.129:40173), b0928c0205754195b08b99d89f289dda (127.29.26.131:36611)
I20251212 09:11:08.462778 31629 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f710bb04eb4444a3b08417236fae2b" candidate_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0928c0205754195b08b99d89f289dda"
I20251212 09:11:08.462839 31629 raft_consensus.cc:3060] T d7f710bb04eb4444a3b08417236fae2b P b0928c0205754195b08b99d89f289dda [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:08.463364 31629 raft_consensus.cc:2468] T d7f710bb04eb4444a3b08417236fae2b P b0928c0205754195b08b99d89f289dda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f38b9a3914d44438fa2a7d0725e16bc in term 1.
I20251212 09:11:08.463464 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f710bb04eb4444a3b08417236fae2b" candidate_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf312bffd2e8423aa318571636978cbd"
I20251212 09:11:08.463538 31367 raft_consensus.cc:3060] T d7f710bb04eb4444a3b08417236fae2b P bf312bffd2e8423aa318571636978cbd [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:08.463546 31433 leader_election.cc:304] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f38b9a3914d44438fa2a7d0725e16bc, b0928c0205754195b08b99d89f289dda; no voters:
I20251212 09:11:08.463654 31697 raft_consensus.cc:2804] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:08.463795 31697 raft_consensus.cc:697] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [term 1 LEADER]: Becoming Leader. State: Replica: 1f38b9a3914d44438fa2a7d0725e16bc, State: Running, Role: LEADER
I20251212 09:11:08.463897 31697 consensus_queue.cc:237] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } }
I20251212 09:11:08.464279 31367 raft_consensus.cc:2468] T d7f710bb04eb4444a3b08417236fae2b P bf312bffd2e8423aa318571636978cbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f38b9a3914d44438fa2a7d0725e16bc in term 1.
I20251212 09:11:08.464597 31224 catalog_manager.cc:5654] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f38b9a3914d44438fa2a7d0725e16bc (127.29.26.130). New cstate: current_term: 1 leader_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 } health_report { overall_health: UNKNOWN } } }
W20251212 09:11:08.544945 31708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:08.545130 31708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:08.546545 31708 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
W20251212 09:11:08.692984 31718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:08.693156 31718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:08.694582 31718 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
W20251212 09:11:08.781368 31256 messenger.cc:191] Invalid argument: socket address is ambiguous: no data on pending connections for acceptor pool at 127.29.26.190:40173
I20251212 09:11:08.831702 31696 consensus_queue.cc:1048] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251212 09:11:08.833732 31696 consensus_queue.cc:1048] T 8cf3abfd831644198121f41caaa513b8 P bf312bffd2e8423aa318571636978cbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f38b9a3914d44438fa2a7d0725e16bc" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251212 09:11:08.840349 31728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:08.840533 31728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:08.842031 31728 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
W20251212 09:11:08.846561 31260 acceptor_pool.cc:311] unable to collect diagnostics on RPC socket 127.29.26.190:40173: Invalid argument: socket address is ambiguous
I20251212 09:11:08.913023 31697 consensus_queue.cc:1048] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf312bffd2e8423aa318571636978cbd" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251212 09:11:08.914856 31697 consensus_queue.cc:1048] T d7f710bb04eb4444a3b08417236fae2b P 1f38b9a3914d44438fa2a7d0725e16bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0928c0205754195b08b99d89f289dda" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 36611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251212 09:11:08.929876 31408 messenger.cc:191] Invalid argument: socket address is ambiguous: no data on pending connections for acceptor pool at 127.29.26.129:40173
W20251212 09:11:08.988435 31743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:08.988611 31743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:08.990127 31743 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20251212 09:11:09.057042 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 31285
I20251212 09:11:09.062214 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 31416
I20251212 09:11:09.067386 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 31547
I20251212 09:11:09.071621 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 31194
2025-12-12T09:11:09Z chronyd exiting
[ OK ] AdminCliTest.TestDescribeTableColumnFlags (1434 ms)
[ RUN ] AdminCliTest.TestAuthzResetCacheNotAuthorized
I20251212 09:11:09.091841 29802 test_util.cc:276] Using random seed: -1537274884
I20251212 09:11:09.092402 29802 ts_itest-base.cc:115] Starting cluster with:
I20251212 09:11:09.092445 29802 ts_itest-base.cc:116] --------------
I20251212 09:11:09.092464 29802 ts_itest-base.cc:117] 3 tablet servers
I20251212 09:11:09.092480 29802 ts_itest-base.cc:118] 3 replicas per TS
I20251212 09:11:09.092496 29802 ts_itest-base.cc:119] --------------
2025-12-12T09:11:09Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-12T09:11:09Z Disabled control of system clock
I20251212 09:11:09.099543 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:40397
--webserver_interface=127.29.26.190
--webserver_port=0
--builtin_ntp_servers=127.29.26.148:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.26.190:40397
--superuser_acl=no-such-user with env {}
W20251212 09:11:09.176107 31762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:09.176275 31762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:09.176324 31762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:09.177802 31762 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251212 09:11:09.177848 31762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:09.177873 31762 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251212 09:11:09.177892 31762 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251212 09:11:09.179406 31762 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.26.190:40397
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:40397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.29.26.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.31762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:09.179631 31762 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:09.179843 31762 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:09.182229 31768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:09.182509 31770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:09.182600 31767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:09.182703 31762 server_base.cc:1047] running on GCE node
I20251212 09:11:09.182936 31762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:09.183159 31762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:09.184286 31762 hybrid_clock.cc:648] HybridClock initialized: now 1765530669184275 us; error 24 us; skew 500 ppm
I20251212 09:11:09.185478 31762 webserver.cc:492] Webserver started at http://127.29.26.190:34509/ using document root <none> and password file <none>
I20251212 09:11:09.185667 31762 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:09.185711 31762 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:09.185822 31762 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:09.186664 31762 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "5de6c229c5e24dd0b51b6815c2621a0a"
format_stamp: "Formatted at 2025-12-12 09:11:09 on dist-test-slave-qqr7"
I20251212 09:11:09.186966 31762 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "5de6c229c5e24dd0b51b6815c2621a0a"
format_stamp: "Formatted at 2025-12-12 09:11:09 on dist-test-slave-qqr7"
I20251212 09:11:09.188141 31762 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251212 09:11:09.188879 31776 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:09.189096 31762 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251212 09:11:09.189177 31762 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
uuid: "5de6c229c5e24dd0b51b6815c2621a0a"
format_stamp: "Formatted at 2025-12-12 09:11:09 on dist-test-slave-qqr7"
I20251212 09:11:09.189241 31762 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:09.210155 31762 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:09.210434 31762 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:09.210553 31762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:09.214432 31762 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.190:40397
I20251212 09:11:09.214488 31828 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.190:40397 every 8 connection(s)
I20251212 09:11:09.214787 31762 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251212 09:11:09.215438 31829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:09.217770 31829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a: Bootstrap starting.
I20251212 09:11:09.218343 31829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:09.218565 31829 log.cc:826] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:09.219152 31829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a: No bootstrap required, opened a new log
I20251212 09:11:09.220304 31829 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de6c229c5e24dd0b51b6815c2621a0a" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 40397 } }
I20251212 09:11:09.220420 31829 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:09.220439 31829 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5de6c229c5e24dd0b51b6815c2621a0a, State: Initialized, Role: FOLLOWER
I20251212 09:11:09.220523 31829 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de6c229c5e24dd0b51b6815c2621a0a" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 40397 } }
I20251212 09:11:09.220568 31829 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:09.220588 31829 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:09.220624 31829 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:09.221139 31829 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de6c229c5e24dd0b51b6815c2621a0a" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 40397 } }
I20251212 09:11:09.221230 31829 leader_election.cc:304] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5de6c229c5e24dd0b51b6815c2621a0a; no voters:
I20251212 09:11:09.221338 31829 leader_election.cc:290] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [CANDIDATE]: Term 1 election: Requested vote from peers
I20251212 09:11:09.221439 31832 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:09.221560 31829 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [sys.catalog]: configured and running, proceeding with master startup.
I20251212 09:11:09.221582 31832 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [term 1 LEADER]: Becoming Leader. State: Replica: 5de6c229c5e24dd0b51b6815c2621a0a, State: Running, Role: LEADER
I20251212 09:11:09.221715 31832 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de6c229c5e24dd0b51b6815c2621a0a" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 40397 } }
I20251212 09:11:09.222031 31833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5de6c229c5e24dd0b51b6815c2621a0a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de6c229c5e24dd0b51b6815c2621a0a" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 40397 } } }
I20251212 09:11:09.222062 31834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5de6c229c5e24dd0b51b6815c2621a0a. Latest consensus state: current_term: 1 leader_uuid: "5de6c229c5e24dd0b51b6815c2621a0a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de6c229c5e24dd0b51b6815c2621a0a" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 40397 } } }
I20251212 09:11:09.222211 31833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:09.222237 31834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:09.222594 31842 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251212 09:11:09.223050 31842 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251212 09:11:09.223340 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 31762
I20251212 09:11:09.223428 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251212 09:11:09.225041 31842 catalog_manager.cc:1357] Generated new cluster ID: 04fd550ab92e49f0abc24cfb9f16881e
I20251212 09:11:09.225096 31842 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251212 09:11:09.241063 31842 catalog_manager.cc:1380] Generated new certificate authority record
I20251212 09:11:09.241914 31842 catalog_manager.cc:1514] Loading token signing keys...
I20251212 09:11:09.248263 31842 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 5de6c229c5e24dd0b51b6815c2621a0a: Generated new TSK 0
I20251212 09:11:09.248459 31842 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251212 09:11:09.257068 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.129:0
--local_ip_for_outbound_sockets=127.29.26.129
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:40397
--builtin_ntp_servers=127.29.26.148:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251212 09:11:09.358305 31853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:09.358477 31853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:09.358510 31853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:09.359956 31853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:09.360024 31853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.129
I20251212 09:11:09.361564 31853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:40397
--never_fsync=true
--heap_profile_path=/tmp/kudu.31853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.129
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:09.361800 31853 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:09.362030 31853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:09.364614 31858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:09.364727 31853 server_base.cc:1047] running on GCE node
W20251212 09:11:09.364615 31861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:09.364830 31859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:09.365008 31853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:09.365204 31853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:09.366343 31853 hybrid_clock.cc:648] HybridClock initialized: now 1765530669366331 us; error 29 us; skew 500 ppm
I20251212 09:11:09.367439 31853 webserver.cc:492] Webserver started at http://127.29.26.129:33873/ using document root <none> and password file <none>
I20251212 09:11:09.367627 31853 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:09.367671 31853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:09.367782 31853 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:09.368607 31853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "9d450679c99849d8940d800937b053de"
format_stamp: "Formatted at 2025-12-12 09:11:09 on dist-test-slave-qqr7"
I20251212 09:11:09.368944 31853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "9d450679c99849d8940d800937b053de"
format_stamp: "Formatted at 2025-12-12 09:11:09 on dist-test-slave-qqr7"
I20251212 09:11:09.370072 31853 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:09.370786 31867 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:09.371001 31853 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:09.371083 31853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "9d450679c99849d8940d800937b053de"
format_stamp: "Formatted at 2025-12-12 09:11:09 on dist-test-slave-qqr7"
I20251212 09:11:09.371145 31853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:09.391192 31853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:09.391450 31853 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:09.391567 31853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:09.391755 31853 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:09.392132 31853 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:09.392171 31853 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:09.392206 31853 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:09.392232 31853 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:09.399010 31853 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.129:38305
I20251212 09:11:09.399065 31980 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.129:38305 every 8 connection(s)
I20251212 09:11:09.399353 31853 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251212 09:11:09.402092 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 31853
I20251212 09:11:09.402176 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251212 09:11:09.403389 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.130:0
--local_ip_for_outbound_sockets=127.29.26.130
--webserver_interface=127.29.26.130
--webserver_port=0
--tserver_master_addrs=127.29.26.190:40397
--builtin_ntp_servers=127.29.26.148:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251212 09:11:09.404021 31981 heartbeater.cc:344] Connected to a master server at 127.29.26.190:40397
I20251212 09:11:09.404098 31981 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:09.404258 31981 heartbeater.cc:507] Master 127.29.26.190:40397 requested a full tablet report, sending...
I20251212 09:11:09.404690 31793 ts_manager.cc:194] Registered new tserver with Master: 9d450679c99849d8940d800937b053de (127.29.26.129:38305)
I20251212 09:11:09.405589 31793 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.129:47685
W20251212 09:11:09.485736 31984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:09.485903 31984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:09.485927 31984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:09.487373 31984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:09.487424 31984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.130
I20251212 09:11:09.488881 31984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.29.26.130
--webserver_port=0
--tserver_master_addrs=127.29.26.190:40397
--never_fsync=true
--heap_profile_path=/tmp/kudu.31984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.130
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:09.489099 31984 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:09.489313 31984 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:09.491824 31990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:09.491860 31992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:09.492017 31984 server_base.cc:1047] running on GCE node
W20251212 09:11:09.491842 31989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:09.492223 31984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:09.492424 31984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:09.493551 31984 hybrid_clock.cc:648] HybridClock initialized: now 1765530669493535 us; error 32 us; skew 500 ppm
I20251212 09:11:09.494643 31984 webserver.cc:492] Webserver started at http://127.29.26.130:36245/ using document root <none> and password file <none>
I20251212 09:11:09.494851 31984 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:09.494891 31984 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:09.495018 31984 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:09.495815 31984 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "dc6a1350c4874404a0661f2d82c7a6e5"
format_stamp: "Formatted at 2025-12-12 09:11:09 on dist-test-slave-qqr7"
I20251212 09:11:09.496102 31984 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "dc6a1350c4874404a0661f2d82c7a6e5"
format_stamp: "Formatted at 2025-12-12 09:11:09 on dist-test-slave-qqr7"
I20251212 09:11:09.497298 31984 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251212 09:11:09.498047 31998 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:09.498278 31984 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20251212 09:11:09.498343 31984 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "dc6a1350c4874404a0661f2d82c7a6e5"
format_stamp: "Formatted at 2025-12-12 09:11:09 on dist-test-slave-qqr7"
I20251212 09:11:09.498391 31984 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:09.519095 31984 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:09.519320 31984 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:09.519403 31984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:09.519563 31984 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:09.519811 31984 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:09.519840 31984 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:09.519860 31984 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:09.519878 31984 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:09.525398 31984 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.130:37417
I20251212 09:11:09.525457 32111 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.130:37417 every 8 connection(s)
I20251212 09:11:09.525725 31984 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251212 09:11:09.528823 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 31984
I20251212 09:11:09.528918 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251212 09:11:09.529933 32112 heartbeater.cc:344] Connected to a master server at 127.29.26.190:40397
I20251212 09:11:09.530020 32112 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:09.530059 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.131:0
--local_ip_for_outbound_sockets=127.29.26.131
--webserver_interface=127.29.26.131
--webserver_port=0
--tserver_master_addrs=127.29.26.190:40397
--builtin_ntp_servers=127.29.26.148:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251212 09:11:09.530249 32112 heartbeater.cc:507] Master 127.29.26.190:40397 requested a full tablet report, sending...
I20251212 09:11:09.530601 31793 ts_manager.cc:194] Registered new tserver with Master: dc6a1350c4874404a0661f2d82c7a6e5 (127.29.26.130:37417)
I20251212 09:11:09.531111 31793 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.130:52563
W20251212 09:11:09.606530 32115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:09.606693 32115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:09.606711 32115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:09.607975 32115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:09.608019 32115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.131
I20251212 09:11:09.609431 32115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.29.26.131
--webserver_port=0
--tserver_master_addrs=127.29.26.190:40397
--never_fsync=true
--heap_profile_path=/tmp/kudu.32115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.131
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:09.609593 32115 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:09.609771 32115 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:09.612308 32120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:09.612335 32121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:09.612330 32123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:09.612382 32115 server_base.cc:1047] running on GCE node
I20251212 09:11:09.612692 32115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:09.612915 32115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:09.614055 32115 hybrid_clock.cc:648] HybridClock initialized: now 1765530669614042 us; error 27 us; skew 500 ppm
I20251212 09:11:09.615254 32115 webserver.cc:492] Webserver started at http://127.29.26.131:37259/ using document root <none> and password file <none>
I20251212 09:11:09.615439 32115 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:09.615481 32115 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:09.615603 32115 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:09.616462 32115 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "0a775257a82643d8a0be7765700e295d"
format_stamp: "Formatted at 2025-12-12 09:11:09 on dist-test-slave-qqr7"
I20251212 09:11:09.616786 32115 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "0a775257a82643d8a0be7765700e295d"
format_stamp: "Formatted at 2025-12-12 09:11:09 on dist-test-slave-qqr7"
I20251212 09:11:09.617871 32115 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251212 09:11:09.618546 32129 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:09.618698 32115 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:09.618767 32115 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "0a775257a82643d8a0be7765700e295d"
format_stamp: "Formatted at 2025-12-12 09:11:09 on dist-test-slave-qqr7"
I20251212 09:11:09.618824 32115 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:09.631722 32115 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:09.631970 32115 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:09.632081 32115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:09.632272 32115 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:09.632609 32115 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:09.632644 32115 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:09.632711 32115 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:09.632742 32115 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:09.638293 32115 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.131:40183
I20251212 09:11:09.638375 32242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.131:40183 every 8 connection(s)
I20251212 09:11:09.638622 32115 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251212 09:11:09.642840 32243 heartbeater.cc:344] Connected to a master server at 127.29.26.190:40397
I20251212 09:11:09.642925 32243 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:09.643121 32243 heartbeater.cc:507] Master 127.29.26.190:40397 requested a full tablet report, sending...
I20251212 09:11:09.643486 31793 ts_manager.cc:194] Registered new tserver with Master: 0a775257a82643d8a0be7765700e295d (127.29.26.131:40183)
I20251212 09:11:09.643821 31793 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.131:35119
I20251212 09:11:09.644542 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 32115
I20251212 09:11:09.644609 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestAuthzResetCacheNotAuthorized.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251212 09:11:09.645651 29802 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251212 09:11:09.651158 31793 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47388:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20251212 09:11:09.652369 31793 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251212 09:11:09.658753 31915 tablet_service.cc:1505] Processing CreateTablet for tablet 74a21d8d388f421986246cd7d7159fa8 (DEFAULT_TABLE table=TestTable [id=2dc3c3e2f8a2422daffcadaefa6d0b47]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:09.658965 32177 tablet_service.cc:1505] Processing CreateTablet for tablet 74a21d8d388f421986246cd7d7159fa8 (DEFAULT_TABLE table=TestTable [id=2dc3c3e2f8a2422daffcadaefa6d0b47]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:09.658942 32046 tablet_service.cc:1505] Processing CreateTablet for tablet 74a21d8d388f421986246cd7d7159fa8 (DEFAULT_TABLE table=TestTable [id=2dc3c3e2f8a2422daffcadaefa6d0b47]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:09.659075 31915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a21d8d388f421986246cd7d7159fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:09.659241 32046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a21d8d388f421986246cd7d7159fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:09.659257 32177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a21d8d388f421986246cd7d7159fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:09.661321 32257 tablet_bootstrap.cc:492] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de: Bootstrap starting.
I20251212 09:11:09.661777 32258 tablet_bootstrap.cc:492] T 74a21d8d388f421986246cd7d7159fa8 P dc6a1350c4874404a0661f2d82c7a6e5: Bootstrap starting.
I20251212 09:11:09.661962 32257 tablet_bootstrap.cc:654] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:09.662304 32257 log.cc:826] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:09.662423 32258 tablet_bootstrap.cc:654] T 74a21d8d388f421986246cd7d7159fa8 P dc6a1350c4874404a0661f2d82c7a6e5: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:09.662695 32258 log.cc:826] T 74a21d8d388f421986246cd7d7159fa8 P dc6a1350c4874404a0661f2d82c7a6e5: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:09.662976 32257 tablet_bootstrap.cc:492] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de: No bootstrap required, opened a new log
I20251212 09:11:09.663012 32259 tablet_bootstrap.cc:492] T 74a21d8d388f421986246cd7d7159fa8 P 0a775257a82643d8a0be7765700e295d: Bootstrap starting.
I20251212 09:11:09.663045 32257 ts_tablet_manager.cc:1403] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251212 09:11:09.663290 32258 tablet_bootstrap.cc:492] T 74a21d8d388f421986246cd7d7159fa8 P dc6a1350c4874404a0661f2d82c7a6e5: No bootstrap required, opened a new log
I20251212 09:11:09.663340 32258 ts_tablet_manager.cc:1403] T 74a21d8d388f421986246cd7d7159fa8 P dc6a1350c4874404a0661f2d82c7a6e5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251212 09:11:09.663578 32259 tablet_bootstrap.cc:654] T 74a21d8d388f421986246cd7d7159fa8 P 0a775257a82643d8a0be7765700e295d: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:09.663830 32259 log.cc:826] T 74a21d8d388f421986246cd7d7159fa8 P 0a775257a82643d8a0be7765700e295d: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:09.664484 32259 tablet_bootstrap.cc:492] T 74a21d8d388f421986246cd7d7159fa8 P 0a775257a82643d8a0be7765700e295d: No bootstrap required, opened a new log
I20251212 09:11:09.664561 32259 ts_tablet_manager.cc:1403] T 74a21d8d388f421986246cd7d7159fa8 P 0a775257a82643d8a0be7765700e295d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251212 09:11:09.664527 32258 raft_consensus.cc:359] T 74a21d8d388f421986246cd7d7159fa8 P dc6a1350c4874404a0661f2d82c7a6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6a1350c4874404a0661f2d82c7a6e5" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 37417 } } peers { permanent_uuid: "9d450679c99849d8940d800937b053de" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 38305 } } peers { permanent_uuid: "0a775257a82643d8a0be7765700e295d" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 40183 } }
I20251212 09:11:09.664717 32258 raft_consensus.cc:385] T 74a21d8d388f421986246cd7d7159fa8 P dc6a1350c4874404a0661f2d82c7a6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:09.664762 32258 raft_consensus.cc:740] T 74a21d8d388f421986246cd7d7159fa8 P dc6a1350c4874404a0661f2d82c7a6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc6a1350c4874404a0661f2d82c7a6e5, State: Initialized, Role: FOLLOWER
I20251212 09:11:09.664806 32257 raft_consensus.cc:359] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6a1350c4874404a0661f2d82c7a6e5" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 37417 } } peers { permanent_uuid: "9d450679c99849d8940d800937b053de" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 38305 } } peers { permanent_uuid: "0a775257a82643d8a0be7765700e295d" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 40183 } }
I20251212 09:11:09.664928 32258 consensus_queue.cc:260] T 74a21d8d388f421986246cd7d7159fa8 P dc6a1350c4874404a0661f2d82c7a6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6a1350c4874404a0661f2d82c7a6e5" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 37417 } } peers { permanent_uuid: "9d450679c99849d8940d800937b053de" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 38305 } } peers { permanent_uuid: "0a775257a82643d8a0be7765700e295d" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 40183 } }
I20251212 09:11:09.664984 32257 raft_consensus.cc:385] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:09.665079 32257 raft_consensus.cc:740] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d450679c99849d8940d800937b053de, State: Initialized, Role: FOLLOWER
I20251212 09:11:09.665180 32258 ts_tablet_manager.cc:1434] T 74a21d8d388f421986246cd7d7159fa8 P dc6a1350c4874404a0661f2d82c7a6e5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:09.665297 32112 heartbeater.cc:499] Master 127.29.26.190:40397 was elected leader, sending a full tablet report...
I20251212 09:11:09.665177 32257 consensus_queue.cc:260] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6a1350c4874404a0661f2d82c7a6e5" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 37417 } } peers { permanent_uuid: "9d450679c99849d8940d800937b053de" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 38305 } } peers { permanent_uuid: "0a775257a82643d8a0be7765700e295d" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 40183 } }
I20251212 09:11:09.665681 32257 ts_tablet_manager.cc:1434] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251212 09:11:09.665787 31981 heartbeater.cc:499] Master 127.29.26.190:40397 was elected leader, sending a full tablet report...
I20251212 09:11:09.666276 32259 raft_consensus.cc:359] T 74a21d8d388f421986246cd7d7159fa8 P 0a775257a82643d8a0be7765700e295d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6a1350c4874404a0661f2d82c7a6e5" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 37417 } } peers { permanent_uuid: "9d450679c99849d8940d800937b053de" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 38305 } } peers { permanent_uuid: "0a775257a82643d8a0be7765700e295d" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 40183 } }
I20251212 09:11:09.666391 32259 raft_consensus.cc:385] T 74a21d8d388f421986246cd7d7159fa8 P 0a775257a82643d8a0be7765700e295d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:09.666424 32259 raft_consensus.cc:740] T 74a21d8d388f421986246cd7d7159fa8 P 0a775257a82643d8a0be7765700e295d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a775257a82643d8a0be7765700e295d, State: Initialized, Role: FOLLOWER
I20251212 09:11:09.666508 32259 consensus_queue.cc:260] T 74a21d8d388f421986246cd7d7159fa8 P 0a775257a82643d8a0be7765700e295d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6a1350c4874404a0661f2d82c7a6e5" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 37417 } } peers { permanent_uuid: "9d450679c99849d8940d800937b053de" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 38305 } } peers { permanent_uuid: "0a775257a82643d8a0be7765700e295d" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 40183 } }
I20251212 09:11:09.666728 32259 ts_tablet_manager.cc:1434] T 74a21d8d388f421986246cd7d7159fa8 P 0a775257a82643d8a0be7765700e295d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251212 09:11:09.666792 32243 heartbeater.cc:499] Master 127.29.26.190:40397 was elected leader, sending a full tablet report...
I20251212 09:11:09.751072 32264 raft_consensus.cc:493] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251212 09:11:09.751204 32264 raft_consensus.cc:515] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6a1350c4874404a0661f2d82c7a6e5" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 37417 } } peers { permanent_uuid: "9d450679c99849d8940d800937b053de" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 38305 } } peers { permanent_uuid: "0a775257a82643d8a0be7765700e295d" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 40183 } }
I20251212 09:11:09.751508 32264 leader_election.cc:290] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc6a1350c4874404a0661f2d82c7a6e5 (127.29.26.130:37417), 0a775257a82643d8a0be7765700e295d (127.29.26.131:40183)
I20251212 09:11:09.754217 32066 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74a21d8d388f421986246cd7d7159fa8" candidate_uuid: "9d450679c99849d8940d800937b053de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc6a1350c4874404a0661f2d82c7a6e5" is_pre_election: true
I20251212 09:11:09.754384 32066 raft_consensus.cc:2468] T 74a21d8d388f421986246cd7d7159fa8 P dc6a1350c4874404a0661f2d82c7a6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d450679c99849d8940d800937b053de in term 0.
I20251212 09:11:09.754408 32197 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74a21d8d388f421986246cd7d7159fa8" candidate_uuid: "9d450679c99849d8940d800937b053de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a775257a82643d8a0be7765700e295d" is_pre_election: true
I20251212 09:11:09.754525 32197 raft_consensus.cc:2468] T 74a21d8d388f421986246cd7d7159fa8 P 0a775257a82643d8a0be7765700e295d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d450679c99849d8940d800937b053de in term 0.
I20251212 09:11:09.754586 31871 leader_election.cc:304] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d450679c99849d8940d800937b053de, dc6a1350c4874404a0661f2d82c7a6e5; no voters:
I20251212 09:11:09.754717 32264 raft_consensus.cc:2804] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251212 09:11:09.754772 32264 raft_consensus.cc:493] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251212 09:11:09.754796 32264 raft_consensus.cc:3060] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:09.755366 32264 raft_consensus.cc:515] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6a1350c4874404a0661f2d82c7a6e5" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 37417 } } peers { permanent_uuid: "9d450679c99849d8940d800937b053de" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 38305 } } peers { permanent_uuid: "0a775257a82643d8a0be7765700e295d" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 40183 } }
I20251212 09:11:09.755472 32264 leader_election.cc:290] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [CANDIDATE]: Term 1 election: Requested vote from peers dc6a1350c4874404a0661f2d82c7a6e5 (127.29.26.130:37417), 0a775257a82643d8a0be7765700e295d (127.29.26.131:40183)
I20251212 09:11:09.755641 32197 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74a21d8d388f421986246cd7d7159fa8" candidate_uuid: "9d450679c99849d8940d800937b053de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a775257a82643d8a0be7765700e295d"
I20251212 09:11:09.755681 32066 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74a21d8d388f421986246cd7d7159fa8" candidate_uuid: "9d450679c99849d8940d800937b053de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc6a1350c4874404a0661f2d82c7a6e5"
I20251212 09:11:09.755720 32197 raft_consensus.cc:3060] T 74a21d8d388f421986246cd7d7159fa8 P 0a775257a82643d8a0be7765700e295d [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:09.755735 32066 raft_consensus.cc:3060] T 74a21d8d388f421986246cd7d7159fa8 P dc6a1350c4874404a0661f2d82c7a6e5 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:09.756457 32066 raft_consensus.cc:2468] T 74a21d8d388f421986246cd7d7159fa8 P dc6a1350c4874404a0661f2d82c7a6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d450679c99849d8940d800937b053de in term 1.
I20251212 09:11:09.756457 32197 raft_consensus.cc:2468] T 74a21d8d388f421986246cd7d7159fa8 P 0a775257a82643d8a0be7765700e295d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d450679c99849d8940d800937b053de in term 1.
I20251212 09:11:09.756641 31871 leader_election.cc:304] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d450679c99849d8940d800937b053de, dc6a1350c4874404a0661f2d82c7a6e5; no voters:
I20251212 09:11:09.756776 32264 raft_consensus.cc:2804] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:09.756925 32264 raft_consensus.cc:697] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [term 1 LEADER]: Becoming Leader. State: Replica: 9d450679c99849d8940d800937b053de, State: Running, Role: LEADER
I20251212 09:11:09.757038 32264 consensus_queue.cc:237] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6a1350c4874404a0661f2d82c7a6e5" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 37417 } } peers { permanent_uuid: "9d450679c99849d8940d800937b053de" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 38305 } } peers { permanent_uuid: "0a775257a82643d8a0be7765700e295d" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 40183 } }
I20251212 09:11:09.757804 31792 catalog_manager.cc:5654] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d450679c99849d8940d800937b053de (127.29.26.129). New cstate: current_term: 1 leader_uuid: "9d450679c99849d8940d800937b053de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc6a1350c4874404a0661f2d82c7a6e5" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 37417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d450679c99849d8940d800937b053de" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 38305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a775257a82643d8a0be7765700e295d" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 40183 } health_report { overall_health: UNKNOWN } } }
I20251212 09:11:09.773490 29802 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251212 09:11:09.773952 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 9d450679c99849d8940d800937b053de to finish bootstrapping
W20251212 09:11:09.776222 32113 tablet.cc:2378] T 74a21d8d388f421986246cd7d7159fa8 P dc6a1350c4874404a0661f2d82c7a6e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251212 09:11:09.777283 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver dc6a1350c4874404a0661f2d82c7a6e5 to finish bootstrapping
I20251212 09:11:09.780257 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 0a775257a82643d8a0be7765700e295d to finish bootstrapping
W20251212 09:11:09.873308 31792 server_base.cc:1129] Unauthorized access attempt to method kudu.master.MasterService.RefreshAuthzCache from {username='slave'} at 127.0.0.1:47408
W20251212 09:11:09.889122 32244 tablet.cc:2378] T 74a21d8d388f421986246cd7d7159fa8 P 0a775257a82643d8a0be7765700e295d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251212 09:11:09.900039 31982 tablet.cc:2378] T 74a21d8d388f421986246cd7d7159fa8 P 9d450679c99849d8940d800937b053de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251212 09:11:09.928826 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 31853
I20251212 09:11:09.933691 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 31984
I20251212 09:11:09.937917 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 32115
I20251212 09:11:09.941973 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 31762
2025-12-12T09:11:09Z chronyd exiting
[ OK ] AdminCliTest.TestAuthzResetCacheNotAuthorized (870 ms)
[ RUN ] AdminCliTest.TestRebuildTables
I20251212 09:11:09.962092 29802 test_util.cc:276] Using random seed: -1536404633
I20251212 09:11:09.962639 29802 ts_itest-base.cc:115] Starting cluster with:
I20251212 09:11:09.962673 29802 ts_itest-base.cc:116] --------------
I20251212 09:11:09.962684 29802 ts_itest-base.cc:117] 3 tablet servers
I20251212 09:11:09.962695 29802 ts_itest-base.cc:118] 3 replicas per TS
I20251212 09:11:09.962718 29802 ts_itest-base.cc:119] --------------
2025-12-12T09:11:09Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-12T09:11:09Z Disabled control of system clock
I20251212 09:11:09.969437 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:44373
--webserver_interface=127.29.26.190
--webserver_port=0
--builtin_ntp_servers=127.29.26.148:41675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.26.190:44373 with env {}
W20251212 09:11:10.045758 32292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:10.045938 32292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:10.045967 32292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:10.047338 32292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251212 09:11:10.047380 32292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:10.047403 32292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251212 09:11:10.047422 32292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251212 09:11:10.048916 32292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:41675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.26.190:44373
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:44373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.29.26.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.32292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:10.049149 32292 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:10.049374 32292 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:10.051704 32298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:10.051710 32297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:10.051723 32300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:10.051810 32292 server_base.cc:1047] running on GCE node
I20251212 09:11:10.052143 32292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:10.052341 32292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:10.053464 32292 hybrid_clock.cc:648] HybridClock initialized: now 1765530670053452 us; error 29 us; skew 500 ppm
I20251212 09:11:10.054715 32292 webserver.cc:492] Webserver started at http://127.29.26.190:34253/ using document root <none> and password file <none>
I20251212 09:11:10.054914 32292 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:10.054967 32292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:10.055083 32292 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:10.055905 32292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "e4af916219b24e4e8c6836b7b59574fa"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:10.056191 32292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "e4af916219b24e4e8c6836b7b59574fa"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:10.057418 32292 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251212 09:11:10.058105 32306 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:10.058257 32292 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:10.058323 32292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
uuid: "e4af916219b24e4e8c6836b7b59574fa"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:10.058386 32292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:10.083433 32292 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:10.083729 32292 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:10.083849 32292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:10.087755 32292 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.190:44373
I20251212 09:11:10.087795 32358 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.190:44373 every 8 connection(s)
I20251212 09:11:10.088114 32292 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251212 09:11:10.088735 32359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:10.091090 32359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa: Bootstrap starting.
I20251212 09:11:10.091619 32359 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:10.091830 32359 log.cc:826] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:10.092397 32359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa: No bootstrap required, opened a new log
I20251212 09:11:10.093182 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 32292
I20251212 09:11:10.093274 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251212 09:11:10.093786 32359 raft_consensus.cc:359] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } }
I20251212 09:11:10.093938 32359 raft_consensus.cc:385] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:10.093974 32359 raft_consensus.cc:740] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4af916219b24e4e8c6836b7b59574fa, State: Initialized, Role: FOLLOWER
I20251212 09:11:10.094115 32359 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } }
I20251212 09:11:10.094208 32359 raft_consensus.cc:399] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:10.094235 32359 raft_consensus.cc:493] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:10.094280 32359 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:10.094872 32359 raft_consensus.cc:515] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } }
I20251212 09:11:10.094993 32359 leader_election.cc:304] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4af916219b24e4e8c6836b7b59574fa; no voters:
I20251212 09:11:10.095124 32359 leader_election.cc:290] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20251212 09:11:10.095178 32364 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:10.095329 32359 sys_catalog.cc:565] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [sys.catalog]: configured and running, proceeding with master startup.
I20251212 09:11:10.095345 32364 raft_consensus.cc:697] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 1 LEADER]: Becoming Leader. State: Replica: e4af916219b24e4e8c6836b7b59574fa, State: Running, Role: LEADER
I20251212 09:11:10.095427 32364 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } }
I20251212 09:11:10.095726 32364 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4af916219b24e4e8c6836b7b59574fa. Latest consensus state: current_term: 1 leader_uuid: "e4af916219b24e4e8c6836b7b59574fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } } }
I20251212 09:11:10.095736 32365 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4af916219b24e4e8c6836b7b59574fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } } }
I20251212 09:11:10.095829 32364 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:10.095870 32365 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:10.096678 32377 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251212 09:11:10.097142 32377 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251212 09:11:10.098515 32377 catalog_manager.cc:1357] Generated new cluster ID: bfff59872bf64b9ab6131b9f933daa44
I20251212 09:11:10.098572 32377 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251212 09:11:10.114199 32377 catalog_manager.cc:1380] Generated new certificate authority record
I20251212 09:11:10.114671 32377 catalog_manager.cc:1514] Loading token signing keys...
I20251212 09:11:10.131326 32377 catalog_manager.cc:6027] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa: Generated new TSK 0
I20251212 09:11:10.131524 32377 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251212 09:11:10.137120 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.129:0
--local_ip_for_outbound_sockets=127.29.26.129
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:44373
--builtin_ntp_servers=127.29.26.148:41675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251212 09:11:10.249027 32383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:10.249286 32383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:10.249317 32383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:10.251737 32383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:10.251816 32383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.129
I20251212 09:11:10.254302 32383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:41675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:44373
--never_fsync=true
--heap_profile_path=/tmp/kudu.32383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.129
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:10.254571 32383 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:10.254837 32383 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:10.257779 32388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:10.257835 32383 server_base.cc:1047] running on GCE node
W20251212 09:11:10.258011 32389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:10.258041 32391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:10.258261 32383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:10.258459 32383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:10.259598 32383 hybrid_clock.cc:648] HybridClock initialized: now 1765530670259584 us; error 30 us; skew 500 ppm
I20251212 09:11:10.260818 32383 webserver.cc:492] Webserver started at http://127.29.26.129:40437/ using document root <none> and password file <none>
I20251212 09:11:10.261019 32383 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:10.261063 32383 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:10.261178 32383 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:10.262090 32383 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "80177290eb56466ebaaf95df99767fdb"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:10.262383 32383 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "80177290eb56466ebaaf95df99767fdb"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:10.263605 32383 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20251212 09:11:10.264364 32397 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:10.264536 32383 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:10.264603 32383 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "80177290eb56466ebaaf95df99767fdb"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:10.264686 32383 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:10.278682 32383 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:10.278934 32383 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:10.279057 32383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:10.279289 32383 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:10.279593 32383 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:10.279625 32383 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:10.279662 32383 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:10.279690 32383 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:10.285367 32383 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.129:40199
I20251212 09:11:10.285441 32510 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.129:40199 every 8 connection(s)
I20251212 09:11:10.285701 32383 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251212 09:11:10.291236 32511 heartbeater.cc:344] Connected to a master server at 127.29.26.190:44373
I20251212 09:11:10.291338 32511 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:10.291553 32511 heartbeater.cc:507] Master 127.29.26.190:44373 requested a full tablet report, sending...
I20251212 09:11:10.292028 32323 ts_manager.cc:194] Registered new tserver with Master: 80177290eb56466ebaaf95df99767fdb (127.29.26.129:40199)
I20251212 09:11:10.292140 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 32383
I20251212 09:11:10.292219 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251212 09:11:10.293017 32323 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.129:32923
I20251212 09:11:10.293416 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.130:0
--local_ip_for_outbound_sockets=127.29.26.130
--webserver_interface=127.29.26.130
--webserver_port=0
--tserver_master_addrs=127.29.26.190:44373
--builtin_ntp_servers=127.29.26.148:41675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251212 09:11:10.369671 32514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:10.369823 32514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:10.369855 32514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:10.371243 32514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:10.371297 32514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.130
I20251212 09:11:10.372813 32514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:41675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.29.26.130
--webserver_port=0
--tserver_master_addrs=127.29.26.190:44373
--never_fsync=true
--heap_profile_path=/tmp/kudu.32514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.130
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:10.373050 32514 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:10.373268 32514 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:10.375728 32520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:10.375725 32519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:10.375782 32522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:10.375769 32514 server_base.cc:1047] running on GCE node
I20251212 09:11:10.376132 32514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:10.376330 32514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:10.377463 32514 hybrid_clock.cc:648] HybridClock initialized: now 1765530670377441 us; error 37 us; skew 500 ppm
I20251212 09:11:10.378556 32514 webserver.cc:492] Webserver started at http://127.29.26.130:38399/ using document root <none> and password file <none>
I20251212 09:11:10.378741 32514 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:10.378785 32514 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:10.378914 32514 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:10.379729 32514 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "a966ff4894cf448a86861726787df12c"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:10.380017 32514 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "a966ff4894cf448a86861726787df12c"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:10.381204 32514 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251212 09:11:10.381884 32528 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:10.382090 32514 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:10.382151 32514 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "a966ff4894cf448a86861726787df12c"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:10.382195 32514 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:10.397240 32514 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:10.397512 32514 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:10.397611 32514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:10.397836 32514 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:10.398128 32514 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:10.398160 32514 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:10.398181 32514 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:10.398193 32514 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:10.403388 32514 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.130:45443
I20251212 09:11:10.403473 32641 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.130:45443 every 8 connection(s)
I20251212 09:11:10.403721 32514 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251212 09:11:10.407574 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 32514
I20251212 09:11:10.407665 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251212 09:11:10.407858 32642 heartbeater.cc:344] Connected to a master server at 127.29.26.190:44373
I20251212 09:11:10.408077 32642 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:10.408294 32642 heartbeater.cc:507] Master 127.29.26.190:44373 requested a full tablet report, sending...
I20251212 09:11:10.408887 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.131:0
--local_ip_for_outbound_sockets=127.29.26.131
--webserver_interface=127.29.26.131
--webserver_port=0
--tserver_master_addrs=127.29.26.190:44373
--builtin_ntp_servers=127.29.26.148:41675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251212 09:11:10.409663 32323 ts_manager.cc:194] Registered new tserver with Master: a966ff4894cf448a86861726787df12c (127.29.26.130:45443)
I20251212 09:11:10.410157 32323 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.130:43723
W20251212 09:11:10.495702 32645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:10.495863 32645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:10.495884 32645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:10.497396 32645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:10.497453 32645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.131
I20251212 09:11:10.499018 32645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:41675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.29.26.131
--webserver_port=0
--tserver_master_addrs=127.29.26.190:44373
--never_fsync=true
--heap_profile_path=/tmp/kudu.32645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.131
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:10.499236 32645 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:10.499472 32645 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:10.501960 32653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:10.501999 32650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:10.501974 32651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:10.502118 32645 server_base.cc:1047] running on GCE node
I20251212 09:11:10.502410 32645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:10.502615 32645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:10.503747 32645 hybrid_clock.cc:648] HybridClock initialized: now 1765530670503735 us; error 25 us; skew 500 ppm
I20251212 09:11:10.504784 32645 webserver.cc:492] Webserver started at http://127.29.26.131:41215/ using document root <none> and password file <none>
I20251212 09:11:10.504976 32645 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:10.505020 32645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:10.505132 32645 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:10.505945 32645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "b60550c4a01042218d18cadc590fa17b"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:10.506249 32645 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "b60550c4a01042218d18cadc590fa17b"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:10.507354 32645 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20251212 09:11:10.507957 32659 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:10.508132 32645 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:10.508200 32645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "b60550c4a01042218d18cadc590fa17b"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:10.508260 32645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:10.517361 32645 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:10.517570 32645 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:10.517681 32645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:10.517871 32645 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:10.518157 32645 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:10.518187 32645 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:10.518219 32645 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:10.518239 32645 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:10.523476 32645 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.131:39705
I20251212 09:11:10.523546 304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.131:39705 every 8 connection(s)
I20251212 09:11:10.523797 32645 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251212 09:11:10.524111 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 32645
I20251212 09:11:10.524230 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251212 09:11:10.528133 305 heartbeater.cc:344] Connected to a master server at 127.29.26.190:44373
I20251212 09:11:10.528225 305 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:10.528394 305 heartbeater.cc:507] Master 127.29.26.190:44373 requested a full tablet report, sending...
I20251212 09:11:10.528777 32323 ts_manager.cc:194] Registered new tserver with Master: b60550c4a01042218d18cadc590fa17b (127.29.26.131:39705)
I20251212 09:11:10.529151 32323 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.131:35715
I20251212 09:11:10.536324 29802 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251212 09:11:10.543399 29802 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251212 09:11:10.543490 29802 test_util.cc:276] Using random seed: -1535823230
I20251212 09:11:10.549490 32323 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37494:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251212 09:11:10.554821 32576 tablet_service.cc:1505] Processing CreateTablet for tablet 6b4f3768383a458a9248f72eb53f3845 (DEFAULT_TABLE table=TestTable [id=23381df43b00439da1efce01fde8c417]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:10.555092 32576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b4f3768383a458a9248f72eb53f3845. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:10.557006 320 tablet_bootstrap.cc:492] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c: Bootstrap starting.
I20251212 09:11:10.557540 320 tablet_bootstrap.cc:654] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:10.557781 320 log.cc:826] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:10.558347 320 tablet_bootstrap.cc:492] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c: No bootstrap required, opened a new log
I20251212 09:11:10.558398 320 ts_tablet_manager.cc:1403] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:10.559441 320 raft_consensus.cc:359] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } }
I20251212 09:11:10.559549 320 raft_consensus.cc:385] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:10.559584 320 raft_consensus.cc:740] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a966ff4894cf448a86861726787df12c, State: Initialized, Role: FOLLOWER
I20251212 09:11:10.559682 320 consensus_queue.cc:260] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } }
I20251212 09:11:10.559753 320 raft_consensus.cc:399] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:10.559787 320 raft_consensus.cc:493] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:10.559841 320 raft_consensus.cc:3060] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:10.560339 320 raft_consensus.cc:515] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } }
I20251212 09:11:10.560451 320 leader_election.cc:304] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a966ff4894cf448a86861726787df12c; no voters:
I20251212 09:11:10.560588 320 leader_election.cc:290] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [CANDIDATE]: Term 1 election: Requested vote from peers
I20251212 09:11:10.560639 322 raft_consensus.cc:2804] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:10.560817 32642 heartbeater.cc:499] Master 127.29.26.190:44373 was elected leader, sending a full tablet report...
I20251212 09:11:10.560839 322 raft_consensus.cc:697] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 1 LEADER]: Becoming Leader. State: Replica: a966ff4894cf448a86861726787df12c, State: Running, Role: LEADER
I20251212 09:11:10.560932 322 consensus_queue.cc:237] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } }
I20251212 09:11:10.560954 320 ts_tablet_manager.cc:1434] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:10.561793 32323 catalog_manager.cc:5654] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c reported cstate change: term changed from 0 to 1, leader changed from <none> to a966ff4894cf448a86861726787df12c (127.29.26.130). New cstate: current_term: 1 leader_uuid: "a966ff4894cf448a86861726787df12c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } health_report { overall_health: HEALTHY } } }
I20251212 09:11:10.585124 29802 test_util.cc:276] Using random seed: -1535781603
I20251212 09:11:10.589414 32322 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37502:
name: "TestTable1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251212 09:11:10.594103 32445 tablet_service.cc:1505] Processing CreateTablet for tablet a3c5f1aefb684092bad686c9446aa016 (DEFAULT_TABLE table=TestTable1 [id=f2be24a8c9ae41dc8b4b5bbdcf4d0765]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:10.594396 32445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3c5f1aefb684092bad686c9446aa016. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:10.596350 342 tablet_bootstrap.cc:492] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb: Bootstrap starting.
I20251212 09:11:10.596971 342 tablet_bootstrap.cc:654] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:10.597235 342 log.cc:826] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:10.597780 342 tablet_bootstrap.cc:492] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb: No bootstrap required, opened a new log
I20251212 09:11:10.597836 342 ts_tablet_manager.cc:1403] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251212 09:11:10.598873 342 raft_consensus.cc:359] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } }
I20251212 09:11:10.598979 342 raft_consensus.cc:385] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:10.599012 342 raft_consensus.cc:740] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80177290eb56466ebaaf95df99767fdb, State: Initialized, Role: FOLLOWER
I20251212 09:11:10.599110 342 consensus_queue.cc:260] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } }
I20251212 09:11:10.599169 342 raft_consensus.cc:399] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:10.599233 342 raft_consensus.cc:493] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:10.599285 342 raft_consensus.cc:3060] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:10.599843 342 raft_consensus.cc:515] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } }
I20251212 09:11:10.599943 342 leader_election.cc:304] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80177290eb56466ebaaf95df99767fdb; no voters:
I20251212 09:11:10.600090 342 leader_election.cc:290] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [CANDIDATE]: Term 1 election: Requested vote from peers
I20251212 09:11:10.600147 344 raft_consensus.cc:2804] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:10.600311 342 ts_tablet_manager.cc:1434] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20251212 09:11:10.600296 344 raft_consensus.cc:697] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 1 LEADER]: Becoming Leader. State: Replica: 80177290eb56466ebaaf95df99767fdb, State: Running, Role: LEADER
I20251212 09:11:10.600303 32511 heartbeater.cc:499] Master 127.29.26.190:44373 was elected leader, sending a full tablet report...
I20251212 09:11:10.600453 344 consensus_queue.cc:237] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } }
I20251212 09:11:10.601127 32322 catalog_manager.cc:5654] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb reported cstate change: term changed from 0 to 1, leader changed from <none> to 80177290eb56466ebaaf95df99767fdb (127.29.26.129). New cstate: current_term: 1 leader_uuid: "80177290eb56466ebaaf95df99767fdb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } health_report { overall_health: HEALTHY } } }
I20251212 09:11:10.614248 29802 test_util.cc:276] Using random seed: -1535752487
I20251212 09:11:10.618484 32323 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37506:
name: "TestTable2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251212 09:11:10.623260 32707 tablet_service.cc:1505] Processing CreateTablet for tablet 14c8ab47f11d406795b21b6e885daa19 (DEFAULT_TABLE table=TestTable2 [id=2eda57162846405983f2fddd73021322]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:10.623521 32707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c8ab47f11d406795b21b6e885daa19. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:10.625347 364 tablet_bootstrap.cc:492] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b: Bootstrap starting.
I20251212 09:11:10.625912 364 tablet_bootstrap.cc:654] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:10.626147 364 log.cc:826] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:10.626716 364 tablet_bootstrap.cc:492] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b: No bootstrap required, opened a new log
I20251212 09:11:10.626777 364 ts_tablet_manager.cc:1403] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:10.627785 364 raft_consensus.cc:359] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 39705 } }
I20251212 09:11:10.627894 364 raft_consensus.cc:385] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:10.627928 364 raft_consensus.cc:740] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b60550c4a01042218d18cadc590fa17b, State: Initialized, Role: FOLLOWER
I20251212 09:11:10.628034 364 consensus_queue.cc:260] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 39705 } }
I20251212 09:11:10.628095 364 raft_consensus.cc:399] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:10.628129 364 raft_consensus.cc:493] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:10.628180 364 raft_consensus.cc:3060] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:10.628741 364 raft_consensus.cc:515] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 39705 } }
I20251212 09:11:10.628830 364 leader_election.cc:304] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b60550c4a01042218d18cadc590fa17b; no voters:
I20251212 09:11:10.628974 364 leader_election.cc:290] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [CANDIDATE]: Term 1 election: Requested vote from peers
I20251212 09:11:10.629048 366 raft_consensus.cc:2804] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:10.629139 364 ts_tablet_manager.cc:1434] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20251212 09:11:10.629192 305 heartbeater.cc:499] Master 127.29.26.190:44373 was elected leader, sending a full tablet report...
I20251212 09:11:10.629221 366 raft_consensus.cc:697] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 1 LEADER]: Becoming Leader. State: Replica: b60550c4a01042218d18cadc590fa17b, State: Running, Role: LEADER
I20251212 09:11:10.629312 366 consensus_queue.cc:237] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 39705 } }
I20251212 09:11:10.629946 32323 catalog_manager.cc:5654] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b reported cstate change: term changed from 0 to 1, leader changed from <none> to b60550c4a01042218d18cadc590fa17b (127.29.26.131). New cstate: current_term: 1 leader_uuid: "b60550c4a01042218d18cadc590fa17b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 39705 } health_report { overall_health: HEALTHY } } }
I20251212 09:11:10.643186 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 32292
I20251212 09:11:11.002605 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 32383
I20251212 09:11:11.007432 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 32514
I20251212 09:11:11.012035 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 32645
I20251212 09:11:11.016695 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:44373
--webserver_interface=127.29.26.190
--webserver_port=34253
--builtin_ntp_servers=127.29.26.148:41675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.26.190:44373 with env {}
W20251212 09:11:11.093997 423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:11.094161 423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:11.094194 423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:11.095594 423 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251212 09:11:11.095638 423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:11.095661 423 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251212 09:11:11.095683 423 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251212 09:11:11.097177 423 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:41675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.26.190:44373
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:44373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.29.26.190
--webserver_port=34253
--never_fsync=true
--heap_profile_path=/tmp/kudu.423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:11.097433 423 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:11.097648 423 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:11.100050 429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:11.100077 428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:11.100117 431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:11.100222 423 server_base.cc:1047] running on GCE node
I20251212 09:11:11.100412 423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:11.100634 423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:11.101799 423 hybrid_clock.cc:648] HybridClock initialized: now 1765530671101787 us; error 28 us; skew 500 ppm
I20251212 09:11:11.102909 423 webserver.cc:492] Webserver started at http://127.29.26.190:34253/ using document root <none> and password file <none>
I20251212 09:11:11.103103 423 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:11.103150 423 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:11.104280 423 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:11.104892 437 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:11.105049 423 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:11.105116 423 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
uuid: "e4af916219b24e4e8c6836b7b59574fa"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:11.105360 423 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:11.125169 423 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:11.125454 423 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:11.125574 423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:11.129333 423 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.190:44373
I20251212 09:11:11.129371 490 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.190:44373 every 8 connection(s)
I20251212 09:11:11.129683 423 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251212 09:11:11.130430 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 423
I20251212 09:11:11.130661 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.129:40199
--local_ip_for_outbound_sockets=127.29.26.129
--tserver_master_addrs=127.29.26.190:44373
--webserver_port=40437
--webserver_interface=127.29.26.129
--builtin_ntp_servers=127.29.26.148:41675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251212 09:11:11.130864 491 sys_catalog.cc:263] Verifying existing consensus state
I20251212 09:11:11.131428 491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa: Bootstrap starting.
I20251212 09:11:11.132845 491 log.cc:826] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:11.135078 491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=0 applied=18 ignored=0} inserts{seen=13 ignored=0} mutations{seen=10 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251212 09:11:11.135459 491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa: Bootstrap complete.
I20251212 09:11:11.137148 491 raft_consensus.cc:359] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } }
I20251212 09:11:11.137351 491 raft_consensus.cc:740] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4af916219b24e4e8c6836b7b59574fa, State: Initialized, Role: FOLLOWER
I20251212 09:11:11.137467 491 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 2.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } }
I20251212 09:11:11.137530 491 raft_consensus.cc:399] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:11.137570 491 raft_consensus.cc:493] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:11.137619 491 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 2 FOLLOWER]: Advancing to term 3
I20251212 09:11:11.138537 491 raft_consensus.cc:515] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } }
I20251212 09:11:11.138626 491 leader_election.cc:304] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4af916219b24e4e8c6836b7b59574fa; no voters:
I20251212 09:11:11.138777 491 leader_election.cc:290] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [CANDIDATE]: Term 3 election: Requested vote from peers
I20251212 09:11:11.138830 495 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 3 FOLLOWER]: Leader election won for term 3
I20251212 09:11:11.138949 495 raft_consensus.cc:697] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 3 LEADER]: Becoming Leader. State: Replica: e4af916219b24e4e8c6836b7b59574fa, State: Running, Role: LEADER
I20251212 09:11:11.139005 491 sys_catalog.cc:565] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [sys.catalog]: configured and running, proceeding with master startup.
I20251212 09:11:11.139026 495 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 2.18, Last appended by leader: 18, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } }
I20251212 09:11:11.139297 495 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4af916219b24e4e8c6836b7b59574fa. Latest consensus state: current_term: 3 leader_uuid: "e4af916219b24e4e8c6836b7b59574fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } } }
I20251212 09:11:11.139371 495 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:11.139309 497 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e4af916219b24e4e8c6836b7b59574fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } } }
I20251212 09:11:11.139554 499 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251212 09:11:11.139572 497 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:11.140245 499 catalog_manager.cc:679] Loaded metadata for table TestTable2 [id=2eda57162846405983f2fddd73021322]
I20251212 09:11:11.140345 499 catalog_manager.cc:679] Loaded metadata for table TestTable1 [id=633713e351be4f69bca5801a9bcac431]
I20251212 09:11:11.140420 499 catalog_manager.cc:679] Loaded metadata for table TestTable [id=cc87a80afef6497c8429cc3c59bd13d6]
I20251212 09:11:11.140612 499 tablet_loader.cc:96] loaded metadata for tablet 14c8ab47f11d406795b21b6e885daa19 (table TestTable2 [id=2eda57162846405983f2fddd73021322])
I20251212 09:11:11.140697 499 tablet_loader.cc:96] loaded metadata for tablet 6b4f3768383a458a9248f72eb53f3845 (table TestTable [id=cc87a80afef6497c8429cc3c59bd13d6])
I20251212 09:11:11.140743 499 tablet_loader.cc:96] loaded metadata for tablet a3c5f1aefb684092bad686c9446aa016 (table TestTable1 [id=633713e351be4f69bca5801a9bcac431])
I20251212 09:11:11.140784 499 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251212 09:11:11.140878 499 catalog_manager.cc:1269] Loaded cluster ID: bfff59872bf64b9ab6131b9f933daa44
I20251212 09:11:11.140933 499 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251212 09:11:11.142006 499 catalog_manager.cc:1514] Loading token signing keys...
I20251212 09:11:11.142172 499 catalog_manager.cc:6038] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa: Loaded TSK: 0
I20251212 09:11:11.142360 499 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20251212 09:11:11.225601 493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:11.225756 493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:11.225775 493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:11.227135 493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:11.227188 493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.129
I20251212 09:11:11.228631 493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:41675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.129:40199
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.29.26.129
--webserver_port=40437
--tserver_master_addrs=127.29.26.190:44373
--never_fsync=true
--heap_profile_path=/tmp/kudu.493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.129
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:11.228879 493 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:11.229105 493 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:11.231609 518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:11.231618 517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:11.231833 520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:11.231822 493 server_base.cc:1047] running on GCE node
I20251212 09:11:11.232033 493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:11.232192 493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:11.233315 493 hybrid_clock.cc:648] HybridClock initialized: now 1765530671233300 us; error 33 us; skew 500 ppm
I20251212 09:11:11.234385 493 webserver.cc:492] Webserver started at http://127.29.26.129:40437/ using document root <none> and password file <none>
I20251212 09:11:11.234588 493 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:11.234647 493 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:11.235795 493 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:11.236399 527 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:11.236577 493 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:11.236644 493 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "80177290eb56466ebaaf95df99767fdb"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:11.236896 493 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:11.257813 493 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:11.258047 493 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:11.258169 493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:11.258353 493 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:11.258780 534 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251212 09:11:11.259608 493 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251212 09:11:11.259649 493 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251212 09:11:11.259675 493 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251212 09:11:11.260183 493 ts_tablet_manager.cc:616] Registered 1 tablets
I20251212 09:11:11.260223 493 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20251212 09:11:11.260262 534 tablet_bootstrap.cc:492] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb: Bootstrap starting.
I20251212 09:11:11.267927 493 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.129:40199
I20251212 09:11:11.268069 641 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.129:40199 every 8 connection(s)
I20251212 09:11:11.268400 493 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251212 09:11:11.271028 534 log.cc:826] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:11.275511 534 tablet_bootstrap.cc:492] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251212 09:11:11.275522 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 493
I20251212 09:11:11.275784 534 tablet_bootstrap.cc:492] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb: Bootstrap complete.
I20251212 09:11:11.275787 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.130:45443
--local_ip_for_outbound_sockets=127.29.26.130
--tserver_master_addrs=127.29.26.190:44373
--webserver_port=38399
--webserver_interface=127.29.26.130
--builtin_ntp_servers=127.29.26.148:41675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251212 09:11:11.276747 534 ts_tablet_manager.cc:1403] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.009s
I20251212 09:11:11.278194 534 raft_consensus.cc:359] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } }
I20251212 09:11:11.278515 534 raft_consensus.cc:740] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80177290eb56466ebaaf95df99767fdb, State: Initialized, Role: FOLLOWER
I20251212 09:11:11.278606 534 consensus_queue.cc:260] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } }
I20251212 09:11:11.278684 534 raft_consensus.cc:399] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:11.278674 642 heartbeater.cc:344] Connected to a master server at 127.29.26.190:44373
I20251212 09:11:11.278741 534 raft_consensus.cc:493] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:11.278821 642 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:11.278828 534 raft_consensus.cc:3060] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 1 FOLLOWER]: Advancing to term 2
I20251212 09:11:11.279064 642 heartbeater.cc:507] Master 127.29.26.190:44373 requested a full tablet report, sending...
I20251212 09:11:11.280175 534 raft_consensus.cc:515] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } }
I20251212 09:11:11.280313 534 leader_election.cc:304] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80177290eb56466ebaaf95df99767fdb; no voters:
I20251212 09:11:11.280495 534 leader_election.cc:290] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [CANDIDATE]: Term 2 election: Requested vote from peers
I20251212 09:11:11.280593 648 raft_consensus.cc:2804] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 2 FOLLOWER]: Leader election won for term 2
I20251212 09:11:11.280709 534 ts_tablet_manager.cc:1434] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20251212 09:11:11.280841 648 raft_consensus.cc:697] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 2 LEADER]: Becoming Leader. State: Replica: 80177290eb56466ebaaf95df99767fdb, State: Running, Role: LEADER
I20251212 09:11:11.280972 648 consensus_queue.cc:237] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } }
I20251212 09:11:11.282181 455 ts_manager.cc:194] Registered new tserver with Master: 80177290eb56466ebaaf95df99767fdb (127.29.26.129:40199)
I20251212 09:11:11.282318 455 catalog_manager.cc:5654] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb reported cstate change: term changed from 0 to 2, leader changed from <none> to 80177290eb56466ebaaf95df99767fdb (127.29.26.129), VOTER 80177290eb56466ebaaf95df99767fdb (127.29.26.129) added. New cstate: current_term: 2 leader_uuid: "80177290eb56466ebaaf95df99767fdb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } health_report { overall_health: HEALTHY } } }
W20251212 09:11:11.285135 455 catalog_manager.cc:5332] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a3c5f1aefb684092bad686c9446aa016 with cas_config_opid_index -1: no extra replica candidate found for tablet a3c5f1aefb684092bad686c9446aa016 (table TestTable1 [id=633713e351be4f69bca5801a9bcac431]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy: the total number of registered tablet servers (1) does not allow for adding an extra replica; consider bringing up more to have at least 4 tablet servers up and running
I20251212 09:11:11.286087 455 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.129:52273
I20251212 09:11:11.286957 642 heartbeater.cc:499] Master 127.29.26.190:44373 was elected leader, sending a full tablet report...
W20251212 09:11:11.355552 647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:11.355701 647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:11.355720 647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:11.357131 647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:11.357178 647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.130
I20251212 09:11:11.358660 647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:41675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.130:45443
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.29.26.130
--webserver_port=38399
--tserver_master_addrs=127.29.26.190:44373
--never_fsync=true
--heap_profile_path=/tmp/kudu.647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.130
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:11.358862 647 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:11.359071 647 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:11.361451 659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:11.361457 661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:11.361457 658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:11.361802 647 server_base.cc:1047] running on GCE node
I20251212 09:11:11.361972 647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:11.362160 647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:11.363298 647 hybrid_clock.cc:648] HybridClock initialized: now 1765530671363280 us; error 31 us; skew 500 ppm
I20251212 09:11:11.364338 647 webserver.cc:492] Webserver started at http://127.29.26.130:38399/ using document root <none> and password file <none>
I20251212 09:11:11.364524 647 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:11.364583 647 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:11.365767 647 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20251212 09:11:11.366359 668 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:11.366526 647 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251212 09:11:11.366596 647 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "a966ff4894cf448a86861726787df12c"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:11.366837 647 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:11.402618 647 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:11.402873 647 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:11.402979 647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:11.403200 647 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:11.403594 675 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251212 09:11:11.404399 647 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251212 09:11:11.404441 647 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251212 09:11:11.404482 647 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251212 09:11:11.405014 647 ts_tablet_manager.cc:616] Registered 1 tablets
I20251212 09:11:11.405046 647 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20251212 09:11:11.405269 675 tablet_bootstrap.cc:492] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c: Bootstrap starting.
I20251212 09:11:11.411525 647 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.130:45443
I20251212 09:11:11.411571 782 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.130:45443 every 8 connection(s)
I20251212 09:11:11.411865 647 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251212 09:11:11.414446 675 log.cc:826] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:11.416265 783 heartbeater.cc:344] Connected to a master server at 127.29.26.190:44373
I20251212 09:11:11.416361 783 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:11.416549 783 heartbeater.cc:507] Master 127.29.26.190:44373 requested a full tablet report, sending...
I20251212 09:11:11.417033 455 ts_manager.cc:194] Registered new tserver with Master: a966ff4894cf448a86861726787df12c (127.29.26.130:45443)
I20251212 09:11:11.417443 455 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.130:36913
I20251212 09:11:11.420382 675 tablet_bootstrap.cc:492] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c: Bootstrap replayed 1/1 log segments. Stats: ops{read=27 overwritten=0 applied=27 ignored=0} inserts{seen=1300 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251212 09:11:11.420640 675 tablet_bootstrap.cc:492] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c: Bootstrap complete.
I20251212 09:11:11.421434 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 647
I20251212 09:11:11.421536 675 ts_tablet_manager.cc:1403] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.009s
I20251212 09:11:11.421697 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.131:39705
--local_ip_for_outbound_sockets=127.29.26.131
--tserver_master_addrs=127.29.26.190:44373
--webserver_port=41215
--webserver_interface=127.29.26.131
--builtin_ntp_servers=127.29.26.148:41675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20251212 09:11:11.422410 675 raft_consensus.cc:359] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } }
I20251212 09:11:11.422580 675 raft_consensus.cc:740] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a966ff4894cf448a86861726787df12c, State: Initialized, Role: FOLLOWER
I20251212 09:11:11.422680 675 consensus_queue.cc:260] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 27, Last appended: 1.27, Last appended by leader: 27, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } }
I20251212 09:11:11.422742 675 raft_consensus.cc:399] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:11.422787 675 raft_consensus.cc:493] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:11.422834 675 raft_consensus.cc:3060] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 1 FOLLOWER]: Advancing to term 2
I20251212 09:11:11.423651 675 raft_consensus.cc:515] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } }
I20251212 09:11:11.423743 675 leader_election.cc:304] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a966ff4894cf448a86861726787df12c; no voters:
I20251212 09:11:11.423897 675 leader_election.cc:290] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [CANDIDATE]: Term 2 election: Requested vote from peers
I20251212 09:11:11.423938 788 raft_consensus.cc:2804] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 2 FOLLOWER]: Leader election won for term 2
I20251212 09:11:11.424036 788 raft_consensus.cc:697] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 2 LEADER]: Becoming Leader. State: Replica: a966ff4894cf448a86861726787df12c, State: Running, Role: LEADER
I20251212 09:11:11.424094 675 ts_tablet_manager.cc:1434] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20251212 09:11:11.424158 783 heartbeater.cc:499] Master 127.29.26.190:44373 was elected leader, sending a full tablet report...
I20251212 09:11:11.424203 788 consensus_queue.cc:237] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 27, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } }
I20251212 09:11:11.424796 455 catalog_manager.cc:5654] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c reported cstate change: term changed from 0 to 2, leader changed from <none> to a966ff4894cf448a86861726787df12c (127.29.26.130), VOTER a966ff4894cf448a86861726787df12c (127.29.26.130) added. New cstate: current_term: 2 leader_uuid: "a966ff4894cf448a86861726787df12c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } health_report { overall_health: HEALTHY } } }
I20251212 09:11:11.428884 737 consensus_queue.cc:237] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 2.28, Last appended by leader: 27, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } } peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: NON_VOTER last_known_addr { host: "127.29.26.129" port: 40199 } attrs { promote: true } }
I20251212 09:11:11.429250 790 raft_consensus.cc:2955] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 2 LEADER]: Committing config change with OpId 2.29: config changed from index -1 to 29, NON_VOTER 80177290eb56466ebaaf95df99767fdb (127.29.26.129) added. New config: { opid_index: 29 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } } peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: NON_VOTER last_known_addr { host: "127.29.26.129" port: 40199 } attrs { promote: true } } }
I20251212 09:11:11.430665 440 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 6b4f3768383a458a9248f72eb53f3845 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20251212 09:11:11.431010 455 catalog_manager.cc:5654] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c reported cstate change: config changed from index -1 to 29, NON_VOTER 80177290eb56466ebaaf95df99767fdb (127.29.26.129) added. New cstate: current_term: 2 leader_uuid: "a966ff4894cf448a86861726787df12c" committed_config { opid_index: 29 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: NON_VOTER last_known_addr { host: "127.29.26.129" port: 40199 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251212 09:11:11.433000 671 consensus_peers.cc:597] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c -> Peer 80177290eb56466ebaaf95df99767fdb (127.29.26.129:40199): Couldn't send request to peer 80177290eb56466ebaaf95df99767fdb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b4f3768383a458a9248f72eb53f3845. This is attempt 1: this message will repeat every 5th retry.
I20251212 09:11:11.496945 596 consensus_queue.cc:237] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 2.13, Last appended by leader: 12, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } } peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: NON_VOTER last_known_addr { host: "127.29.26.130" port: 45443 } attrs { promote: true } }
I20251212 09:11:11.497437 648 raft_consensus.cc:2955] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 2 LEADER]: Committing config change with OpId 2.14: config changed from index -1 to 14, NON_VOTER a966ff4894cf448a86861726787df12c (127.29.26.130) added. New config: { opid_index: 14 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } } peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: NON_VOTER last_known_addr { host: "127.29.26.130" port: 45443 } attrs { promote: true } } }
I20251212 09:11:11.498270 440 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a3c5f1aefb684092bad686c9446aa016 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 4)
I20251212 09:11:11.498540 455 catalog_manager.cc:5654] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb reported cstate change: config changed from index -1 to 14, NON_VOTER a966ff4894cf448a86861726787df12c (127.29.26.130) added. New cstate: current_term: 2 leader_uuid: "80177290eb56466ebaaf95df99767fdb" committed_config { opid_index: 14 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: NON_VOTER last_known_addr { host: "127.29.26.130" port: 45443 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251212 09:11:11.501278 530 consensus_peers.cc:597] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb -> Peer a966ff4894cf448a86861726787df12c (127.29.26.130:45443): Couldn't send request to peer a966ff4894cf448a86861726787df12c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a3c5f1aefb684092bad686c9446aa016. This is attempt 1: this message will repeat every 5th retry.
W20251212 09:11:11.502220 787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:11.502352 787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:11.502372 787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:11.503700 787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:11.503746 787 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.131
I20251212 09:11:11.505203 787 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:41675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.131:39705
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.29.26.131
--webserver_port=41215
--tserver_master_addrs=127.29.26.190:44373
--never_fsync=true
--heap_profile_path=/tmp/kudu.787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.131
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:11.505358 787 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:11.505539 787 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:11.507711 803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:11.507753 801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:11.507833 787 server_base.cc:1047] running on GCE node
W20251212 09:11:11.507833 800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:11.508037 787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:11.508255 787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:11.509385 787 hybrid_clock.cc:648] HybridClock initialized: now 1765530671509365 us; error 30 us; skew 500 ppm
I20251212 09:11:11.510501 787 webserver.cc:492] Webserver started at http://127.29.26.131:41215/ using document root <none> and password file <none>
I20251212 09:11:11.510696 787 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:11.510754 787 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:11.511884 787 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:11.512594 810 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:11.512764 787 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:11.512835 787 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "b60550c4a01042218d18cadc590fa17b"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:11.513067 787 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:11.538604 787 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:11.538875 787 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:11.538990 787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:11.539217 787 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:11.539659 817 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251212 09:11:11.540620 787 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251212 09:11:11.540684 787 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251212 09:11:11.540730 787 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251212 09:11:11.541286 787 ts_tablet_manager.cc:616] Registered 1 tablets
I20251212 09:11:11.541319 787 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20251212 09:11:11.541380 817 tablet_bootstrap.cc:492] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b: Bootstrap starting.
I20251212 09:11:11.548202 787 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.131:39705
I20251212 09:11:11.548266 926 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.131:39705 every 8 connection(s)
I20251212 09:11:11.548533 787 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251212 09:11:11.548943 817 log.cc:826] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:11.552973 927 heartbeater.cc:344] Connected to a master server at 127.29.26.190:44373
I20251212 09:11:11.552989 817 tablet_bootstrap.cc:492] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=600 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251212 09:11:11.553112 927 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:11.553318 927 heartbeater.cc:507] Master 127.29.26.190:44373 requested a full tablet report, sending...
I20251212 09:11:11.553318 817 tablet_bootstrap.cc:492] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b: Bootstrap complete.
I20251212 09:11:11.553854 455 ts_manager.cc:194] Registered new tserver with Master: b60550c4a01042218d18cadc590fa17b (127.29.26.131:39705)
I20251212 09:11:11.554378 455 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.131:47085
I20251212 09:11:11.554406 817 ts_tablet_manager.cc:1403] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20251212 09:11:11.555279 817 raft_consensus.cc:359] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 39705 } }
I20251212 09:11:11.555460 817 raft_consensus.cc:740] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b60550c4a01042218d18cadc590fa17b, State: Initialized, Role: FOLLOWER
I20251212 09:11:11.555531 817 consensus_queue.cc:260] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 1.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 39705 } }
I20251212 09:11:11.555588 817 raft_consensus.cc:399] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:11.555610 817 raft_consensus.cc:493] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:11.555660 817 raft_consensus.cc:3060] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 1 FOLLOWER]: Advancing to term 2
I20251212 09:11:11.556438 817 raft_consensus.cc:515] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 39705 } }
I20251212 09:11:11.556521 817 leader_election.cc:304] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b60550c4a01042218d18cadc590fa17b; no voters:
I20251212 09:11:11.556713 817 leader_election.cc:290] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [CANDIDATE]: Term 2 election: Requested vote from peers
I20251212 09:11:11.556759 931 raft_consensus.cc:2804] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 2 FOLLOWER]: Leader election won for term 2
I20251212 09:11:11.556766 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 787
I20251212 09:11:11.556895 931 raft_consensus.cc:697] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [term 2 LEADER]: Becoming Leader. State: Replica: b60550c4a01042218d18cadc590fa17b, State: Running, Role: LEADER
I20251212 09:11:11.556952 927 heartbeater.cc:499] Master 127.29.26.190:44373 was elected leader, sending a full tablet report...
I20251212 09:11:11.556910 817 ts_tablet_manager.cc:1434] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20251212 09:11:11.557103 931 consensus_queue.cc:237] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 13, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 39705 } }
I20251212 09:11:11.557749 455 catalog_manager.cc:5654] T 14c8ab47f11d406795b21b6e885daa19 P b60550c4a01042218d18cadc590fa17b reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "b60550c4a01042218d18cadc590fa17b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 39705 } health_report { overall_health: HEALTHY } } }
I20251212 09:11:11.557964 737 consensus_queue.cc:237] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 2.29, Last appended by leader: 27, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } } peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: NON_VOTER last_known_addr { host: "127.29.26.129" port: 40199 } attrs { promote: true } } peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: NON_VOTER last_known_addr { host: "127.29.26.131" port: 39705 } attrs { promote: true } }
I20251212 09:11:11.558480 788 raft_consensus.cc:2955] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c [term 2 LEADER]: Committing config change with OpId 2.30: config changed from index 29 to 30, NON_VOTER b60550c4a01042218d18cadc590fa17b (127.29.26.131) added. New config: { opid_index: 30 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } } peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: NON_VOTER last_known_addr { host: "127.29.26.129" port: 40199 } attrs { promote: true } } peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: NON_VOTER last_known_addr { host: "127.29.26.131" port: 39705 } attrs { promote: true } } }
W20251212 09:11:11.559361 671 consensus_peers.cc:597] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c -> Peer 80177290eb56466ebaaf95df99767fdb (127.29.26.129:40199): Couldn't send request to peer 80177290eb56466ebaaf95df99767fdb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b4f3768383a458a9248f72eb53f3845. This is attempt 1: this message will repeat every 5th retry.
I20251212 09:11:11.559547 440 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 6b4f3768383a458a9248f72eb53f3845 with cas_config_opid_index 29: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 3)
I20251212 09:11:11.559670 455 catalog_manager.cc:5654] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c reported cstate change: config changed from index 29 to 30, NON_VOTER b60550c4a01042218d18cadc590fa17b (127.29.26.131) added. New cstate: current_term: 2 leader_uuid: "a966ff4894cf448a86861726787df12c" committed_config { opid_index: 30 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: NON_VOTER last_known_addr { host: "127.29.26.129" port: 40199 } attrs { promote: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: NON_VOTER last_known_addr { host: "127.29.26.131" port: 39705 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251212 09:11:11.561165 29802 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251212 09:11:11.561677 29802 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251212 09:11:11.562140 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 80177290eb56466ebaaf95df99767fdb to finish bootstrapping
W20251212 09:11:11.562517 670 consensus_peers.cc:597] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c -> Peer b60550c4a01042218d18cadc590fa17b (127.29.26.131:39705): Couldn't send request to peer b60550c4a01042218d18cadc590fa17b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b4f3768383a458a9248f72eb53f3845. This is attempt 1: this message will repeat every 5th retry.
I20251212 09:11:11.565070 596 consensus_queue.cc:237] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 12, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } } peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: NON_VOTER last_known_addr { host: "127.29.26.130" port: 45443 } attrs { promote: true } } peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: NON_VOTER last_known_addr { host: "127.29.26.131" port: 39705 } attrs { promote: true } }
I20251212 09:11:11.565409 648 raft_consensus.cc:2955] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb [term 2 LEADER]: Committing config change with OpId 2.15: config changed from index 14 to 15, NON_VOTER b60550c4a01042218d18cadc590fa17b (127.29.26.131) added. New config: { opid_index: 15 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } } peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: NON_VOTER last_known_addr { host: "127.29.26.130" port: 45443 } attrs { promote: true } } peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: NON_VOTER last_known_addr { host: "127.29.26.131" port: 39705 } attrs { promote: true } } }
I20251212 09:11:11.565901 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver a966ff4894cf448a86861726787df12c to finish bootstrapping
I20251212 09:11:11.566263 440 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a3c5f1aefb684092bad686c9446aa016 with cas_config_opid_index 14: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 2)
W20251212 09:11:11.566386 530 consensus_peers.cc:597] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb -> Peer a966ff4894cf448a86861726787df12c (127.29.26.130:45443): Couldn't send request to peer a966ff4894cf448a86861726787df12c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a3c5f1aefb684092bad686c9446aa016. This is attempt 1: this message will repeat every 5th retry.
I20251212 09:11:11.566489 455 catalog_manager.cc:5654] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb reported cstate change: config changed from index 14 to 15, NON_VOTER b60550c4a01042218d18cadc590fa17b (127.29.26.131) added. New cstate: current_term: 2 leader_uuid: "80177290eb56466ebaaf95df99767fdb" committed_config { opid_index: 15 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: NON_VOTER last_known_addr { host: "127.29.26.130" port: 45443 } attrs { promote: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: NON_VOTER last_known_addr { host: "127.29.26.131" port: 39705 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20251212 09:11:11.568849 529 consensus_peers.cc:597] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb -> Peer b60550c4a01042218d18cadc590fa17b (127.29.26.131:39705): Couldn't send request to peer b60550c4a01042218d18cadc590fa17b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a3c5f1aefb684092bad686c9446aa016. This is attempt 1: this message will repeat every 5th retry.
I20251212 09:11:11.569347 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver b60550c4a01042218d18cadc590fa17b to finish bootstrapping
I20251212 09:11:11.597690 860 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251212 09:11:11.597708 570 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251212 09:11:11.598320 717 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
e4af916219b24e4e8c6836b7b59574fa | 127.29.26.190:44373 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.29.26.148:41675 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
80177290eb56466ebaaf95df99767fdb | 127.29.26.129:40199 | HEALTHY | <none> | 1 | 0
a966ff4894cf448a86861726787df12c | 127.29.26.130:45443 | HEALTHY | <none> | 1 | 0
b60550c4a01042218d18cadc590fa17b | 127.29.26.131:39705 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.29.26.129 | experimental | 127.29.26.129:40199
local_ip_for_outbound_sockets | 127.29.26.130 | experimental | 127.29.26.130:45443
local_ip_for_outbound_sockets | 127.29.26.131 | experimental | 127.29.26.131:39705
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.29.26.129:40199
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.29.26.130:45443
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.29.26.131:39705
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.29.26.148:41675 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
TestTable1 | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
TestTable2 | 1 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 2
First Quartile | 2
Median | 2
Third Quartile | 3
Maximum | 3
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 3
Tablets | 3
Replicas | 7
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20251212 09:11:11.609606 29802 log_verifier.cc:126] Checking tablet 14c8ab47f11d406795b21b6e885daa19
I20251212 09:11:11.616043 29802 log_verifier.cc:177] Verified matching terms for 14 ops in tablet 14c8ab47f11d406795b21b6e885daa19
I20251212 09:11:11.616110 29802 log_verifier.cc:126] Checking tablet 6b4f3768383a458a9248f72eb53f3845
I20251212 09:11:11.622879 29802 log_verifier.cc:177] Verified matching terms for 30 ops in tablet 6b4f3768383a458a9248f72eb53f3845
I20251212 09:11:11.623040 29802 log_verifier.cc:126] Checking tablet a3c5f1aefb684092bad686c9446aa016
I20251212 09:11:11.628394 29802 log_verifier.cc:177] Verified matching terms for 15 ops in tablet a3c5f1aefb684092bad686c9446aa016
I20251212 09:11:11.628499 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 423
I20251212 09:11:11.634272 29802 minidump.cc:252] Setting minidump size limit to 20M
I20251212 09:11:11.634507 29802 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:11.634634 29802 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:11.636970 967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:11.637070 964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:11.636976 965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:11.637202 29802 server_base.cc:1047] running on GCE node
I20251212 09:11:11.637416 29802 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251212 09:11:11.637455 29802 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251212 09:11:11.637490 29802 hybrid_clock.cc:648] HybridClock initialized: now 1765530671637490 us; error 0 us; skew 500 ppm
I20251212 09:11:11.638260 29802 webserver.cc:492] Webserver started at http://0.0.0.0:40055/ using document root <none> and password file <none>
I20251212 09:11:11.638427 29802 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:11.638463 29802 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:11.639146 29802 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:11.639724 972 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:11.639904 29802 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:11.639995 29802 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
uuid: "e4af916219b24e4e8c6836b7b59574fa"
format_stamp: "Formatted at 2025-12-12 09:11:10 on dist-test-slave-qqr7"
I20251212 09:11:11.640197 29802 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:11.646099 29802 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:11.646272 29802 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:11.646359 29802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:11.647100 29802 sys_catalog.cc:263] Verifying existing consensus state
W20251212 09:11:11.647389 29802 sys_catalog.cc:243] For a single master config, on-disk Raft master: 127.29.26.190:44373 exists but no master address supplied!
I20251212 09:11:11.647883 29802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa: Bootstrap starting.
I20251212 09:11:11.654625 29802 log.cc:826] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:11.657284 29802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=13 ignored=0} mutations{seen=17 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251212 09:11:11.657527 29802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa: Bootstrap complete.
I20251212 09:11:11.659194 29802 raft_consensus.cc:359] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } }
I20251212 09:11:11.659315 29802 raft_consensus.cc:740] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4af916219b24e4e8c6836b7b59574fa, State: Initialized, Role: FOLLOWER
I20251212 09:11:11.659407 29802 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 3.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } }
I20251212 09:11:11.659483 29802 raft_consensus.cc:399] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 3 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:11.659519 29802 raft_consensus.cc:493] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 3 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:11.659554 29802 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 3 FOLLOWER]: Advancing to term 4
I20251212 09:11:11.660334 29802 raft_consensus.cc:515] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } }
I20251212 09:11:11.660422 29802 leader_election.cc:304] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4af916219b24e4e8c6836b7b59574fa; no voters:
I20251212 09:11:11.660585 29802 leader_election.cc:290] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [CANDIDATE]: Term 4 election: Requested vote from peers
I20251212 09:11:11.660647 979 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 4 FOLLOWER]: Leader election won for term 4
I20251212 09:11:11.660815 979 raft_consensus.cc:697] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 4 LEADER]: Becoming Leader. State: Replica: e4af916219b24e4e8c6836b7b59574fa, State: Running, Role: LEADER
I20251212 09:11:11.660892 979 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 3.26, Last appended by leader: 26, Current term: 4, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } }
I20251212 09:11:11.661173 981 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4af916219b24e4e8c6836b7b59574fa. Latest consensus state: current_term: 4 leader_uuid: "e4af916219b24e4e8c6836b7b59574fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } } }
I20251212 09:11:11.661154 980 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 leader_uuid: "e4af916219b24e4e8c6836b7b59574fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4af916219b24e4e8c6836b7b59574fa" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 44373 } } }
I20251212 09:11:11.661274 981 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:11.661320 980 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:11.662786 29802 tablet_replica.cc:333] stopping tablet replica
I20251212 09:11:11.662858 29802 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 4 LEADER]: Raft consensus shutting down.
I20251212 09:11:11.662905 29802 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e4af916219b24e4e8c6836b7b59574fa [term 4 FOLLOWER]: Raft consensus is shut down!
I20251212 09:11:11.663209 29802 master.cc:561] Master@0.0.0.0:7051 shutting down...
W20251212 09:11:11.663352 29802 acceptor_pool.cc:194] Could not shut down acceptor socket on 0.0.0.0:7051: Network error: shutdown error: Transport endpoint is not connected (error 107)
I20251212 09:11:11.664240 29802 master.cc:583] Master@0.0.0.0:7051 shutdown complete.
I20251212 09:11:11.993052 1029 ts_tablet_manager.cc:933] T a3c5f1aefb684092bad686c9446aa016 P b60550c4a01042218d18cadc590fa17b: Initiating tablet copy from peer 80177290eb56466ebaaf95df99767fdb (127.29.26.129:40199)
I20251212 09:11:11.993296 1029 tablet_copy_client.cc:323] T a3c5f1aefb684092bad686c9446aa016 P b60550c4a01042218d18cadc590fa17b: tablet copy: Beginning tablet copy session from remote peer at address 127.29.26.129:40199
I20251212 09:11:11.996400 606 tablet_copy_service.cc:140] P 80177290eb56466ebaaf95df99767fdb: Received BeginTabletCopySession request for tablet a3c5f1aefb684092bad686c9446aa016 from peer b60550c4a01042218d18cadc590fa17b ({username='slave'} at 127.29.26.131:54709)
I20251212 09:11:11.996476 606 tablet_copy_service.cc:161] P 80177290eb56466ebaaf95df99767fdb: Beginning new tablet copy session on tablet a3c5f1aefb684092bad686c9446aa016 from peer b60550c4a01042218d18cadc590fa17b at {username='slave'} at 127.29.26.131:54709: session id = b60550c4a01042218d18cadc590fa17b-a3c5f1aefb684092bad686c9446aa016
I20251212 09:11:11.997059 606 tablet_copy_source_session.cc:215] T a3c5f1aefb684092bad686c9446aa016 P 80177290eb56466ebaaf95df99767fdb: Tablet Copy: opened 0 blocks and 1 log segments
I20251212 09:11:11.997701 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3c5f1aefb684092bad686c9446aa016. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:11.998947 1029 tablet_copy_client.cc:806] T a3c5f1aefb684092bad686c9446aa016 P b60550c4a01042218d18cadc590fa17b: tablet copy: Starting download of 0 data blocks...
I20251212 09:11:11.999085 1029 tablet_copy_client.cc:670] T a3c5f1aefb684092bad686c9446aa016 P b60550c4a01042218d18cadc590fa17b: tablet copy: Starting download of 1 WAL segments...
I20251212 09:11:12.000057 1029 tablet_copy_client.cc:538] T a3c5f1aefb684092bad686c9446aa016 P b60550c4a01042218d18cadc590fa17b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251212 09:11:12.000630 1029 tablet_bootstrap.cc:492] T a3c5f1aefb684092bad686c9446aa016 P b60550c4a01042218d18cadc590fa17b: Bootstrap starting.
I20251212 09:11:12.003535 1029 tablet_bootstrap.cc:492] T a3c5f1aefb684092bad686c9446aa016 P b60550c4a01042218d18cadc590fa17b: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251212 09:11:12.003743 1029 tablet_bootstrap.cc:492] T a3c5f1aefb684092bad686c9446aa016 P b60550c4a01042218d18cadc590fa17b: Bootstrap complete.
I20251212 09:11:12.003858 1029 ts_tablet_manager.cc:1403] T a3c5f1aefb684092bad686c9446aa016 P b60550c4a01042218d18cadc590fa17b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251212 09:11:12.004004 1029 raft_consensus.cc:359] T a3c5f1aefb684092bad686c9446aa016 P b60550c4a01042218d18cadc590fa17b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } } peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: NON_VOTER last_known_addr { host: "127.29.26.130" port: 45443 } attrs { promote: true } } peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: NON_VOTER last_known_addr { host: "127.29.26.131" port: 39705 } attrs { promote: true } }
I20251212 09:11:12.004061 1029 raft_consensus.cc:740] T a3c5f1aefb684092bad686c9446aa016 P b60550c4a01042218d18cadc590fa17b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b60550c4a01042218d18cadc590fa17b, State: Initialized, Role: LEARNER
I20251212 09:11:12.004099 1029 consensus_queue.cc:260] T a3c5f1aefb684092bad686c9446aa016 P b60550c4a01042218d18cadc590fa17b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 2.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: true peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 40199 } } peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: NON_VOTER last_known_addr { host: "127.29.26.130" port: 45443 } attrs { promote: true } } peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: NON_VOTER last_known_addr { host: "127.29.26.131" port: 39705 } attrs { promote: true } }
I20251212 09:11:12.004189 1029 ts_tablet_manager.cc:1434] T a3c5f1aefb684092bad686c9446aa016 P b60550c4a01042218d18cadc590fa17b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.004456 606 tablet_copy_service.cc:342] P 80177290eb56466ebaaf95df99767fdb: Request end of tablet copy session b60550c4a01042218d18cadc590fa17b-a3c5f1aefb684092bad686c9446aa016 received from {username='slave'} at 127.29.26.131:54709
I20251212 09:11:12.004542 606 tablet_copy_service.cc:434] P 80177290eb56466ebaaf95df99767fdb: ending tablet copy session b60550c4a01042218d18cadc590fa17b-a3c5f1aefb684092bad686c9446aa016 on tablet a3c5f1aefb684092bad686c9446aa016 with peer b60550c4a01042218d18cadc590fa17b
W20251212 09:11:12.004607 927 heartbeater.cc:646] Failed to heartbeat to 127.29.26.190:44373 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.26.190:44373: connect: Connection refused (error 111)
I20251212 09:11:12.018898 1029 ts_tablet_manager.cc:933] T 6b4f3768383a458a9248f72eb53f3845 P b60550c4a01042218d18cadc590fa17b: Initiating tablet copy from peer a966ff4894cf448a86861726787df12c (127.29.26.130:45443)
I20251212 09:11:12.019176 1029 tablet_copy_client.cc:323] T 6b4f3768383a458a9248f72eb53f3845 P b60550c4a01042218d18cadc590fa17b: tablet copy: Beginning tablet copy session from remote peer at address 127.29.26.130:45443
I20251212 09:11:12.021673 757 tablet_copy_service.cc:140] P a966ff4894cf448a86861726787df12c: Received BeginTabletCopySession request for tablet 6b4f3768383a458a9248f72eb53f3845 from peer b60550c4a01042218d18cadc590fa17b ({username='slave'} at 127.29.26.131:56007)
I20251212 09:11:12.021746 757 tablet_copy_service.cc:161] P a966ff4894cf448a86861726787df12c: Beginning new tablet copy session on tablet 6b4f3768383a458a9248f72eb53f3845 from peer b60550c4a01042218d18cadc590fa17b at {username='slave'} at 127.29.26.131:56007: session id = b60550c4a01042218d18cadc590fa17b-6b4f3768383a458a9248f72eb53f3845
I20251212 09:11:12.022210 757 tablet_copy_source_session.cc:215] T 6b4f3768383a458a9248f72eb53f3845 P a966ff4894cf448a86861726787df12c: Tablet Copy: opened 0 blocks and 1 log segments
I20251212 09:11:12.022686 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b4f3768383a458a9248f72eb53f3845. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:12.023916 1029 tablet_copy_client.cc:806] T 6b4f3768383a458a9248f72eb53f3845 P b60550c4a01042218d18cadc590fa17b: tablet copy: Starting download of 0 data blocks...
I20251212 09:11:12.024075 1029 tablet_copy_client.cc:670] T 6b4f3768383a458a9248f72eb53f3845 P b60550c4a01042218d18cadc590fa17b: tablet copy: Starting download of 1 WAL segments...
I20251212 09:11:12.024948 1029 tablet_copy_client.cc:538] T 6b4f3768383a458a9248f72eb53f3845 P b60550c4a01042218d18cadc590fa17b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251212 09:11:12.025666 1029 tablet_bootstrap.cc:492] T 6b4f3768383a458a9248f72eb53f3845 P b60550c4a01042218d18cadc590fa17b: Bootstrap starting.
I20251212 09:11:12.033957 1029 tablet_bootstrap.cc:492] T 6b4f3768383a458a9248f72eb53f3845 P b60550c4a01042218d18cadc590fa17b: Bootstrap replayed 1/1 log segments. Stats: ops{read=30 overwritten=0 applied=30 ignored=0} inserts{seen=1300 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251212 09:11:12.034173 1029 tablet_bootstrap.cc:492] T 6b4f3768383a458a9248f72eb53f3845 P b60550c4a01042218d18cadc590fa17b: Bootstrap complete.
I20251212 09:11:12.034277 1029 ts_tablet_manager.cc:1403] T 6b4f3768383a458a9248f72eb53f3845 P b60550c4a01042218d18cadc590fa17b: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20251212 09:11:12.034420 1029 raft_consensus.cc:359] T 6b4f3768383a458a9248f72eb53f3845 P b60550c4a01042218d18cadc590fa17b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 30 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } } peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: NON_VOTER last_known_addr { host: "127.29.26.129" port: 40199 } attrs { promote: true } } peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: NON_VOTER last_known_addr { host: "127.29.26.131" port: 39705 } attrs { promote: true } }
I20251212 09:11:12.034489 1029 raft_consensus.cc:740] T 6b4f3768383a458a9248f72eb53f3845 P b60550c4a01042218d18cadc590fa17b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b60550c4a01042218d18cadc590fa17b, State: Initialized, Role: LEARNER
I20251212 09:11:12.034535 1029 consensus_queue.cc:260] T 6b4f3768383a458a9248f72eb53f3845 P b60550c4a01042218d18cadc590fa17b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 30, Last appended: 2.30, Last appended by leader: 30, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 30 OBSOLETE_local: true peers { permanent_uuid: "a966ff4894cf448a86861726787df12c" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 45443 } } peers { permanent_uuid: "80177290eb56466ebaaf95df99767fdb" member_type: NON_VOTER last_known_addr { host: "127.29.26.129" port: 40199 } attrs { promote: true } } peers { permanent_uuid: "b60550c4a01042218d18cadc590fa17b" member_type: NON_VOTER last_known_addr { host: "127.29.26.131" port: 39705 } attrs { promote: true } }
I20251212 09:11:12.034633 1029 ts_tablet_manager.cc:1434] T 6b4f3768383a458a9248f72eb53f3845 P b60550c4a01042218d18cadc590fa17b: Time spent starting tablet: real 0.000s user 0.002s sys 0.000s
I20251212 09:11:12.034920 757 tablet_copy_service.cc:342] P a966ff4894cf448a86861726787df12c: Request end of tablet copy session b60550c4a01042218d18cadc590fa17b-6b4f3768383a458a9248f72eb53f3845 received from {username='slave'} at 127.29.26.131:56007
I20251212 09:11:12.035001 757 tablet_copy_service.cc:434] P a966ff4894cf448a86861726787df12c: ending tablet copy session b60550c4a01042218d18cadc590fa17b-6b4f3768383a458a9248f72eb53f3845 on tablet 6b4f3768383a458a9248f72eb53f3845 with peer b60550c4a01042218d18cadc590fa17b
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tools/kudu-admin-test.cc:3916: Failure
Value of: stdout2
Expected: has substring "Rebuilt from 3 replicas, of which 0 had errors"
Actual: "Rebuild Report\nTablet Servers\n address | status\n---------------------+--------\n 127.29.26.129:40199 | OK\n 127.29.26.130:45443 | OK\n 127.29.26.131:39705 | OK\nRebuilt from 3 tablet servers, of which 0 had errors\n\nReplicas\n table | tablet | tablet server | status\n-----------+----------------------------------+---------------------+--------\n TestTable | 6b4f3768383a458a9248f72eb53f3845 | 127.29.26.130:45443 | OK\nRebuilt from 1 replicas, of which 0 had errors\n"
I20251212 09:11:12.054261 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 493
I20251212 09:11:12.059195 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 647
I20251212 09:11:12.064179 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 787
2025-12-12T09:11:12Z chronyd exiting
I20251212 09:11:12.079960 29802 test_util.cc:183] -----------------------------------------------
I20251212 09:11:12.080034 29802 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.AdminCliTest.TestRebuildTables.1765530660439309-29802-0
[ FAILED ] AdminCliTest.TestRebuildTables (2118 ms)
[----------] 5 tests from AdminCliTest (11636 ms total)
[----------] 1 test from EnableKudu1097AndDownTS/MoveTabletParamTest
[ RUN ] EnableKudu1097AndDownTS/MoveTabletParamTest.Test/4
I20251212 09:11:12.080487 29802 test_util.cc:276] Using random seed: -1534286236
I20251212 09:11:12.081064 29802 ts_itest-base.cc:115] Starting cluster with:
I20251212 09:11:12.081101 29802 ts_itest-base.cc:116] --------------
I20251212 09:11:12.081122 29802 ts_itest-base.cc:117] 5 tablet servers
I20251212 09:11:12.081138 29802 ts_itest-base.cc:118] 3 replicas per TS
I20251212 09:11:12.081175 29802 ts_itest-base.cc:119] --------------
2025-12-12T09:11:12Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-12T09:11:12Z Disabled control of system clock
I20251212 09:11:12.087914 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:39727
--webserver_interface=127.29.26.190
--webserver_port=0
--builtin_ntp_servers=127.29.26.148:46161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.26.190:39727
--raft_prepare_replacement_before_eviction=true with env {}
W20251212 09:11:12.162925 1041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:12.163100 1041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:12.163143 1041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:12.164450 1041 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251212 09:11:12.164491 1041 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251212 09:11:12.164515 1041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:12.164533 1041 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251212 09:11:12.164553 1041 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251212 09:11:12.166136 1041 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:46161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.26.190:39727
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:39727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.29.26.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.1041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:12.166363 1041 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:12.166596 1041 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:12.168934 1046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:12.168934 1047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:12.169000 1049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:12.169257 1041 server_base.cc:1047] running on GCE node
I20251212 09:11:12.169466 1041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:12.169658 1041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:12.170792 1041 hybrid_clock.cc:648] HybridClock initialized: now 1765530672170775 us; error 34 us; skew 500 ppm
I20251212 09:11:12.171892 1041 webserver.cc:492] Webserver started at http://127.29.26.190:39441/ using document root <none> and password file <none>
I20251212 09:11:12.172109 1041 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:12.172149 1041 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:12.172247 1041 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:12.173123 1041 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "e2861f47fa154982ae79d7981f13198c"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.173417 1041 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "e2861f47fa154982ae79d7981f13198c"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.174556 1041 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251212 09:11:12.175207 1055 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.175361 1041 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:12.175432 1041 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
uuid: "e2861f47fa154982ae79d7981f13198c"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.175493 1041 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:12.189961 1041 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:12.190229 1041 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:12.190347 1041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:12.193931 1041 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.190:39727
I20251212 09:11:12.193961 1108 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.190:39727 every 8 connection(s)
I20251212 09:11:12.194276 1041 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251212 09:11:12.194854 1109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:12.197019 1109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c: Bootstrap starting.
I20251212 09:11:12.197576 1109 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:12.197824 1109 log.cc:826] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:12.198402 1109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c: No bootstrap required, opened a new log
I20251212 09:11:12.199551 1109 raft_consensus.cc:359] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2861f47fa154982ae79d7981f13198c" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 39727 } }
I20251212 09:11:12.199666 1109 raft_consensus.cc:385] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:12.199687 1109 raft_consensus.cc:740] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2861f47fa154982ae79d7981f13198c, State: Initialized, Role: FOLLOWER
I20251212 09:11:12.199810 1109 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2861f47fa154982ae79d7981f13198c" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 39727 } }
I20251212 09:11:12.199865 1109 raft_consensus.cc:399] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:12.199887 1109 raft_consensus.cc:493] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:12.199937 1109 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:12.200420 1109 raft_consensus.cc:515] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2861f47fa154982ae79d7981f13198c" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 39727 } }
I20251212 09:11:12.200510 1109 leader_election.cc:304] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2861f47fa154982ae79d7981f13198c; no voters:
I20251212 09:11:12.200680 1109 leader_election.cc:290] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [CANDIDATE]: Term 1 election: Requested vote from peers
I20251212 09:11:12.200783 1112 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:12.200910 1109 sys_catalog.cc:565] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [sys.catalog]: configured and running, proceeding with master startup.
I20251212 09:11:12.200978 1112 raft_consensus.cc:697] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [term 1 LEADER]: Becoming Leader. State: Replica: e2861f47fa154982ae79d7981f13198c, State: Running, Role: LEADER
I20251212 09:11:12.201117 1112 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2861f47fa154982ae79d7981f13198c" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 39727 } }
I20251212 09:11:12.201470 1113 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2861f47fa154982ae79d7981f13198c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2861f47fa154982ae79d7981f13198c" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 39727 } } }
I20251212 09:11:12.201453 1114 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2861f47fa154982ae79d7981f13198c. Latest consensus state: current_term: 1 leader_uuid: "e2861f47fa154982ae79d7981f13198c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2861f47fa154982ae79d7981f13198c" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 39727 } } }
I20251212 09:11:12.201548 1113 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:12.201555 1114 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:12.201601 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 1041
I20251212 09:11:12.201704 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal/instance
W20251212 09:11:12.203379 1130 catalog_manager.cc:1568] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251212 09:11:12.203435 1130 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251212 09:11:12.203476 1117 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251212 09:11:12.203857 1117 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251212 09:11:12.205101 1117 catalog_manager.cc:1357] Generated new cluster ID: 90addb4fc342436d81e571edc6dc2410
I20251212 09:11:12.205145 1117 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251212 09:11:12.230412 1117 catalog_manager.cc:1380] Generated new certificate authority record
I20251212 09:11:12.230983 1117 catalog_manager.cc:1514] Loading token signing keys...
I20251212 09:11:12.236783 1117 catalog_manager.cc:6027] T 00000000000000000000000000000000 P e2861f47fa154982ae79d7981f13198c: Generated new TSK 0
I20251212 09:11:12.236948 1117 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251212 09:11:12.241124 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.129:0
--local_ip_for_outbound_sockets=127.29.26.129
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39727
--builtin_ntp_servers=127.29.26.148:46161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20251212 09:11:12.318888 1133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:12.319046 1133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:12.319077 1133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:12.320461 1133 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251212 09:11:12.320503 1133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:12.320552 1133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.129
I20251212 09:11:12.322003 1133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:46161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39727
--never_fsync=true
--heap_profile_path=/tmp/kudu.1133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.129
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:12.322225 1133 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:12.322430 1133 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:12.324860 1139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:12.324900 1138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:12.325048 1133 server_base.cc:1047] running on GCE node
W20251212 09:11:12.324877 1141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:12.325289 1133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:12.325482 1133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:12.326642 1133 hybrid_clock.cc:648] HybridClock initialized: now 1765530672326632 us; error 36 us; skew 500 ppm
I20251212 09:11:12.327832 1133 webserver.cc:492] Webserver started at http://127.29.26.129:38987/ using document root <none> and password file <none>
I20251212 09:11:12.328027 1133 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:12.328073 1133 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:12.328202 1133 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:12.329015 1133 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "25f8c778d44e44d192307575a73f6047"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.329334 1133 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "25f8c778d44e44d192307575a73f6047"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.330552 1133 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251212 09:11:12.331331 1147 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.331508 1133 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:12.331580 1133 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "25f8c778d44e44d192307575a73f6047"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.331635 1133 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:12.341786 1133 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:12.341990 1133 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:12.342097 1133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:12.342284 1133 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:12.342566 1133 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:12.342597 1133 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.342629 1133 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:12.342657 1133 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.348047 1133 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.129:37973
I20251212 09:11:12.348102 1262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.129:37973 every 8 connection(s)
I20251212 09:11:12.348376 1133 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251212 09:11:12.353256 1263 heartbeater.cc:344] Connected to a master server at 127.29.26.190:39727
I20251212 09:11:12.353354 1263 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:12.353540 1263 heartbeater.cc:507] Master 127.29.26.190:39727 requested a full tablet report, sending...
I20251212 09:11:12.353955 1072 ts_manager.cc:194] Registered new tserver with Master: 25f8c778d44e44d192307575a73f6047 (127.29.26.129:37973)
I20251212 09:11:12.354605 1072 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.129:48455
I20251212 09:11:12.355741 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 1133
I20251212 09:11:12.355803 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251212 09:11:12.356880 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.130:0
--local_ip_for_outbound_sockets=127.29.26.130
--webserver_interface=127.29.26.130
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39727
--builtin_ntp_servers=127.29.26.148:46161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20251212 09:11:12.435913 1266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:12.436065 1266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:12.436084 1266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:12.437430 1266 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251212 09:11:12.437467 1266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:12.437490 1266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.130
I20251212 09:11:12.438890 1266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:46161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.29.26.130
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39727
--never_fsync=true
--heap_profile_path=/tmp/kudu.1266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.130
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:12.439069 1266 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:12.439249 1266 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:12.441679 1272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:12.441700 1271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:12.441694 1274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:12.442040 1266 server_base.cc:1047] running on GCE node
I20251212 09:11:12.442217 1266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:12.442420 1266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:12.443552 1266 hybrid_clock.cc:648] HybridClock initialized: now 1765530672443537 us; error 29 us; skew 500 ppm
I20251212 09:11:12.444684 1266 webserver.cc:492] Webserver started at http://127.29.26.130:42019/ using document root <none> and password file <none>
I20251212 09:11:12.444881 1266 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:12.444938 1266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:12.445056 1266 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:12.445879 1266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "bec4590d2f9844f68d1885faf5989f2e"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.446179 1266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "bec4590d2f9844f68d1885faf5989f2e"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.447319 1266 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251212 09:11:12.448027 1280 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.448195 1266 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:12.448266 1266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "bec4590d2f9844f68d1885faf5989f2e"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.448326 1266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:12.474416 1266 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:12.474673 1266 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:12.474782 1266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:12.474999 1266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:12.475328 1266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:12.475361 1266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.475399 1266 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:12.475426 1266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.480722 1266 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.130:43659
I20251212 09:11:12.480809 1393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.130:43659 every 8 connection(s)
I20251212 09:11:12.481063 1266 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20251212 09:11:12.481758 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 1266
I20251212 09:11:12.481846 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20251212 09:11:12.483026 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.131:0
--local_ip_for_outbound_sockets=127.29.26.131
--webserver_interface=127.29.26.131
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39727
--builtin_ntp_servers=127.29.26.148:46161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20251212 09:11:12.485561 1394 heartbeater.cc:344] Connected to a master server at 127.29.26.190:39727
I20251212 09:11:12.485653 1394 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:12.485841 1394 heartbeater.cc:507] Master 127.29.26.190:39727 requested a full tablet report, sending...
I20251212 09:11:12.486191 1072 ts_manager.cc:194] Registered new tserver with Master: bec4590d2f9844f68d1885faf5989f2e (127.29.26.130:43659)
I20251212 09:11:12.486778 1072 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.130:35743
W20251212 09:11:12.559309 1397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:12.559484 1397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:12.559502 1397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:12.560883 1397 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251212 09:11:12.560922 1397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:12.560943 1397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.131
I20251212 09:11:12.562364 1397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:46161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.29.26.131
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39727
--never_fsync=true
--heap_profile_path=/tmp/kudu.1397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.131
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:12.562516 1397 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:12.562692 1397 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:12.565141 1406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:12.565167 1403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:12.565173 1404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:12.565235 1397 server_base.cc:1047] running on GCE node
I20251212 09:11:12.565541 1397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:12.565778 1397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:12.566906 1397 hybrid_clock.cc:648] HybridClock initialized: now 1765530672566897 us; error 31 us; skew 500 ppm
I20251212 09:11:12.568091 1397 webserver.cc:492] Webserver started at http://127.29.26.131:33187/ using document root <none> and password file <none>
I20251212 09:11:12.568272 1397 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:12.568315 1397 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:12.568423 1397 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:12.569257 1397 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "57d28858c7aa4de69605c7b8c98320d5"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.569567 1397 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "57d28858c7aa4de69605c7b8c98320d5"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.570678 1397 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251212 09:11:12.571419 1412 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.571616 1397 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:12.571702 1397 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "57d28858c7aa4de69605c7b8c98320d5"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.571761 1397 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:12.581465 1397 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:12.581665 1397 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:12.581771 1397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:12.581951 1397 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:12.582243 1397 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:12.582274 1397 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.582307 1397 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:12.582340 1397 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.587505 1397 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.131:41321
I20251212 09:11:12.587569 1526 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.131:41321 every 8 connection(s)
I20251212 09:11:12.587816 1397 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20251212 09:11:12.588093 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 1397
I20251212 09:11:12.588186 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20251212 09:11:12.589504 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.132:0
--local_ip_for_outbound_sockets=127.29.26.132
--webserver_interface=127.29.26.132
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39727
--builtin_ntp_servers=127.29.26.148:46161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20251212 09:11:12.592868 1527 heartbeater.cc:344] Connected to a master server at 127.29.26.190:39727
I20251212 09:11:12.592980 1527 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:12.593178 1527 heartbeater.cc:507] Master 127.29.26.190:39727 requested a full tablet report, sending...
I20251212 09:11:12.593533 1072 ts_manager.cc:194] Registered new tserver with Master: 57d28858c7aa4de69605c7b8c98320d5 (127.29.26.131:41321)
I20251212 09:11:12.594082 1072 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.131:40849
W20251212 09:11:12.666021 1530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:12.666168 1530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:12.666188 1530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:12.667518 1530 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251212 09:11:12.667554 1530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:12.667577 1530 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.132
I20251212 09:11:12.668985 1530 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:46161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.29.26.132
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39727
--never_fsync=true
--heap_profile_path=/tmp/kudu.1530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.132
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:12.669154 1530 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:12.669335 1530 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:12.671649 1535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:12.671664 1536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:12.671844 1530 server_base.cc:1047] running on GCE node
W20251212 09:11:12.671844 1538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:12.672061 1530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:12.672255 1530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:12.673382 1530 hybrid_clock.cc:648] HybridClock initialized: now 1765530672673372 us; error 23 us; skew 500 ppm
I20251212 09:11:12.674471 1530 webserver.cc:492] Webserver started at http://127.29.26.132:39801/ using document root <none> and password file <none>
I20251212 09:11:12.674664 1530 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:12.674710 1530 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:12.674823 1530 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:12.675702 1530 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "53367de394504ec0a951077019beda7d"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.675990 1530 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "53367de394504ec0a951077019beda7d"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.677175 1530 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20251212 09:11:12.677857 1544 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.678041 1530 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:12.678114 1530 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "53367de394504ec0a951077019beda7d"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.678174 1530 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:12.695276 1530 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:12.695572 1530 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:12.695680 1530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:12.695878 1530 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:12.696177 1530 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:12.696208 1530 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.696245 1530 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:12.696276 1530 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.701716 1530 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.132:38163
I20251212 09:11:12.701769 1658 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.132:38163 every 8 connection(s)
I20251212 09:11:12.702104 1530 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20251212 09:11:12.704548 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 1530
I20251212 09:11:12.704677 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20251212 09:11:12.705863 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.133:0
--local_ip_for_outbound_sockets=127.29.26.133
--webserver_interface=127.29.26.133
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39727
--builtin_ntp_servers=127.29.26.148:46161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20251212 09:11:12.706558 1659 heartbeater.cc:344] Connected to a master server at 127.29.26.190:39727
I20251212 09:11:12.706650 1659 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:12.706851 1659 heartbeater.cc:507] Master 127.29.26.190:39727 requested a full tablet report, sending...
I20251212 09:11:12.707175 1072 ts_manager.cc:194] Registered new tserver with Master: 53367de394504ec0a951077019beda7d (127.29.26.132:38163)
I20251212 09:11:12.707682 1072 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.132:37191
W20251212 09:11:12.783541 1662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:12.783692 1662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:12.783711 1662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:12.785096 1662 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20251212 09:11:12.785135 1662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:12.785157 1662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.133
I20251212 09:11:12.786540 1662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:46161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.133:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.29.26.133
--webserver_port=0
--tserver_master_addrs=127.29.26.190:39727
--never_fsync=true
--heap_profile_path=/tmp/kudu.1662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.133
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:12.786696 1662 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:12.786865 1662 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:12.789281 1668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:12.789279 1667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:12.789314 1670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:12.789496 1662 server_base.cc:1047] running on GCE node
I20251212 09:11:12.789691 1662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:12.789878 1662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:12.791010 1662 hybrid_clock.cc:648] HybridClock initialized: now 1765530672790995 us; error 30 us; skew 500 ppm
I20251212 09:11:12.792097 1662 webserver.cc:492] Webserver started at http://127.29.26.133:43027/ using document root <none> and password file <none>
I20251212 09:11:12.792284 1662 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:12.792330 1662 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:12.792435 1662 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:12.793274 1662 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "fb532eb6d77641c39f572aae3b5ca458"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.793569 1662 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "fb532eb6d77641c39f572aae3b5ca458"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.794705 1662 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251212 09:11:12.795341 1676 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.795493 1662 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:12.795557 1662 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "fb532eb6d77641c39f572aae3b5ca458"
format_stamp: "Formatted at 2025-12-12 09:11:12 on dist-test-slave-qqr7"
I20251212 09:11:12.795612 1662 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:12.811641 1662 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:12.811882 1662 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:12.812011 1662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:12.812198 1662 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:12.812640 1662 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:12.812739 1662 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.812777 1662 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:12.812803 1662 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:12.817975 1662 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.133:41385
I20251212 09:11:12.818017 1791 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.133:41385 every 8 connection(s)
I20251212 09:11:12.818289 1662 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20251212 09:11:12.820518 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 1662
I20251212 09:11:12.820597 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.EnableKudu1097AndDownTS_MoveTabletParamTest.Test_4.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20251212 09:11:12.822688 1792 heartbeater.cc:344] Connected to a master server at 127.29.26.190:39727
I20251212 09:11:12.822788 1792 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:12.822957 1792 heartbeater.cc:507] Master 127.29.26.190:39727 requested a full tablet report, sending...
I20251212 09:11:12.823256 1072 ts_manager.cc:194] Registered new tserver with Master: fb532eb6d77641c39f572aae3b5ca458 (127.29.26.133:41385)
I20251212 09:11:12.823571 1072 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.133:34625
I20251212 09:11:12.832451 29802 external_mini_cluster.cc:949] 5 TS(s) registered with all masters
I20251212 09:11:12.837890 1072 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35352:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20251212 09:11:12.845526 1196 tablet_service.cc:1505] Processing CreateTablet for tablet 381560f0b5544b67a5feb27acd70619c (DEFAULT_TABLE table=TestTable [id=db829b73999b4e1dbeccf723cefab559]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:12.845543 1460 tablet_service.cc:1505] Processing CreateTablet for tablet 381560f0b5544b67a5feb27acd70619c (DEFAULT_TABLE table=TestTable [id=db829b73999b4e1dbeccf723cefab559]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:12.845543 1726 tablet_service.cc:1505] Processing CreateTablet for tablet 381560f0b5544b67a5feb27acd70619c (DEFAULT_TABLE table=TestTable [id=db829b73999b4e1dbeccf723cefab559]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:12.845803 1196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381560f0b5544b67a5feb27acd70619c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:12.845804 1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381560f0b5544b67a5feb27acd70619c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:12.845804 1460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381560f0b5544b67a5feb27acd70619c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:12.847781 1809 tablet_bootstrap.cc:492] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047: Bootstrap starting.
I20251212 09:11:12.848416 1809 tablet_bootstrap.cc:654] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:12.848438 1811 tablet_bootstrap.cc:492] T 381560f0b5544b67a5feb27acd70619c P fb532eb6d77641c39f572aae3b5ca458: Bootstrap starting.
I20251212 09:11:12.848767 1809 log.cc:826] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:12.849062 1811 tablet_bootstrap.cc:654] T 381560f0b5544b67a5feb27acd70619c P fb532eb6d77641c39f572aae3b5ca458: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:12.849292 1811 log.cc:826] T 381560f0b5544b67a5feb27acd70619c P fb532eb6d77641c39f572aae3b5ca458: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:12.849416 1809 tablet_bootstrap.cc:492] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047: No bootstrap required, opened a new log
I20251212 09:11:12.849483 1809 ts_tablet_manager.cc:1403] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251212 09:11:12.848276 1810 tablet_bootstrap.cc:492] T 381560f0b5544b67a5feb27acd70619c P 57d28858c7aa4de69605c7b8c98320d5: Bootstrap starting.
I20251212 09:11:12.849875 1811 tablet_bootstrap.cc:492] T 381560f0b5544b67a5feb27acd70619c P fb532eb6d77641c39f572aae3b5ca458: No bootstrap required, opened a new log
I20251212 09:11:12.849946 1811 ts_tablet_manager.cc:1403] T 381560f0b5544b67a5feb27acd70619c P fb532eb6d77641c39f572aae3b5ca458: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251212 09:11:12.850021 1810 tablet_bootstrap.cc:654] T 381560f0b5544b67a5feb27acd70619c P 57d28858c7aa4de69605c7b8c98320d5: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:12.850317 1810 log.cc:826] T 381560f0b5544b67a5feb27acd70619c P 57d28858c7aa4de69605c7b8c98320d5: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:12.850863 1810 tablet_bootstrap.cc:492] T 381560f0b5544b67a5feb27acd70619c P 57d28858c7aa4de69605c7b8c98320d5: No bootstrap required, opened a new log
I20251212 09:11:12.850929 1810 ts_tablet_manager.cc:1403] T 381560f0b5544b67a5feb27acd70619c P 57d28858c7aa4de69605c7b8c98320d5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251212 09:11:12.851060 1809 raft_consensus.cc:359] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25f8c778d44e44d192307575a73f6047" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 37973 } } peers { permanent_uuid: "57d28858c7aa4de69605c7b8c98320d5" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 41321 } } peers { permanent_uuid: "fb532eb6d77641c39f572aae3b5ca458" member_type: VOTER last_known_addr { host: "127.29.26.133" port: 41385 } }
I20251212 09:11:12.851204 1809 raft_consensus.cc:385] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:12.851274 1809 raft_consensus.cc:740] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25f8c778d44e44d192307575a73f6047, State: Initialized, Role: FOLLOWER
I20251212 09:11:12.851451 1809 consensus_queue.cc:260] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25f8c778d44e44d192307575a73f6047" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 37973 } } peers { permanent_uuid: "57d28858c7aa4de69605c7b8c98320d5" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 41321 } } peers { permanent_uuid: "fb532eb6d77641c39f572aae3b5ca458" member_type: VOTER last_known_addr { host: "127.29.26.133" port: 41385 } }
I20251212 09:11:12.851504 1811 raft_consensus.cc:359] T 381560f0b5544b67a5feb27acd70619c P fb532eb6d77641c39f572aae3b5ca458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25f8c778d44e44d192307575a73f6047" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 37973 } } peers { permanent_uuid: "57d28858c7aa4de69605c7b8c98320d5" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 41321 } } peers { permanent_uuid: "fb532eb6d77641c39f572aae3b5ca458" member_type: VOTER last_known_addr { host: "127.29.26.133" port: 41385 } }
I20251212 09:11:12.851704 1811 raft_consensus.cc:385] T 381560f0b5544b67a5feb27acd70619c P fb532eb6d77641c39f572aae3b5ca458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:12.851716 1809 ts_tablet_manager.cc:1434] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251212 09:11:12.851739 1263 heartbeater.cc:499] Master 127.29.26.190:39727 was elected leader, sending a full tablet report...
I20251212 09:11:12.851800 1811 raft_consensus.cc:740] T 381560f0b5544b67a5feb27acd70619c P fb532eb6d77641c39f572aae3b5ca458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb532eb6d77641c39f572aae3b5ca458, State: Initialized, Role: FOLLOWER
I20251212 09:11:12.851892 1811 consensus_queue.cc:260] T 381560f0b5544b67a5feb27acd70619c P fb532eb6d77641c39f572aae3b5ca458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25f8c778d44e44d192307575a73f6047" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 37973 } } peers { permanent_uuid: "57d28858c7aa4de69605c7b8c98320d5" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 41321 } } peers { permanent_uuid: "fb532eb6d77641c39f572aae3b5ca458" member_type: VOTER last_known_addr { host: "127.29.26.133" port: 41385 } }
I20251212 09:11:12.852140 1811 ts_tablet_manager.cc:1434] T 381560f0b5544b67a5feb27acd70619c P fb532eb6d77641c39f572aae3b5ca458: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251212 09:11:12.852255 1792 heartbeater.cc:499] Master 127.29.26.190:39727 was elected leader, sending a full tablet report...
I20251212 09:11:12.852576 1810 raft_consensus.cc:359] T 381560f0b5544b67a5feb27acd70619c P 57d28858c7aa4de69605c7b8c98320d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25f8c778d44e44d192307575a73f6047" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 37973 } } peers { permanent_uuid: "57d28858c7aa4de69605c7b8c98320d5" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 41321 } } peers { permanent_uuid: "fb532eb6d77641c39f572aae3b5ca458" member_type: VOTER last_known_addr { host: "127.29.26.133" port: 41385 } }
I20251212 09:11:12.852905 1810 raft_consensus.cc:385] T 381560f0b5544b67a5feb27acd70619c P 57d28858c7aa4de69605c7b8c98320d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:12.852936 1810 raft_consensus.cc:740] T 381560f0b5544b67a5feb27acd70619c P 57d28858c7aa4de69605c7b8c98320d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57d28858c7aa4de69605c7b8c98320d5, State: Initialized, Role: FOLLOWER
I20251212 09:11:12.853004 1810 consensus_queue.cc:260] T 381560f0b5544b67a5feb27acd70619c P 57d28858c7aa4de69605c7b8c98320d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25f8c778d44e44d192307575a73f6047" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 37973 } } peers { permanent_uuid: "57d28858c7aa4de69605c7b8c98320d5" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 41321 } } peers { permanent_uuid: "fb532eb6d77641c39f572aae3b5ca458" member_type: VOTER last_known_addr { host: "127.29.26.133" port: 41385 } }
I20251212 09:11:12.853250 1810 ts_tablet_manager.cc:1434] T 381560f0b5544b67a5feb27acd70619c P 57d28858c7aa4de69605c7b8c98320d5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:12.853278 1527 heartbeater.cc:499] Master 127.29.26.190:39727 was elected leader, sending a full tablet report...
I20251212 09:11:12.970777 1815 raft_consensus.cc:493] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251212 09:11:12.970887 1815 raft_consensus.cc:515] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25f8c778d44e44d192307575a73f6047" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 37973 } } peers { permanent_uuid: "57d28858c7aa4de69605c7b8c98320d5" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 41321 } } peers { permanent_uuid: "fb532eb6d77641c39f572aae3b5ca458" member_type: VOTER last_known_addr { host: "127.29.26.133" port: 41385 } }
I20251212 09:11:12.971227 1815 leader_election.cc:290] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57d28858c7aa4de69605c7b8c98320d5 (127.29.26.131:41321), fb532eb6d77641c39f572aae3b5ca458 (127.29.26.133:41385)
I20251212 09:11:12.973973 1480 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "381560f0b5544b67a5feb27acd70619c" candidate_uuid: "25f8c778d44e44d192307575a73f6047" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57d28858c7aa4de69605c7b8c98320d5" is_pre_election: true
I20251212 09:11:12.974129 1480 raft_consensus.cc:2468] T 381560f0b5544b67a5feb27acd70619c P 57d28858c7aa4de69605c7b8c98320d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25f8c778d44e44d192307575a73f6047 in term 0.
I20251212 09:11:12.974383 1148 leader_election.cc:304] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25f8c778d44e44d192307575a73f6047, 57d28858c7aa4de69605c7b8c98320d5; no voters:
I20251212 09:11:12.974382 1746 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "381560f0b5544b67a5feb27acd70619c" candidate_uuid: "25f8c778d44e44d192307575a73f6047" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb532eb6d77641c39f572aae3b5ca458" is_pre_election: true
I20251212 09:11:12.974510 1746 raft_consensus.cc:2468] T 381560f0b5544b67a5feb27acd70619c P fb532eb6d77641c39f572aae3b5ca458 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25f8c778d44e44d192307575a73f6047 in term 0.
I20251212 09:11:12.974524 1815 raft_consensus.cc:2804] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251212 09:11:12.974604 1815 raft_consensus.cc:493] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251212 09:11:12.974642 1815 raft_consensus.cc:3060] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:12.975248 1815 raft_consensus.cc:515] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25f8c778d44e44d192307575a73f6047" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 37973 } } peers { permanent_uuid: "57d28858c7aa4de69605c7b8c98320d5" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 41321 } } peers { permanent_uuid: "fb532eb6d77641c39f572aae3b5ca458" member_type: VOTER last_known_addr { host: "127.29.26.133" port: 41385 } }
I20251212 09:11:12.975385 1815 leader_election.cc:290] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [CANDIDATE]: Term 1 election: Requested vote from peers 57d28858c7aa4de69605c7b8c98320d5 (127.29.26.131:41321), fb532eb6d77641c39f572aae3b5ca458 (127.29.26.133:41385)
I20251212 09:11:12.975523 1746 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "381560f0b5544b67a5feb27acd70619c" candidate_uuid: "25f8c778d44e44d192307575a73f6047" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb532eb6d77641c39f572aae3b5ca458"
I20251212 09:11:12.975594 1746 raft_consensus.cc:3060] T 381560f0b5544b67a5feb27acd70619c P fb532eb6d77641c39f572aae3b5ca458 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:12.975606 1480 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "381560f0b5544b67a5feb27acd70619c" candidate_uuid: "25f8c778d44e44d192307575a73f6047" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57d28858c7aa4de69605c7b8c98320d5"
I20251212 09:11:12.975718 1480 raft_consensus.cc:3060] T 381560f0b5544b67a5feb27acd70619c P 57d28858c7aa4de69605c7b8c98320d5 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:12.976217 1746 raft_consensus.cc:2468] T 381560f0b5544b67a5feb27acd70619c P fb532eb6d77641c39f572aae3b5ca458 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25f8c778d44e44d192307575a73f6047 in term 1.
I20251212 09:11:12.976325 1480 raft_consensus.cc:2468] T 381560f0b5544b67a5feb27acd70619c P 57d28858c7aa4de69605c7b8c98320d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25f8c778d44e44d192307575a73f6047 in term 1.
I20251212 09:11:12.976389 1150 leader_election.cc:304] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25f8c778d44e44d192307575a73f6047, fb532eb6d77641c39f572aae3b5ca458; no voters:
I20251212 09:11:12.976478 1815 raft_consensus.cc:2804] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:12.976608 1815 raft_consensus.cc:697] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [term 1 LEADER]: Becoming Leader. State: Replica: 25f8c778d44e44d192307575a73f6047, State: Running, Role: LEADER
I20251212 09:11:12.976728 1815 consensus_queue.cc:237] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25f8c778d44e44d192307575a73f6047" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 37973 } } peers { permanent_uuid: "57d28858c7aa4de69605c7b8c98320d5" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 41321 } } peers { permanent_uuid: "fb532eb6d77641c39f572aae3b5ca458" member_type: VOTER last_known_addr { host: "127.29.26.133" port: 41385 } }
I20251212 09:11:12.977488 1070 catalog_manager.cc:5654] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25f8c778d44e44d192307575a73f6047 (127.29.26.129). New cstate: current_term: 1 leader_uuid: "25f8c778d44e44d192307575a73f6047" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25f8c778d44e44d192307575a73f6047" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 37973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57d28858c7aa4de69605c7b8c98320d5" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb532eb6d77641c39f572aae3b5ca458" member_type: VOTER last_known_addr { host: "127.29.26.133" port: 41385 } health_report { overall_health: UNKNOWN } } }
I20251212 09:11:12.987699 29802 external_mini_cluster.cc:949] 5 TS(s) registered with all masters
I20251212 09:11:12.988126 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 25f8c778d44e44d192307575a73f6047 to finish bootstrapping
I20251212 09:11:12.991475 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 57d28858c7aa4de69605c7b8c98320d5 to finish bootstrapping
I20251212 09:11:12.994643 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver fb532eb6d77641c39f572aae3b5ca458 to finish bootstrapping
I20251212 09:11:12.997565 29802 test_util.cc:276] Using random seed: -1533369157
I20251212 09:11:13.002729 29802 test_workload.cc:405] TestWorkload: Skipping table creation because table TestTable already exists
I20251212 09:11:13.002848 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 1662
I20251212 09:11:13.008288 1480 raft_consensus.cc:1275] T 381560f0b5544b67a5feb27acd70619c P 57d28858c7aa4de69605c7b8c98320d5 [term 1 FOLLOWER]: Refusing update from remote peer 25f8c778d44e44d192307575a73f6047: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251212 09:11:13.008585 1150 connection.cc:537] client connection to 127.29.26.133:41385 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251212 09:11:13.008597 1820 consensus_queue.cc:1048] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57d28858c7aa4de69605c7b8c98320d5" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251212 09:11:13.008730 1150 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251212 09:11:13.010259 1150 consensus_peers.cc:597] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 -> Peer fb532eb6d77641c39f572aae3b5ca458 (127.29.26.133:41385): Couldn't send request to peer fb532eb6d77641c39f572aae3b5ca458. Status: Network error: Client connection negotiation failed: client connection to 127.29.26.133:41385: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251212 09:11:13.011256 1832 mvcc.cc:204] Tried to move back new op lower bound from 7231613636639240192 to 7231613636513353728. Current Snapshot: MvccSnapshot[applied={T|T < 7231613636639240192}]
I20251212 09:11:13.134528 1196 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251212 09:11:13.134654 1460 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:13.135243 1593 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:13.138835 1328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:13.487695 1394 heartbeater.cc:499] Master 127.29.26.190:39727 was elected leader, sending a full tablet report...
I20251212 09:11:13.708446 1659 heartbeater.cc:499] Master 127.29.26.190:39727 was elected leader, sending a full tablet report...
I20251212 09:11:14.176602 1196 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251212 09:11:14.177035 1460 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:14.178201 1328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:14.186683 1593 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:15.225062 1196 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251212 09:11:15.226338 1593 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:15.227955 1328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:15.236699 1460 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20251212 09:11:15.729105 1150 consensus_peers.cc:597] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 -> Peer fb532eb6d77641c39f572aae3b5ca458 (127.29.26.133:41385): Couldn't send request to peer fb532eb6d77641c39f572aae3b5ca458. Status: Network error: Client connection negotiation failed: client connection to 127.29.26.133:41385: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20251212 09:11:16.275115 1593 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:16.275794 1196 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251212 09:11:16.283708 1328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:16.285418 1460 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:17.324390 1593 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:17.328593 1460 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:17.328588 1196 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251212 09:11:17.329649 1328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20251212 09:11:18.160437 1150 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.26.133:41385: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20251212 09:11:18.160856 1150 consensus_peers.cc:597] T 381560f0b5544b67a5feb27acd70619c P 25f8c778d44e44d192307575a73f6047 -> Peer fb532eb6d77641c39f572aae3b5ca458 (127.29.26.133:41385): Couldn't send request to peer fb532eb6d77641c39f572aae3b5ca458. Status: Network error: Client connection negotiation failed: client connection to 127.29.26.133:41385: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20251212 09:11:18.347560 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 1133
W20251212 09:11:18.353179 1413 connection.cc:537] server connection from 127.29.26.129:59115 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251212 09:11:18.353461 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 1266
I20251212 09:11:18.358412 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 1397
I20251212 09:11:18.363088 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 1530
I20251212 09:11:18.367295 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 1041
2025-12-12T09:11:18Z chronyd exiting
[ OK ] EnableKudu1097AndDownTS/MoveTabletParamTest.Test/4 (6307 ms)
[----------] 1 test from EnableKudu1097AndDownTS/MoveTabletParamTest (6307 ms total)
[----------] 1 test from ListTableCliSimpleParamTest
[ RUN ] ListTableCliSimpleParamTest.TestListTables/2
I20251212 09:11:18.388306 29802 test_util.cc:276] Using random seed: -1527978420
I20251212 09:11:18.388849 29802 ts_itest-base.cc:115] Starting cluster with:
I20251212 09:11:18.388892 29802 ts_itest-base.cc:116] --------------
I20251212 09:11:18.388911 29802 ts_itest-base.cc:117] 1 tablet servers
I20251212 09:11:18.388926 29802 ts_itest-base.cc:118] 1 replicas per TS
I20251212 09:11:18.388954 29802 ts_itest-base.cc:119] --------------
2025-12-12T09:11:18Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-12T09:11:18Z Disabled control of system clock
I20251212 09:11:18.396183 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:35579
--webserver_interface=127.29.26.190
--webserver_port=0
--builtin_ntp_servers=127.29.26.148:44575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.26.190:35579 with env {}
W20251212 09:11:18.471513 2040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:18.471673 2040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:18.471700 2040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:18.473140 2040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251212 09:11:18.473193 2040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:18.473218 2040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251212 09:11:18.473237 2040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251212 09:11:18.474748 2040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:44575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.26.190:35579
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:35579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.29.26.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.2040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:18.474987 2040 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:18.475183 2040 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:18.477843 2047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:18.477815 2045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:18.477793 2040 server_base.cc:1047] running on GCE node
W20251212 09:11:18.477902 2049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:18.478299 2040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:18.478525 2040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:18.479646 2040 hybrid_clock.cc:648] HybridClock initialized: now 1765530678479629 us; error 33 us; skew 500 ppm
I20251212 09:11:18.480799 2040 webserver.cc:492] Webserver started at http://127.29.26.190:38975/ using document root <none> and password file <none>
I20251212 09:11:18.481029 2040 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:18.481069 2040 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:18.481176 2040 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:18.481976 2040 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "07e1b16a17484bf59f4be59e40440385"
format_stamp: "Formatted at 2025-12-12 09:11:18 on dist-test-slave-qqr7"
I20251212 09:11:18.482270 2040 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "07e1b16a17484bf59f4be59e40440385"
format_stamp: "Formatted at 2025-12-12 09:11:18 on dist-test-slave-qqr7"
I20251212 09:11:18.483377 2040 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251212 09:11:18.484059 2055 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:18.484241 2040 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251212 09:11:18.484308 2040 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
uuid: "07e1b16a17484bf59f4be59e40440385"
format_stamp: "Formatted at 2025-12-12 09:11:18 on dist-test-slave-qqr7"
I20251212 09:11:18.484364 2040 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:18.496469 2040 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:18.496804 2040 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:18.496928 2040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:18.500361 2040 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.190:35579
I20251212 09:11:18.500391 2109 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.190:35579 every 8 connection(s)
I20251212 09:11:18.500710 2040 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20251212 09:11:18.501295 2110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:18.503594 2110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385: Bootstrap starting.
I20251212 09:11:18.504161 2110 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:18.504413 2110 log.cc:826] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:18.504998 2110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385: No bootstrap required, opened a new log
I20251212 09:11:18.506137 2110 raft_consensus.cc:359] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e1b16a17484bf59f4be59e40440385" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 35579 } }
I20251212 09:11:18.506250 2110 raft_consensus.cc:385] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:18.506269 2110 raft_consensus.cc:740] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07e1b16a17484bf59f4be59e40440385, State: Initialized, Role: FOLLOWER
I20251212 09:11:18.506390 2110 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e1b16a17484bf59f4be59e40440385" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 35579 } }
I20251212 09:11:18.506444 2110 raft_consensus.cc:399] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:18.506469 2110 raft_consensus.cc:493] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:18.506517 2110 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:18.506992 2110 raft_consensus.cc:515] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e1b16a17484bf59f4be59e40440385" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 35579 } }
I20251212 09:11:18.507110 2110 leader_election.cc:304] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07e1b16a17484bf59f4be59e40440385; no voters:
I20251212 09:11:18.507256 2110 leader_election.cc:290] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251212 09:11:18.507300 2113 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:18.507416 2113 raft_consensus.cc:697] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [term 1 LEADER]: Becoming Leader. State: Replica: 07e1b16a17484bf59f4be59e40440385, State: Running, Role: LEADER
I20251212 09:11:18.507472 2110 sys_catalog.cc:565] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [sys.catalog]: configured and running, proceeding with master startup.
I20251212 09:11:18.507542 2113 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e1b16a17484bf59f4be59e40440385" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 35579 } }
I20251212 09:11:18.507861 2115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07e1b16a17484bf59f4be59e40440385. Latest consensus state: current_term: 1 leader_uuid: "07e1b16a17484bf59f4be59e40440385" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e1b16a17484bf59f4be59e40440385" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 35579 } } }
I20251212 09:11:18.507840 2114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07e1b16a17484bf59f4be59e40440385" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e1b16a17484bf59f4be59e40440385" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 35579 } } }
I20251212 09:11:18.507949 2115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:18.508033 2114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385 [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:18.508390 2120 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251212 09:11:18.508818 2120 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251212 09:11:18.510037 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 2040
I20251212 09:11:18.510130 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/master-0/wal/instance
I20251212 09:11:18.510296 2120 catalog_manager.cc:1357] Generated new cluster ID: 585a82c926a74e7dad0dd5cef0933bf3
I20251212 09:11:18.510339 2120 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251212 09:11:18.518031 2120 catalog_manager.cc:1380] Generated new certificate authority record
I20251212 09:11:18.518499 2120 catalog_manager.cc:1514] Loading token signing keys...
I20251212 09:11:18.522706 2120 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 07e1b16a17484bf59f4be59e40440385: Generated new TSK 0
I20251212 09:11:18.522866 2120 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251212 09:11:18.527354 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.129:0
--local_ip_for_outbound_sockets=127.29.26.129
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:35579
--builtin_ntp_servers=127.29.26.148:44575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20251212 09:11:18.614929 2134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:18.615098 2134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:18.615118 2134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:18.616547 2134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:18.616600 2134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.129
I20251212 09:11:18.618062 2134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:44575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:35579
--never_fsync=true
--heap_profile_path=/tmp/kudu.2134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.129
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:18.618271 2134 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:18.618496 2134 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:18.621162 2142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:18.621193 2139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:18.621289 2134 server_base.cc:1047] running on GCE node
W20251212 09:11:18.621168 2140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:18.621562 2134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:18.621757 2134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:18.622895 2134 hybrid_clock.cc:648] HybridClock initialized: now 1765530678622868 us; error 45 us; skew 500 ppm
I20251212 09:11:18.623991 2134 webserver.cc:492] Webserver started at http://127.29.26.129:41021/ using document root <none> and password file <none>
I20251212 09:11:18.624193 2134 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:18.624230 2134 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:18.624331 2134 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:18.625229 2134 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "81507a960786413ea2025c72167d528e"
format_stamp: "Formatted at 2025-12-12 09:11:18 on dist-test-slave-qqr7"
I20251212 09:11:18.625515 2134 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "81507a960786413ea2025c72167d528e"
format_stamp: "Formatted at 2025-12-12 09:11:18 on dist-test-slave-qqr7"
I20251212 09:11:18.626631 2134 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251212 09:11:18.627305 2148 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:18.627487 2134 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:18.627568 2134 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "81507a960786413ea2025c72167d528e"
format_stamp: "Formatted at 2025-12-12 09:11:18 on dist-test-slave-qqr7"
I20251212 09:11:18.627640 2134 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:18.667562 2134 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:18.667842 2134 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:18.667961 2134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:18.668176 2134 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:18.668530 2134 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:18.668571 2134 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:18.668609 2134 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:18.668632 2134 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:18.675004 2134 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.129:34085
I20251212 09:11:18.675078 2264 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.129:34085 every 8 connection(s)
I20251212 09:11:18.675364 2134 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20251212 09:11:18.680272 2265 heartbeater.cc:344] Connected to a master server at 127.29.26.190:35579
I20251212 09:11:18.680357 2265 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:18.680531 2265 heartbeater.cc:507] Master 127.29.26.190:35579 requested a full tablet report, sending...
I20251212 09:11:18.681028 2073 ts_manager.cc:194] Registered new tserver with Master: 81507a960786413ea2025c72167d528e (127.29.26.129:34085)
I20251212 09:11:18.681990 2073 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.129:56019
I20251212 09:11:18.682907 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 2134
I20251212 09:11:18.683015 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.ListTableCliSimpleParamTest.TestListTables_2.1765530660439309-29802-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20251212 09:11:18.684170 29802 external_mini_cluster.cc:949] 1 TS(s) registered with all masters
I20251212 09:11:18.692063 2073 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36954:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20251212 09:11:18.698819 2198 tablet_service.cc:1505] Processing CreateTablet for tablet 7f273062fc444441b3db023e76bdf66b (DEFAULT_TABLE table=TestTable [id=4abec479906a471ea21444f8c715b642]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:18.699118 2198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f273062fc444441b3db023e76bdf66b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:18.701124 2275 tablet_bootstrap.cc:492] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e: Bootstrap starting.
I20251212 09:11:18.701668 2275 tablet_bootstrap.cc:654] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:18.701874 2275 log.cc:826] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:18.702415 2275 tablet_bootstrap.cc:492] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e: No bootstrap required, opened a new log
I20251212 09:11:18.702466 2275 ts_tablet_manager.cc:1403] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:18.703442 2275 raft_consensus.cc:359] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81507a960786413ea2025c72167d528e" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 34085 } }
I20251212 09:11:18.703545 2275 raft_consensus.cc:385] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:18.703565 2275 raft_consensus.cc:740] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81507a960786413ea2025c72167d528e, State: Initialized, Role: FOLLOWER
I20251212 09:11:18.703758 2275 consensus_queue.cc:260] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81507a960786413ea2025c72167d528e" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 34085 } }
I20251212 09:11:18.703845 2275 raft_consensus.cc:399] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:18.703876 2275 raft_consensus.cc:493] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:18.703927 2275 raft_consensus.cc:3060] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:18.704403 2275 raft_consensus.cc:515] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81507a960786413ea2025c72167d528e" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 34085 } }
I20251212 09:11:18.704495 2275 leader_election.cc:304] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 81507a960786413ea2025c72167d528e; no voters:
I20251212 09:11:18.704619 2275 leader_election.cc:290] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e [CANDIDATE]: Term 1 election: Requested vote from peers
I20251212 09:11:18.704701 2277 raft_consensus.cc:2804] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:18.704819 2275 ts_tablet_manager.cc:1434] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:18.704876 2265 heartbeater.cc:499] Master 127.29.26.190:35579 was elected leader, sending a full tablet report...
I20251212 09:11:18.704888 2277 raft_consensus.cc:697] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e [term 1 LEADER]: Becoming Leader. State: Replica: 81507a960786413ea2025c72167d528e, State: Running, Role: LEADER
I20251212 09:11:18.705029 2277 consensus_queue.cc:237] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81507a960786413ea2025c72167d528e" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 34085 } }
I20251212 09:11:18.705775 2073 catalog_manager.cc:5654] T 7f273062fc444441b3db023e76bdf66b P 81507a960786413ea2025c72167d528e reported cstate change: term changed from 0 to 1, leader changed from <none> to 81507a960786413ea2025c72167d528e (127.29.26.129). New cstate: current_term: 1 leader_uuid: "81507a960786413ea2025c72167d528e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81507a960786413ea2025c72167d528e" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 34085 } health_report { overall_health: HEALTHY } } }
I20251212 09:11:18.708453 29802 external_mini_cluster.cc:949] 1 TS(s) registered with all masters
I20251212 09:11:18.708850 29802 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 81507a960786413ea2025c72167d528e to finish bootstrapping
I20251212 09:11:18.855639 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 2134
I20251212 09:11:18.860219 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 2040
2025-12-12T09:11:18Z chronyd exiting
[ OK ] ListTableCliSimpleParamTest.TestListTables/2 (490 ms)
[----------] 1 test from ListTableCliSimpleParamTest (490 ms total)
[----------] 1 test from ListTableCliParamTest
[ RUN ] ListTableCliParamTest.ListTabletWithPartitionInfo/4
I20251212 09:11:18.878886 29802 test_util.cc:276] Using random seed: -1527487842
[ OK ] ListTableCliParamTest.ListTabletWithPartitionInfo/4 (1 ms)
[----------] 1 test from ListTableCliParamTest (1 ms total)
[----------] 1 test from IsSecure/SecureClusterAdminCliParamTest
[ RUN ] IsSecure/SecureClusterAdminCliParamTest.TestRebuildMaster/0
2025-12-12T09:11:18Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-12T09:11:18Z Disabled control of system clock
I20251212 09:11:18.887358 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:42029
--webserver_interface=127.29.26.190
--webserver_port=0
--builtin_ntp_servers=127.29.26.148:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.26.190:42029 with env {}
W20251212 09:11:18.963595 2299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:18.963768 2299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:18.963786 2299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:18.965184 2299 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251212 09:11:18.965235 2299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:18.965250 2299 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251212 09:11:18.965268 2299 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251212 09:11:18.966707 2299 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.26.190:42029
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:42029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.26.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.2299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:18.966894 2299 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:18.967077 2299 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:18.969513 2304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:18.969507 2305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:18.969509 2307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:18.969704 2299 server_base.cc:1047] running on GCE node
I20251212 09:11:18.970013 2299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:18.970233 2299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:18.971405 2299 hybrid_clock.cc:648] HybridClock initialized: now 1765530678971382 us; error 34 us; skew 500 ppm
I20251212 09:11:18.972616 2299 webserver.cc:492] Webserver started at http://127.29.26.190:43113/ using document root <none> and password file <none>
I20251212 09:11:18.972838 2299 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:18.972887 2299 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:18.973026 2299 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:18.973858 2299 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data/instance:
uuid: "ca5cebf87ad94175ade1144c467a091d"
format_stamp: "Formatted at 2025-12-12 09:11:18 on dist-test-slave-qqr7"
I20251212 09:11:18.974160 2299 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal/instance:
uuid: "ca5cebf87ad94175ade1144c467a091d"
format_stamp: "Formatted at 2025-12-12 09:11:18 on dist-test-slave-qqr7"
I20251212 09:11:18.975354 2299 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251212 09:11:18.976076 2313 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:18.976269 2299 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:18.976332 2299 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal
uuid: "ca5cebf87ad94175ade1144c467a091d"
format_stamp: "Formatted at 2025-12-12 09:11:18 on dist-test-slave-qqr7"
I20251212 09:11:18.976397 2299 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:18.993992 2299 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:18.994280 2299 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:18.994400 2299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:18.998258 2299 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.190:42029
I20251212 09:11:18.998292 2365 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.190:42029 every 8 connection(s)
I20251212 09:11:18.998605 2299 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data/info.pb
I20251212 09:11:18.999168 2366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:19.001318 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 2299
I20251212 09:11:19.001437 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal/instance
I20251212 09:11:19.001674 2366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d: Bootstrap starting.
I20251212 09:11:19.002362 2366 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:19.002625 2366 log.cc:826] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:19.003345 2366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d: No bootstrap required, opened a new log
I20251212 09:11:19.004530 2366 raft_consensus.cc:359] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca5cebf87ad94175ade1144c467a091d" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 42029 } }
I20251212 09:11:19.004714 2366 raft_consensus.cc:385] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:19.004746 2366 raft_consensus.cc:740] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca5cebf87ad94175ade1144c467a091d, State: Initialized, Role: FOLLOWER
I20251212 09:11:19.004853 2366 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca5cebf87ad94175ade1144c467a091d" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 42029 } }
I20251212 09:11:19.004933 2366 raft_consensus.cc:399] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:19.004974 2366 raft_consensus.cc:493] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:19.005033 2366 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:19.005965 2366 raft_consensus.cc:515] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca5cebf87ad94175ade1144c467a091d" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 42029 } }
I20251212 09:11:19.006084 2366 leader_election.cc:304] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca5cebf87ad94175ade1144c467a091d; no voters:
I20251212 09:11:19.006240 2366 leader_election.cc:290] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [CANDIDATE]: Term 1 election: Requested vote from peers
I20251212 09:11:19.006321 2371 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:19.006470 2366 sys_catalog.cc:565] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [sys.catalog]: configured and running, proceeding with master startup.
I20251212 09:11:19.006505 2371 raft_consensus.cc:697] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [term 1 LEADER]: Becoming Leader. State: Replica: ca5cebf87ad94175ade1144c467a091d, State: Running, Role: LEADER
I20251212 09:11:19.006702 2371 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca5cebf87ad94175ade1144c467a091d" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 42029 } }
I20251212 09:11:19.007050 2372 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca5cebf87ad94175ade1144c467a091d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca5cebf87ad94175ade1144c467a091d" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 42029 } } }
I20251212 09:11:19.007139 2372 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:19.007292 2373 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca5cebf87ad94175ade1144c467a091d. Latest consensus state: current_term: 1 leader_uuid: "ca5cebf87ad94175ade1144c467a091d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca5cebf87ad94175ade1144c467a091d" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 42029 } } }
I20251212 09:11:19.007335 2379 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251212 09:11:19.007357 2373 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:19.007908 2379 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251212 09:11:19.013082 2379 catalog_manager.cc:1357] Generated new cluster ID: 5057820ad5884fa0aa161c4e3f0f9ec3
I20251212 09:11:19.013142 2379 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251212 09:11:19.034531 2379 catalog_manager.cc:1380] Generated new certificate authority record
I20251212 09:11:19.035300 2379 catalog_manager.cc:1514] Loading token signing keys...
I20251212 09:11:19.040355 2379 catalog_manager.cc:6027] T 00000000000000000000000000000000 P ca5cebf87ad94175ade1144c467a091d: Generated new TSK 0
I20251212 09:11:19.040549 2379 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251212 09:11:19.044546 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.129:0
--local_ip_for_outbound_sockets=127.29.26.129
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:42029
--builtin_ntp_servers=127.29.26.148:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20251212 09:11:19.122442 2391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:19.122608 2391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:19.122638 2391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:19.123994 2391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:19.124053 2391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.129
I20251212 09:11:19.125559 2391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.26.129
--webserver_port=0
--tserver_master_addrs=127.29.26.190:42029
--never_fsync=true
--heap_profile_path=/tmp/kudu.2391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.129
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:19.125773 2391 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:19.125989 2391 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:19.128464 2396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:19.128445 2397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:19.128677 2391 server_base.cc:1047] running on GCE node
W20251212 09:11:19.128801 2399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:19.129025 2391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:19.129215 2391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:19.130357 2391 hybrid_clock.cc:648] HybridClock initialized: now 1765530679130344 us; error 30 us; skew 500 ppm
I20251212 09:11:19.131424 2391 webserver.cc:492] Webserver started at http://127.29.26.129:34083/ using document root <none> and password file <none>
I20251212 09:11:19.131618 2391 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:19.131656 2391 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:19.131750 2391 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:19.132586 2391 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data/instance:
uuid: "6ba798a513464c5092d9c07bd724e2a1"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:19.132933 2391 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/wal/instance:
uuid: "6ba798a513464c5092d9c07bd724e2a1"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:19.134070 2391 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:19.134747 2405 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:19.134931 2391 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:19.134992 2391 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/wal
uuid: "6ba798a513464c5092d9c07bd724e2a1"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:19.135053 2391 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:19.142360 2391 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:19.142546 2391 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:19.142640 2391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:19.142831 2391 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:19.143127 2391 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:19.143162 2391 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:19.143193 2391 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:19.143222 2391 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:19.149557 2391 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.129:33699
I20251212 09:11:19.149617 2519 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.129:33699 every 8 connection(s)
I20251212 09:11:19.149890 2391 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data/info.pb
I20251212 09:11:19.154870 2520 heartbeater.cc:344] Connected to a master server at 127.29.26.190:42029
I20251212 09:11:19.154994 2520 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:19.155208 2520 heartbeater.cc:507] Master 127.29.26.190:42029 requested a full tablet report, sending...
I20251212 09:11:19.155645 2330 ts_manager.cc:194] Registered new tserver with Master: 6ba798a513464c5092d9c07bd724e2a1 (127.29.26.129:33699)
I20251212 09:11:19.156270 2330 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.129:54585
I20251212 09:11:19.159049 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 2391
I20251212 09:11:19.159129 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/wal/instance
I20251212 09:11:19.160171 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.130:0
--local_ip_for_outbound_sockets=127.29.26.130
--webserver_interface=127.29.26.130
--webserver_port=0
--tserver_master_addrs=127.29.26.190:42029
--builtin_ntp_servers=127.29.26.148:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20251212 09:11:19.237897 2523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:19.238075 2523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:19.238108 2523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:19.239578 2523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:19.239639 2523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.130
I20251212 09:11:19.241184 2523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.26.130
--webserver_port=0
--tserver_master_addrs=127.29.26.190:42029
--never_fsync=true
--heap_profile_path=/tmp/kudu.2523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.130
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:19.241411 2523 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:19.241644 2523 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:19.244299 2529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:19.244383 2528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:19.244439 2523 server_base.cc:1047] running on GCE node
W20251212 09:11:19.244299 2531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:19.244710 2523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:19.244939 2523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:19.246078 2523 hybrid_clock.cc:648] HybridClock initialized: now 1765530679246069 us; error 28 us; skew 500 ppm
I20251212 09:11:19.247164 2523 webserver.cc:492] Webserver started at http://127.29.26.130:33447/ using document root <none> and password file <none>
I20251212 09:11:19.247350 2523 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:19.247390 2523 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:19.247501 2523 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:19.248320 2523 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data/instance:
uuid: "daf397d05bbb4e1fbbb354962f2127a6"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:19.248598 2523 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/wal/instance:
uuid: "daf397d05bbb4e1fbbb354962f2127a6"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:19.249730 2523 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251212 09:11:19.250391 2538 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:19.250551 2523 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251212 09:11:19.250622 2523 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/wal
uuid: "daf397d05bbb4e1fbbb354962f2127a6"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:19.250681 2523 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:19.275836 2523 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:19.276146 2523 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:19.276257 2523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:19.276487 2523 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:19.276885 2523 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:19.276917 2523 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:19.276957 2523 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:19.276988 2523 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:19.282524 2523 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.130:36063
I20251212 09:11:19.282594 2651 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.130:36063 every 8 connection(s)
I20251212 09:11:19.282872 2523 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data/info.pb
I20251212 09:11:19.284579 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 2523
I20251212 09:11:19.284684 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/wal/instance
I20251212 09:11:19.285722 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.131:0
--local_ip_for_outbound_sockets=127.29.26.131
--webserver_interface=127.29.26.131
--webserver_port=0
--tserver_master_addrs=127.29.26.190:42029
--builtin_ntp_servers=127.29.26.148:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251212 09:11:19.287300 2652 heartbeater.cc:344] Connected to a master server at 127.29.26.190:42029
I20251212 09:11:19.287412 2652 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:19.287637 2652 heartbeater.cc:507] Master 127.29.26.190:42029 requested a full tablet report, sending...
I20251212 09:11:19.287992 2330 ts_manager.cc:194] Registered new tserver with Master: daf397d05bbb4e1fbbb354962f2127a6 (127.29.26.130:36063)
I20251212 09:11:19.288334 2330 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.130:46891
W20251212 09:11:19.363423 2655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:19.363595 2655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:19.363626 2655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:19.365077 2655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:19.365136 2655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.131
I20251212 09:11:19.366650 2655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.26.131
--webserver_port=0
--tserver_master_addrs=127.29.26.190:42029
--never_fsync=true
--heap_profile_path=/tmp/kudu.2655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.131
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:19.366884 2655 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:19.367107 2655 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:19.369650 2660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:19.369630 2663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:19.369638 2661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:19.369714 2655 server_base.cc:1047] running on GCE node
I20251212 09:11:19.370052 2655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:19.370260 2655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:19.371397 2655 hybrid_clock.cc:648] HybridClock initialized: now 1765530679371385 us; error 32 us; skew 500 ppm
I20251212 09:11:19.372478 2655 webserver.cc:492] Webserver started at http://127.29.26.131:44345/ using document root <none> and password file <none>
I20251212 09:11:19.372695 2655 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:19.372748 2655 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:19.372866 2655 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:19.373708 2655 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data/instance:
uuid: "949bbf50f52549a193a8ed8d7441765a"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:19.374025 2655 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/wal/instance:
uuid: "949bbf50f52549a193a8ed8d7441765a"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:19.375128 2655 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251212 09:11:19.375763 2669 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:19.375917 2655 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:19.375984 2655 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/wal
uuid: "949bbf50f52549a193a8ed8d7441765a"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:19.376047 2655 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:19.388175 2655 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:19.388432 2655 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:19.388561 2655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:19.388772 2655 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:19.389087 2655 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251212 09:11:19.389122 2655 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:19.389156 2655 ts_tablet_manager.cc:616] Registered 0 tablets
I20251212 09:11:19.389187 2655 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:19.394893 2655 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.131:42235
I20251212 09:11:19.394948 2783 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.131:42235 every 8 connection(s)
I20251212 09:11:19.395244 2655 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data/info.pb
I20251212 09:11:19.399479 2784 heartbeater.cc:344] Connected to a master server at 127.29.26.190:42029
I20251212 09:11:19.399575 2784 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:19.399772 2784 heartbeater.cc:507] Master 127.29.26.190:42029 requested a full tablet report, sending...
I20251212 09:11:19.400084 2330 ts_manager.cc:194] Registered new tserver with Master: 949bbf50f52549a193a8ed8d7441765a (127.29.26.131:42235)
I20251212 09:11:19.400434 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 2655
I20251212 09:11:19.400460 2330 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.131:48419
I20251212 09:11:19.400522 29802 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/wal/instance
I20251212 09:11:19.401559 29802 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251212 09:11:19.406286 29802 test_util.cc:276] Using random seed: -1526960435
I20251212 09:11:19.411789 2330 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46968:
name: "pre_rebuild"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251212 09:11:19.412091 2330 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table pre_rebuild in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251212 09:11:19.417819 2718 tablet_service.cc:1505] Processing CreateTablet for tablet 939cd927cf4147fbb006027a44bf5e82 (DEFAULT_TABLE table=pre_rebuild [id=3f0f6777ea184fc49c8c03182751905c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:19.418164 2718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939cd927cf4147fbb006027a44bf5e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:19.418416 2454 tablet_service.cc:1505] Processing CreateTablet for tablet 939cd927cf4147fbb006027a44bf5e82 (DEFAULT_TABLE table=pre_rebuild [id=3f0f6777ea184fc49c8c03182751905c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:19.418653 2454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939cd927cf4147fbb006027a44bf5e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:19.420334 2803 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: Bootstrap starting.
I20251212 09:11:19.420814 2804 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: Bootstrap starting.
I20251212 09:11:19.421043 2803 tablet_bootstrap.cc:654] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:19.421361 2804 tablet_bootstrap.cc:654] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:19.421347 2803 log.cc:826] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:19.421645 2804 log.cc:826] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:19.421864 2586 tablet_service.cc:1505] Processing CreateTablet for tablet 939cd927cf4147fbb006027a44bf5e82 (DEFAULT_TABLE table=pre_rebuild [id=3f0f6777ea184fc49c8c03182751905c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:19.422024 2803 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: No bootstrap required, opened a new log
I20251212 09:11:19.422084 2803 ts_tablet_manager.cc:1403] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251212 09:11:19.422147 2586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939cd927cf4147fbb006027a44bf5e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:19.422282 2804 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: No bootstrap required, opened a new log
I20251212 09:11:19.422365 2804 ts_tablet_manager.cc:1403] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251212 09:11:19.423629 2803 raft_consensus.cc:359] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:19.423777 2803 raft_consensus.cc:385] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:19.423807 2803 raft_consensus.cc:740] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 949bbf50f52549a193a8ed8d7441765a, State: Initialized, Role: FOLLOWER
I20251212 09:11:19.423771 2804 raft_consensus.cc:359] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:19.423882 2804 raft_consensus.cc:385] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:19.423907 2804 raft_consensus.cc:740] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba798a513464c5092d9c07bd724e2a1, State: Initialized, Role: FOLLOWER
I20251212 09:11:19.423915 2803 consensus_queue.cc:260] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:19.423974 2804 consensus_queue.cc:260] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:19.424152 2804 ts_tablet_manager.cc:1434] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:19.424152 2803 ts_tablet_manager.cc:1434] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251212 09:11:19.424288 2784 heartbeater.cc:499] Master 127.29.26.190:42029 was elected leader, sending a full tablet report...
I20251212 09:11:19.424305 2520 heartbeater.cc:499] Master 127.29.26.190:42029 was elected leader, sending a full tablet report...
I20251212 09:11:19.424371 2807 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: Bootstrap starting.
I20251212 09:11:19.424961 2807 tablet_bootstrap.cc:654] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:19.425266 2807 log.cc:826] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:19.425937 2807 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: No bootstrap required, opened a new log
I20251212 09:11:19.426019 2807 ts_tablet_manager.cc:1403] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251212 09:11:19.427054 2807 raft_consensus.cc:359] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:19.427165 2807 raft_consensus.cc:385] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:19.427199 2807 raft_consensus.cc:740] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf397d05bbb4e1fbbb354962f2127a6, State: Initialized, Role: FOLLOWER
I20251212 09:11:19.427299 2807 consensus_queue.cc:260] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:19.427564 2807 ts_tablet_manager.cc:1434] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251212 09:11:19.427584 2652 heartbeater.cc:499] Master 127.29.26.190:42029 was elected leader, sending a full tablet report...
I20251212 09:11:19.454214 2808 raft_consensus.cc:493] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251212 09:11:19.454355 2808 raft_consensus.cc:515] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:19.454746 2808 leader_election.cc:290] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers daf397d05bbb4e1fbbb354962f2127a6 (127.29.26.130:36063), 6ba798a513464c5092d9c07bd724e2a1 (127.29.26.129:33699)
I20251212 09:11:19.457804 2606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "939cd927cf4147fbb006027a44bf5e82" candidate_uuid: "949bbf50f52549a193a8ed8d7441765a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf397d05bbb4e1fbbb354962f2127a6" is_pre_election: true
I20251212 09:11:19.457973 2606 raft_consensus.cc:2468] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 949bbf50f52549a193a8ed8d7441765a in term 0.
I20251212 09:11:19.458205 2672 leader_election.cc:304] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 949bbf50f52549a193a8ed8d7441765a, daf397d05bbb4e1fbbb354962f2127a6; no voters:
I20251212 09:11:19.458369 2808 raft_consensus.cc:2804] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251212 09:11:19.458428 2808 raft_consensus.cc:493] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251212 09:11:19.458457 2808 raft_consensus.cc:3060] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:19.458564 2474 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "939cd927cf4147fbb006027a44bf5e82" candidate_uuid: "949bbf50f52549a193a8ed8d7441765a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba798a513464c5092d9c07bd724e2a1" is_pre_election: true
I20251212 09:11:19.458696 2474 raft_consensus.cc:2468] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 949bbf50f52549a193a8ed8d7441765a in term 0.
I20251212 09:11:19.459249 2808 raft_consensus.cc:515] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:19.459441 2808 leader_election.cc:290] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [CANDIDATE]: Term 1 election: Requested vote from peers daf397d05bbb4e1fbbb354962f2127a6 (127.29.26.130:36063), 6ba798a513464c5092d9c07bd724e2a1 (127.29.26.129:33699)
I20251212 09:11:19.459587 2606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "939cd927cf4147fbb006027a44bf5e82" candidate_uuid: "949bbf50f52549a193a8ed8d7441765a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf397d05bbb4e1fbbb354962f2127a6"
I20251212 09:11:19.459587 2474 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "939cd927cf4147fbb006027a44bf5e82" candidate_uuid: "949bbf50f52549a193a8ed8d7441765a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba798a513464c5092d9c07bd724e2a1"
I20251212 09:11:19.459666 2606 raft_consensus.cc:3060] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:19.459673 2474 raft_consensus.cc:3060] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:19.460460 2606 raft_consensus.cc:2468] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 949bbf50f52549a193a8ed8d7441765a in term 1.
I20251212 09:11:19.460461 2474 raft_consensus.cc:2468] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 949bbf50f52549a193a8ed8d7441765a in term 1.
I20251212 09:11:19.460640 2673 leader_election.cc:304] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba798a513464c5092d9c07bd724e2a1, 949bbf50f52549a193a8ed8d7441765a; no voters:
I20251212 09:11:19.460762 2808 raft_consensus.cc:2804] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:19.460909 2808 raft_consensus.cc:697] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 1 LEADER]: Becoming Leader. State: Replica: 949bbf50f52549a193a8ed8d7441765a, State: Running, Role: LEADER
I20251212 09:11:19.461025 2808 consensus_queue.cc:237] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:19.461735 2330 catalog_manager.cc:5654] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a reported cstate change: term changed from 0 to 1, leader changed from <none> to 949bbf50f52549a193a8ed8d7441765a (127.29.26.131). New cstate: current_term: 1 leader_uuid: "949bbf50f52549a193a8ed8d7441765a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } health_report { overall_health: UNKNOWN } } }
I20251212 09:11:19.483796 2606 raft_consensus.cc:1275] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 1 FOLLOWER]: Refusing update from remote peer 949bbf50f52549a193a8ed8d7441765a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251212 09:11:19.483848 2474 raft_consensus.cc:1275] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 1 FOLLOWER]: Refusing update from remote peer 949bbf50f52549a193a8ed8d7441765a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251212 09:11:19.484169 2813 consensus_queue.cc:1048] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251212 09:11:19.484295 2808 consensus_queue.cc:1048] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251212 09:11:19.487210 2820 mvcc.cc:204] Tried to move back new op lower bound from 7231613663165157376 to 7231613663073087488. Current Snapshot: MvccSnapshot[applied={T|T < 7231613663163015168}]
I20251212 09:11:19.488843 2822 mvcc.cc:204] Tried to move back new op lower bound from 7231613663165157376 to 7231613663073087488. Current Snapshot: MvccSnapshot[applied={T|T < 7231613663165157376 or (T in {7231613663165157376})}]
I20251212 09:11:19.488948 2821 mvcc.cc:204] Tried to move back new op lower bound from 7231613663165157376 to 7231613663073087488. Current Snapshot: MvccSnapshot[applied={T|T < 7231613663163015168 or (T in {7231613663164297216,7231613663164776448})}]
I20251212 09:11:19.648468 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 2299
W20251212 09:11:19.737296 2842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:19.737468 2842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:19.738974 2842 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20251212 09:11:19.756784 2842 minidump.cc:252] Setting minidump size limit to 20M
I20251212 09:11:19.757107 2842 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:19.757308 2842 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:19.759478 2865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:19.759464 2864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:19.761509 2867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:19.761613 2842 server_base.cc:1047] running on GCE node
I20251212 09:11:19.761900 2842 hybrid_clock.cc:584] initializing the hybrid clock with 'system' time source
I20251212 09:11:19.761999 2842 hybrid_clock.cc:648] HybridClock initialized: now 1765530679761998 us; error 210540 us; skew 500 ppm
I20251212 09:11:19.762868 2842 webserver.cc:492] Webserver started at http://0.0.0.0:39739/ using document root <none> and password file <none>
I20251212 09:11:19.763089 2842 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:19.763157 2842 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:19.763255 2842 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251212 09:11:19.764328 2842 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data/instance:
uuid: "025c4ecefd044a838a505d42023da36c"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:19.764707 2842 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal/instance:
uuid: "025c4ecefd044a838a505d42023da36c"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:19.766182 2842 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:19.766971 2872 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:19.767138 2842 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:19.767207 2842 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal
uuid: "025c4ecefd044a838a505d42023da36c"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:19.767256 2842 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:19.895264 2842 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:19.895614 2842 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:19.895761 2842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:19.896251 2842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:19.898471 2842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c: Bootstrap starting.
I20251212 09:11:19.899013 2842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:19.899518 2842 log.cc:826] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:19.900136 2842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c: No bootstrap required, opened a new log
I20251212 09:11:19.901271 2842 raft_consensus.cc:359] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025c4ecefd044a838a505d42023da36c" member_type: VOTER }
I20251212 09:11:19.901372 2842 raft_consensus.cc:385] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:19.901405 2842 raft_consensus.cc:740] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 025c4ecefd044a838a505d42023da36c, State: Initialized, Role: FOLLOWER
I20251212 09:11:19.901497 2842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025c4ecefd044a838a505d42023da36c" member_type: VOTER }
I20251212 09:11:19.901548 2842 raft_consensus.cc:399] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:19.901580 2842 raft_consensus.cc:493] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:19.901633 2842 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:19.902122 2842 raft_consensus.cc:515] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025c4ecefd044a838a505d42023da36c" member_type: VOTER }
I20251212 09:11:19.902221 2842 leader_election.cc:304] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 025c4ecefd044a838a505d42023da36c; no voters:
I20251212 09:11:19.902392 2842 leader_election.cc:290] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [CANDIDATE]: Term 1 election: Requested vote from peers
I20251212 09:11:19.902479 2879 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:19.902643 2879 raft_consensus.cc:697] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 1 LEADER]: Becoming Leader. State: Replica: 025c4ecefd044a838a505d42023da36c, State: Running, Role: LEADER
I20251212 09:11:19.902730 2879 consensus_queue.cc:237] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025c4ecefd044a838a505d42023da36c" member_type: VOTER }
I20251212 09:11:19.903052 2880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "025c4ecefd044a838a505d42023da36c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025c4ecefd044a838a505d42023da36c" member_type: VOTER } }
I20251212 09:11:19.903142 2880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:19.903096 2881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 025c4ecefd044a838a505d42023da36c. Latest consensus state: current_term: 1 leader_uuid: "025c4ecefd044a838a505d42023da36c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025c4ecefd044a838a505d42023da36c" member_type: VOTER } }
I20251212 09:11:19.903276 2881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:19.904384 2842 tablet_replica.cc:333] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c: stopping tablet replica
I20251212 09:11:19.904453 2842 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 1 LEADER]: Raft consensus shutting down.
I20251212 09:11:19.904515 2842 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251212 09:11:19.904810 2842 master.cc:561] Master@0.0.0.0:7051 shutting down...
W20251212 09:11:19.904898 2842 acceptor_pool.cc:194] Could not shut down acceptor socket on 0.0.0.0:7051: Network error: shutdown error: Transport endpoint is not connected (error 107)
I20251212 09:11:19.915769 2842 master.cc:583] Master@0.0.0.0:7051 shutdown complete.
I20251212 09:11:19.921887 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 2391
I20251212 09:11:19.926573 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 2523
I20251212 09:11:19.931092 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 2655
I20251212 09:11:19.936694 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:42029
--webserver_interface=127.29.26.190
--webserver_port=43113
--builtin_ntp_servers=127.29.26.148:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.26.190:42029 with env {}
W20251212 09:11:20.014811 2885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:20.014973 2885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:20.014991 2885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:20.016287 2885 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251212 09:11:20.016322 2885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:20.016335 2885 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251212 09:11:20.016347 2885 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251212 09:11:20.017802 2885 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.26.190:42029
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.26.190:42029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.26.190
--webserver_port=43113
--never_fsync=true
--heap_profile_path=/tmp/kudu.2885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:20.017977 2885 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:20.018162 2885 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:20.020512 2893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:20.020503 2890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:20.020573 2885 server_base.cc:1047] running on GCE node
W20251212 09:11:20.020483 2891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:20.020942 2885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:20.021178 2885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:20.022310 2885 hybrid_clock.cc:648] HybridClock initialized: now 1765530680022299 us; error 26 us; skew 500 ppm
I20251212 09:11:20.023366 2885 webserver.cc:492] Webserver started at http://127.29.26.190:43113/ using document root <none> and password file <none>
I20251212 09:11:20.023546 2885 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:20.023603 2885 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:20.024755 2885 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:20.025380 2899 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:20.025547 2885 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:20.025615 2885 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal
uuid: "025c4ecefd044a838a505d42023da36c"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:20.025851 2885 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:20.036640 2885 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:20.036947 2885 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:20.037062 2885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:20.041244 2885 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.190:42029
I20251212 09:11:20.041285 2952 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.190:42029 every 8 connection(s)
I20251212 09:11:20.041639 2885 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data/info.pb
I20251212 09:11:20.042709 2953 sys_catalog.cc:263] Verifying existing consensus state
I20251212 09:11:20.044570 2953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c: Bootstrap starting.
I20251212 09:11:20.045604 2953 log.cc:826] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:20.046938 2953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251212 09:11:20.047151 2953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c: Bootstrap complete.
I20251212 09:11:20.048379 2953 raft_consensus.cc:359] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025c4ecefd044a838a505d42023da36c" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 42029 } }
I20251212 09:11:20.048501 2953 raft_consensus.cc:740] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 025c4ecefd044a838a505d42023da36c, State: Initialized, Role: FOLLOWER
I20251212 09:11:20.048590 2953 consensus_queue.cc:260] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025c4ecefd044a838a505d42023da36c" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 42029 } }
I20251212 09:11:20.048633 2953 raft_consensus.cc:399] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251212 09:11:20.048693 2953 raft_consensus.cc:493] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251212 09:11:20.048746 2953 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 1 FOLLOWER]: Advancing to term 2
I20251212 09:11:20.049240 2953 raft_consensus.cc:515] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025c4ecefd044a838a505d42023da36c" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 42029 } }
I20251212 09:11:20.049319 2953 leader_election.cc:304] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 025c4ecefd044a838a505d42023da36c; no voters:
I20251212 09:11:20.049450 2953 leader_election.cc:290] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [CANDIDATE]: Term 2 election: Requested vote from peers
I20251212 09:11:20.049515 2956 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 2 FOLLOWER]: Leader election won for term 2
I20251212 09:11:20.049652 2956 raft_consensus.cc:697] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [term 2 LEADER]: Becoming Leader. State: Replica: 025c4ecefd044a838a505d42023da36c, State: Running, Role: LEADER
I20251212 09:11:20.049652 2953 sys_catalog.cc:565] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [sys.catalog]: configured and running, proceeding with master startup.
I20251212 09:11:20.049741 2956 consensus_queue.cc:237] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025c4ecefd044a838a505d42023da36c" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 42029 } }
I20251212 09:11:20.050046 2957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "025c4ecefd044a838a505d42023da36c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025c4ecefd044a838a505d42023da36c" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 42029 } } }
I20251212 09:11:20.050064 2958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 025c4ecefd044a838a505d42023da36c. Latest consensus state: current_term: 2 leader_uuid: "025c4ecefd044a838a505d42023da36c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025c4ecefd044a838a505d42023da36c" member_type: VOTER last_known_addr { host: "127.29.26.190" port: 42029 } } }
I20251212 09:11:20.050160 2957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:20.050164 2958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c [sys.catalog]: This master's current role is: LEADER
I20251212 09:11:20.050424 2961 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251212 09:11:20.050984 2961 catalog_manager.cc:679] Loaded metadata for table pre_rebuild [id=49963fb943c5464c9475e2591b45f601]
I20251212 09:11:20.051123 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 2885
I20251212 09:11:20.051163 2961 tablet_loader.cc:96] loaded metadata for tablet 939cd927cf4147fbb006027a44bf5e82 (table pre_rebuild [id=49963fb943c5464c9475e2591b45f601])
I20251212 09:11:20.051216 2961 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251212 09:11:20.051388 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.129:33699
--local_ip_for_outbound_sockets=127.29.26.129
--tserver_master_addrs=127.29.26.190:42029
--webserver_port=34083
--webserver_interface=127.29.26.129
--builtin_ntp_servers=127.29.26.148:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251212 09:11:20.052321 2961 catalog_manager.cc:1357] Generated new cluster ID: 02683990c5fa42ac92f4c0af5d924c73
I20251212 09:11:20.052367 2961 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251212 09:11:20.067266 2961 catalog_manager.cc:1380] Generated new certificate authority record
I20251212 09:11:20.067957 2961 catalog_manager.cc:1514] Loading token signing keys...
I20251212 09:11:20.077575 2961 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c: Generated new TSK 0
I20251212 09:11:20.077749 2961 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20251212 09:11:20.134976 2973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:20.135134 2973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:20.135166 2973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:20.136513 2973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:20.136570 2973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.129
I20251212 09:11:20.138103 2973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.129:33699
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.26.129
--webserver_port=34083
--tserver_master_addrs=127.29.26.190:42029
--never_fsync=true
--heap_profile_path=/tmp/kudu.2973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.129
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:20.138321 2973 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:20.138530 2973 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:20.140956 2981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:20.141021 2980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:20.141204 2984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:20.141405 2973 server_base.cc:1047] running on GCE node
I20251212 09:11:20.141562 2973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:20.141777 2973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:20.142940 2973 hybrid_clock.cc:648] HybridClock initialized: now 1765530680142921 us; error 33 us; skew 500 ppm
I20251212 09:11:20.144253 2973 webserver.cc:492] Webserver started at http://127.29.26.129:34083/ using document root <none> and password file <none>
I20251212 09:11:20.144469 2973 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:20.144541 2973 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:20.146072 2973 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:20.146891 2990 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:20.147099 2973 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:20.147178 2973 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/wal
uuid: "6ba798a513464c5092d9c07bd724e2a1"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:20.147490 2973 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:20.170364 2973 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:20.170660 2973 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:20.170794 2973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:20.171069 2973 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:20.171590 2997 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251212 09:11:20.172503 2973 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251212 09:11:20.172564 2973 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251212 09:11:20.172600 2973 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251212 09:11:20.173350 2973 ts_tablet_manager.cc:616] Registered 1 tablets
I20251212 09:11:20.173394 2973 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20251212 09:11:20.173476 2997 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: Bootstrap starting.
I20251212 09:11:20.180523 2973 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.129:33699
I20251212 09:11:20.180954 2973 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data/info.pb
I20251212 09:11:20.184959 3104 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.129:33699 every 8 connection(s)
I20251212 09:11:20.187371 2997 log.cc:826] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:20.190441 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 2973
I20251212 09:11:20.190733 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.130:36063
--local_ip_for_outbound_sockets=127.29.26.130
--tserver_master_addrs=127.29.26.190:42029
--webserver_port=33447
--webserver_interface=127.29.26.130
--builtin_ntp_servers=127.29.26.148:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251212 09:11:20.193622 3105 heartbeater.cc:344] Connected to a master server at 127.29.26.190:42029
I20251212 09:11:20.193734 3105 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:20.193949 3105 heartbeater.cc:507] Master 127.29.26.190:42029 requested a full tablet report, sending...
I20251212 09:11:20.194701 2917 ts_manager.cc:194] Registered new tserver with Master: 6ba798a513464c5092d9c07bd724e2a1 (127.29.26.129:33699)
I20251212 09:11:20.195920 2917 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.129:58653
I20251212 09:11:20.221073 2997 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: Bootstrap replayed 1/1 log segments. Stats: ops{read=207 overwritten=0 applied=207 ignored=0} inserts{seen=10300 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251212 09:11:20.221429 2997 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: Bootstrap complete.
I20251212 09:11:20.222373 2997 ts_tablet_manager.cc:1403] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: Time spent bootstrapping tablet: real 0.049s user 0.035s sys 0.012s
I20251212 09:11:20.223266 2997 raft_consensus.cc:359] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:20.223451 2997 raft_consensus.cc:740] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba798a513464c5092d9c07bd724e2a1, State: Initialized, Role: FOLLOWER
I20251212 09:11:20.223608 2997 consensus_queue.cc:260] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 207, Last appended: 1.207, Last appended by leader: 207, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:20.223907 2997 ts_tablet_manager.cc:1434] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: Time spent starting tablet: real 0.001s user 0.002s sys 0.001s
I20251212 09:11:20.223925 3105 heartbeater.cc:499] Master 127.29.26.190:42029 was elected leader, sending a full tablet report...
W20251212 09:11:20.285022 3110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:20.285190 3110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:20.285210 3110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:20.286641 3110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:20.286695 3110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.130
I20251212 09:11:20.288205 3110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.130:36063
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.26.130
--webserver_port=33447
--tserver_master_addrs=127.29.26.190:42029
--never_fsync=true
--heap_profile_path=/tmp/kudu.3110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.130
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:20.288414 3110 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:20.288640 3110 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:20.291214 3119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:20.291222 3117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:20.291254 3116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:20.291281 3110 server_base.cc:1047] running on GCE node
I20251212 09:11:20.291567 3110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:20.291762 3110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:20.292902 3110 hybrid_clock.cc:648] HybridClock initialized: now 1765530680292890 us; error 28 us; skew 500 ppm
I20251212 09:11:20.297853 3110 webserver.cc:492] Webserver started at http://127.29.26.130:33447/ using document root <none> and password file <none>
I20251212 09:11:20.298085 3110 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:20.298166 3110 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:20.299391 3110 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:20.300068 3125 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:20.300252 3110 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:20.300343 3110 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/wal
uuid: "daf397d05bbb4e1fbbb354962f2127a6"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:20.300771 3110 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:20.307231 3110 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:20.307443 3110 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:20.307542 3110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:20.307719 3110 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:20.308095 3133 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251212 09:11:20.308975 3110 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251212 09:11:20.309031 3110 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251212 09:11:20.309074 3110 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251212 09:11:20.309617 3110 ts_tablet_manager.cc:616] Registered 1 tablets
I20251212 09:11:20.309649 3110 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20251212 09:11:20.309698 3133 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: Bootstrap starting.
I20251212 09:11:20.315591 3110 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.130:36063
I20251212 09:11:20.315652 3240 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.130:36063 every 8 connection(s)
I20251212 09:11:20.315943 3110 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data/info.pb
I20251212 09:11:20.319846 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 3110
I20251212 09:11:20.320190 29802 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
/tmp/dist-test-taskEI9Tzd/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.26.131:42235
--local_ip_for_outbound_sockets=127.29.26.131
--tserver_master_addrs=127.29.26.190:42029
--webserver_port=44345
--webserver_interface=127.29.26.131
--builtin_ntp_servers=127.29.26.148:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251212 09:11:20.321311 3241 heartbeater.cc:344] Connected to a master server at 127.29.26.190:42029
I20251212 09:11:20.321419 3241 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:20.321635 3241 heartbeater.cc:507] Master 127.29.26.190:42029 requested a full tablet report, sending...
I20251212 09:11:20.322271 2917 ts_manager.cc:194] Registered new tserver with Master: daf397d05bbb4e1fbbb354962f2127a6 (127.29.26.130:36063)
I20251212 09:11:20.322815 2917 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.130:52619
I20251212 09:11:20.323215 3133 log.cc:826] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:20.351560 3133 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=207 overwritten=0 applied=207 ignored=0} inserts{seen=10300 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251212 09:11:20.351881 3133 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: Bootstrap complete.
I20251212 09:11:20.352921 3133 ts_tablet_manager.cc:1403] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: Time spent bootstrapping tablet: real 0.043s user 0.022s sys 0.021s
I20251212 09:11:20.353797 3133 raft_consensus.cc:359] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:20.353983 3133 raft_consensus.cc:740] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf397d05bbb4e1fbbb354962f2127a6, State: Initialized, Role: FOLLOWER
I20251212 09:11:20.354100 3133 consensus_queue.cc:260] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 207, Last appended: 1.207, Last appended by leader: 207, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:20.354359 3133 ts_tablet_manager.cc:1434] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251212 09:11:20.354429 3241 heartbeater.cc:499] Master 127.29.26.190:42029 was elected leader, sending a full tablet report...
W20251212 09:11:20.401108 3244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251212 09:11:20.401291 3244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251212 09:11:20.401310 3244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251212 09:11:20.402701 3244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251212 09:11:20.402757 3244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.26.131
I20251212 09:11:20.404382 3244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.26.148:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.26.131:42235
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.26.131
--webserver_port=44345
--tserver_master_addrs=127.29.26.190:42029
--never_fsync=true
--heap_profile_path=/tmp/kudu.3244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.26.131
--log_dir=/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type RELEASE
built by None at 12 Dec 2025 08:43:13 UTC on 5fd53c4cbb9d
build id 9475
I20251212 09:11:20.404613 3244 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251212 09:11:20.404865 3244 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251212 09:11:20.407642 3254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251212 09:11:20.407646 3251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:20.407783 3244 server_base.cc:1047] running on GCE node
W20251212 09:11:20.407646 3252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251212 09:11:20.408073 3244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251212 09:11:20.408291 3244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251212 09:11:20.409431 3244 hybrid_clock.cc:648] HybridClock initialized: now 1765530680409402 us; error 47 us; skew 500 ppm
I20251212 09:11:20.410542 3244 webserver.cc:492] Webserver started at http://127.29.26.131:44345/ using document root <none> and password file <none>
I20251212 09:11:20.410728 3244 fs_manager.cc:362] Metadata directory not provided
I20251212 09:11:20.410785 3244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251212 09:11:20.412015 3244 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:20.412690 3260 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:20.412868 3244 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251212 09:11:20.412940 3244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/wal
uuid: "949bbf50f52549a193a8ed8d7441765a"
format_stamp: "Formatted at 2025-12-12 09:11:19 on dist-test-slave-qqr7"
I20251212 09:11:20.413213 3244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251212 09:11:20.423292 3244 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251212 09:11:20.423532 3244 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251212 09:11:20.423641 3244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251212 09:11:20.423835 3244 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251212 09:11:20.424315 3267 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251212 09:11:20.425382 3244 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251212 09:11:20.425422 3244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251212 09:11:20.425447 3244 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251212 09:11:20.425961 3244 ts_tablet_manager.cc:616] Registered 1 tablets
I20251212 09:11:20.425992 3244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20251212 09:11:20.426086 3267 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: Bootstrap starting.
I20251212 09:11:20.431821 3244 rpc_server.cc:307] RPC server started. Bound to: 127.29.26.131:42235
I20251212 09:11:20.431880 3375 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.26.131:42235 every 8 connection(s)
I20251212 09:11:20.432214 3244 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data/info.pb
I20251212 09:11:20.435505 29802 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu as pid 3244
I20251212 09:11:20.437400 3376 heartbeater.cc:344] Connected to a master server at 127.29.26.190:42029
I20251212 09:11:20.437525 3376 heartbeater.cc:461] Registering TS with master...
I20251212 09:11:20.437775 3376 heartbeater.cc:507] Master 127.29.26.190:42029 requested a full tablet report, sending...
I20251212 09:11:20.438374 2917 ts_manager.cc:194] Registered new tserver with Master: 949bbf50f52549a193a8ed8d7441765a (127.29.26.131:42235)
I20251212 09:11:20.438936 2917 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.26.131:37981
I20251212 09:11:20.440280 29802 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251212 09:11:20.440754 3267 log.cc:826] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: Log is configured to *not* fsync() on all Append() calls
I20251212 09:11:20.486459 3267 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: Bootstrap replayed 1/1 log segments. Stats: ops{read=207 overwritten=0 applied=207 ignored=0} inserts{seen=10300 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251212 09:11:20.486876 3267 tablet_bootstrap.cc:492] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: Bootstrap complete.
I20251212 09:11:20.488163 3267 ts_tablet_manager.cc:1403] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: Time spent bootstrapping tablet: real 0.062s user 0.047s sys 0.011s
I20251212 09:11:20.489735 3267 raft_consensus.cc:359] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:20.490124 3267 raft_consensus.cc:740] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 949bbf50f52549a193a8ed8d7441765a, State: Initialized, Role: FOLLOWER
I20251212 09:11:20.490254 3267 consensus_queue.cc:260] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 207, Last appended: 1.207, Last appended by leader: 207, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:20.490551 3267 ts_tablet_manager.cc:1434] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
I20251212 09:11:20.490579 3376 heartbeater.cc:499] Master 127.29.26.190:42029 was elected leader, sending a full tablet report...
I20251212 09:11:21.755367 3388 raft_consensus.cc:493] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251212 09:11:21.755492 3388 raft_consensus.cc:515] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:21.755777 3388 leader_election.cc:290] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 949bbf50f52549a193a8ed8d7441765a (127.29.26.131:42235), 6ba798a513464c5092d9c07bd724e2a1 (127.29.26.129:33699)
I20251212 09:11:21.760423 3330 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "939cd927cf4147fbb006027a44bf5e82" candidate_uuid: "daf397d05bbb4e1fbbb354962f2127a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 207 } } ignore_live_leader: false dest_uuid: "949bbf50f52549a193a8ed8d7441765a" is_pre_election: true
I20251212 09:11:21.760421 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "939cd927cf4147fbb006027a44bf5e82" candidate_uuid: "daf397d05bbb4e1fbbb354962f2127a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 207 } } ignore_live_leader: false dest_uuid: "6ba798a513464c5092d9c07bd724e2a1" is_pre_election: true
I20251212 09:11:21.760567 3330 raft_consensus.cc:2468] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daf397d05bbb4e1fbbb354962f2127a6 in term 1.
I20251212 09:11:21.760574 3059 raft_consensus.cc:2468] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daf397d05bbb4e1fbbb354962f2127a6 in term 1.
I20251212 09:11:21.760859 3129 leader_election.cc:304] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 949bbf50f52549a193a8ed8d7441765a, daf397d05bbb4e1fbbb354962f2127a6; no voters:
I20251212 09:11:21.761050 3388 raft_consensus.cc:2804] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251212 09:11:21.761135 3388 raft_consensus.cc:493] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251212 09:11:21.761157 3388 raft_consensus.cc:3060] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 1 FOLLOWER]: Advancing to term 2
I20251212 09:11:21.762385 3388 raft_consensus.cc:515] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:21.762512 3388 leader_election.cc:290] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [CANDIDATE]: Term 2 election: Requested vote from peers 949bbf50f52549a193a8ed8d7441765a (127.29.26.131:42235), 6ba798a513464c5092d9c07bd724e2a1 (127.29.26.129:33699)
I20251212 09:11:21.762707 3330 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "939cd927cf4147fbb006027a44bf5e82" candidate_uuid: "daf397d05bbb4e1fbbb354962f2127a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 207 } } ignore_live_leader: false dest_uuid: "949bbf50f52549a193a8ed8d7441765a"
I20251212 09:11:21.762712 3059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "939cd927cf4147fbb006027a44bf5e82" candidate_uuid: "daf397d05bbb4e1fbbb354962f2127a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 207 } } ignore_live_leader: false dest_uuid: "6ba798a513464c5092d9c07bd724e2a1"
I20251212 09:11:21.762777 3059 raft_consensus.cc:3060] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 1 FOLLOWER]: Advancing to term 2
I20251212 09:11:21.762784 3330 raft_consensus.cc:3060] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 1 FOLLOWER]: Advancing to term 2
I20251212 09:11:21.763693 3059 raft_consensus.cc:2468] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf397d05bbb4e1fbbb354962f2127a6 in term 2.
I20251212 09:11:21.763700 3330 raft_consensus.cc:2468] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf397d05bbb4e1fbbb354962f2127a6 in term 2.
I20251212 09:11:21.763878 3129 leader_election.cc:304] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 949bbf50f52549a193a8ed8d7441765a, daf397d05bbb4e1fbbb354962f2127a6; no voters:
I20251212 09:11:21.763983 3388 raft_consensus.cc:2804] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 2 FOLLOWER]: Leader election won for term 2
I20251212 09:11:21.764133 3388 raft_consensus.cc:697] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 2 LEADER]: Becoming Leader. State: Replica: daf397d05bbb4e1fbbb354962f2127a6, State: Running, Role: LEADER
I20251212 09:11:21.764221 3388 consensus_queue.cc:237] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 207, Committed index: 207, Last appended: 1.207, Last appended by leader: 207, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:21.764946 2917 catalog_manager.cc:5654] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 reported cstate change: term changed from 0 to 2, leader changed from <none> to daf397d05bbb4e1fbbb354962f2127a6 (127.29.26.130), VOTER 6ba798a513464c5092d9c07bd724e2a1 (127.29.26.129) added, VOTER 949bbf50f52549a193a8ed8d7441765a (127.29.26.131) added, VOTER daf397d05bbb4e1fbbb354962f2127a6 (127.29.26.130) added. New cstate: current_term: 2 leader_uuid: "daf397d05bbb4e1fbbb354962f2127a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } health_report { overall_health: UNKNOWN } } }
W20251212 09:11:21.956501 29802 scanner-internal.cc:458] Time spent opening tablet: real 1.511s user 0.000s sys 0.001s
I20251212 09:11:22.000916 3310 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:22.001058 3175 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251212 09:11:22.006309 3039 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
025c4ecefd044a838a505d42023da36c | 127.29.26.190:42029 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.29.26.148:40777 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
6ba798a513464c5092d9c07bd724e2a1 | 127.29.26.129:33699 | HEALTHY | <none> | 0 | 0
949bbf50f52549a193a8ed8d7441765a | 127.29.26.131:42235 | HEALTHY | <none> | 0 | 0
daf397d05bbb4e1fbbb354962f2127a6 | 127.29.26.130:36063 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.29.26.129 | experimental | 127.29.26.129:33699
local_ip_for_outbound_sockets | 127.29.26.130 | experimental | 127.29.26.130:36063
local_ip_for_outbound_sockets | 127.29.26.131 | experimental | 127.29.26.131:42235
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data/info.pb | hidden | 127.29.26.129:33699
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data/info.pb | hidden | 127.29.26.130:36063
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data/info.pb | hidden | 127.29.26.131:42235
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.29.26.148:40777 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 939cd927cf4147fbb006027a44bf5e82 of table 'pre_rebuild' is conflicted: 2 replicas' active configs disagree with the leader master's
949bbf50f52549a193a8ed8d7441765a (127.29.26.131:42235): RUNNING
daf397d05bbb4e1fbbb354962f2127a6 (127.29.26.130:36063): RUNNING [LEADER]
6ba798a513464c5092d9c07bd724e2a1 (127.29.26.129:33699): RUNNING
All reported replicas are:
A = 949bbf50f52549a193a8ed8d7441765a
B = daf397d05bbb4e1fbbb354962f2127a6
C = 6ba798a513464c5092d9c07bd724e2a1
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B C | 2 | -1 | Yes
B | A B* C | 2 | -1 | Yes
C | A B C | 2 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-------------+----+--------------------+---------------+---------+------------+------------------+-------------
pre_rebuild | 1 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20251212 09:11:22.016516 29802 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20251212 09:11:22.151633 3330 raft_consensus.cc:1275] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 2 FOLLOWER]: Refusing update from remote peer daf397d05bbb4e1fbbb354962f2127a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 207. Preceding OpId from leader: term: 2 index: 208. (index mismatch)
I20251212 09:11:22.152017 3388 consensus_queue.cc:1048] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 208, Last known committed idx: 207, Time since last communication: 0.000s
I20251212 09:11:22.153770 3059 raft_consensus.cc:1275] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 2 FOLLOWER]: Refusing update from remote peer daf397d05bbb4e1fbbb354962f2127a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 207. Preceding OpId from leader: term: 2 index: 208. (index mismatch)
I20251212 09:11:22.154008 3388 consensus_queue.cc:1048] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 208, Last known committed idx: 207, Time since last communication: 0.000s
I20251212 09:11:22.157377 3195 consensus_queue.cc:237] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 208, Committed index: 208, Last appended: 2.208, Last appended by leader: 207, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } }
I20251212 09:11:22.157804 3330 raft_consensus.cc:1275] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 2 FOLLOWER]: Refusing update from remote peer daf397d05bbb4e1fbbb354962f2127a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 208. Preceding OpId from leader: term: 2 index: 209. (index mismatch)
I20251212 09:11:22.157992 3388 consensus_queue.cc:1048] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 209, Last known committed idx: 208, Time since last communication: 0.000s
I20251212 09:11:22.158569 3393 raft_consensus.cc:2955] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 2 LEADER]: Committing config change with OpId 2.209: config changed from index -1 to 209, VOTER 6ba798a513464c5092d9c07bd724e2a1 (127.29.26.129) evicted. New config: { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } }
I20251212 09:11:22.158667 3330 raft_consensus.cc:2955] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 2 FOLLOWER]: Committing config change with OpId 2.209: config changed from index -1 to 209, VOTER 6ba798a513464c5092d9c07bd724e2a1 (127.29.26.129) evicted. New config: { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } }
I20251212 09:11:22.159809 2902 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 939cd927cf4147fbb006027a44bf5e82 with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251212 09:11:22.159816 2916 catalog_manager.cc:5654] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 reported cstate change: config changed from index -1 to 209, VOTER 6ba798a513464c5092d9c07bd724e2a1 (127.29.26.129) evicted. New cstate: current_term: 2 leader_uuid: "daf397d05bbb4e1fbbb354962f2127a6" committed_config { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } health_report { overall_health: HEALTHY } } }
I20251212 09:11:22.160912 3195 consensus_queue.cc:237] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 209, Committed index: 209, Last appended: 2.209, Last appended by leader: 207, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 210 OBSOLETE_local: false peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } }
I20251212 09:11:22.161128 3437 raft_consensus.cc:2955] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 2 LEADER]: Committing config change with OpId 2.210: config changed from index 209 to 210, VOTER 949bbf50f52549a193a8ed8d7441765a (127.29.26.131) evicted. New config: { opid_index: 210 OBSOLETE_local: false peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } }
I20251212 09:11:22.161922 2902 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 939cd927cf4147fbb006027a44bf5e82 with cas_config_opid_index 209: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20251212 09:11:22.162163 2916 catalog_manager.cc:5654] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 reported cstate change: config changed from index 209 to 210, VOTER 949bbf50f52549a193a8ed8d7441765a (127.29.26.131) evicted. New cstate: current_term: 2 leader_uuid: "daf397d05bbb4e1fbbb354962f2127a6" committed_config { opid_index: 210 OBSOLETE_local: false peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } health_report { overall_health: HEALTHY } } }
I20251212 09:11:22.163552 3039 tablet_service.cc:1552] Processing DeleteTablet for tablet 939cd927cf4147fbb006027a44bf5e82 with delete_type TABLET_DATA_TOMBSTONED (TS 6ba798a513464c5092d9c07bd724e2a1 not found in new config with opid_index 209) from {username='slave'} at 127.0.0.1:53422
I20251212 09:11:22.164270 3439 tablet_replica.cc:333] stopping tablet replica
I20251212 09:11:22.164371 3439 raft_consensus.cc:2243] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251212 09:11:22.164436 3439 raft_consensus.cc:2272] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251212 09:11:22.164812 3439 ts_tablet_manager.cc:1916] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251212 09:11:22.165450 3310 tablet_service.cc:1552] Processing DeleteTablet for tablet 939cd927cf4147fbb006027a44bf5e82 with delete_type TABLET_DATA_TOMBSTONED (TS 949bbf50f52549a193a8ed8d7441765a not found in new config with opid_index 210) from {username='slave'} at 127.0.0.1:56068
I20251212 09:11:22.165700 3440 tablet_replica.cc:333] stopping tablet replica
I20251212 09:11:22.165799 3440 raft_consensus.cc:2243] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 2 FOLLOWER]: Raft consensus shutting down.
I20251212 09:11:22.165870 3440 raft_consensus.cc:2272] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a [term 2 FOLLOWER]: Raft consensus is shut down!
I20251212 09:11:22.166229 3440 ts_tablet_manager.cc:1916] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251212 09:11:22.166352 3439 ts_tablet_manager.cc:1929] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.208
I20251212 09:11:22.166419 3439 log.cc:1199] T 939cd927cf4147fbb006027a44bf5e82 P 6ba798a513464c5092d9c07bd724e2a1: Deleting WAL directory at /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/wal/wals/939cd927cf4147fbb006027a44bf5e82
I20251212 09:11:22.166944 2903 catalog_manager.cc:4985] TS 6ba798a513464c5092d9c07bd724e2a1 (127.29.26.129:33699): tablet 939cd927cf4147fbb006027a44bf5e82 (table pre_rebuild [id=49963fb943c5464c9475e2591b45f601]) successfully deleted
I20251212 09:11:22.168030 3440 ts_tablet_manager.cc:1929] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.209
I20251212 09:11:22.168111 3440 log.cc:1199] T 939cd927cf4147fbb006027a44bf5e82 P 949bbf50f52549a193a8ed8d7441765a: Deleting WAL directory at /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/wal/wals/939cd927cf4147fbb006027a44bf5e82
I20251212 09:11:22.168574 2902 catalog_manager.cc:4985] TS 949bbf50f52549a193a8ed8d7441765a (127.29.26.131:42235): tablet 939cd927cf4147fbb006027a44bf5e82 (table pre_rebuild [id=49963fb943c5464c9475e2591b45f601]) successfully deleted
I20251212 09:11:22.191423 3039 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:22.191550 3310 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:22.192297 3175 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
025c4ecefd044a838a505d42023da36c | 127.29.26.190:42029 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.29.26.148:40777 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
6ba798a513464c5092d9c07bd724e2a1 | 127.29.26.129:33699 | HEALTHY | <none> | 0 | 0
949bbf50f52549a193a8ed8d7441765a | 127.29.26.131:42235 | HEALTHY | <none> | 0 | 0
daf397d05bbb4e1fbbb354962f2127a6 | 127.29.26.130:36063 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.29.26.129 | experimental | 127.29.26.129:33699
local_ip_for_outbound_sockets | 127.29.26.130 | experimental | 127.29.26.130:36063
local_ip_for_outbound_sockets | 127.29.26.131 | experimental | 127.29.26.131:42235
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data/info.pb | hidden | 127.29.26.129:33699
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data/info.pb | hidden | 127.29.26.130:36063
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data/info.pb | hidden | 127.29.26.131:42235
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.29.26.148:40777 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-------------+----+---------+---------------+---------+------------+------------------+-------------
pre_rebuild | 1 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 0
Median | 0
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 1
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20251212 09:11:22.201570 29802 log_verifier.cc:126] Checking tablet 939cd927cf4147fbb006027a44bf5e82
I20251212 09:11:22.214187 29802 log_verifier.cc:177] Verified matching terms for 210 ops in tablet 939cd927cf4147fbb006027a44bf5e82
I20251212 09:11:22.214702 2916 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46982:
table { table_name: "pre_rebuild" } modify_external_catalogs: true
I20251212 09:11:22.214809 2916 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46982:
table { table_name: "pre_rebuild" } modify_external_catalogs: true
I20251212 09:11:22.215634 2916 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 025c4ecefd044a838a505d42023da36c: Sending DeleteTablet for 1 replicas of tablet 939cd927cf4147fbb006027a44bf5e82
I20251212 09:11:22.215958 29802 test_util.cc:276] Using random seed: -1524150764
I20251212 09:11:22.215958 3175 tablet_service.cc:1552] Processing DeleteTablet for tablet 939cd927cf4147fbb006027a44bf5e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-12 09:11:22 UTC) from {username='slave'} at 127.0.0.1:39200
I20251212 09:11:22.216291 3464 tablet_replica.cc:333] stopping tablet replica
I20251212 09:11:22.216390 3464 raft_consensus.cc:2243] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 2 LEADER]: Raft consensus shutting down.
I20251212 09:11:22.216468 3464 raft_consensus.cc:2272] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251212 09:11:22.217818 3464 ts_tablet_manager.cc:1916] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251212 09:11:22.219712 3464 ts_tablet_manager.cc:1929] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.210
I20251212 09:11:22.219794 3464 log.cc:1199] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: Deleting WAL directory at /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/wal/wals/939cd927cf4147fbb006027a44bf5e82
I20251212 09:11:22.220136 3464 ts_tablet_manager.cc:1950] T 939cd927cf4147fbb006027a44bf5e82 P daf397d05bbb4e1fbbb354962f2127a6: Deleting consensus metadata
I20251212 09:11:22.220548 2902 catalog_manager.cc:4985] TS daf397d05bbb4e1fbbb354962f2127a6 (127.29.26.130:36063): tablet 939cd927cf4147fbb006027a44bf5e82 (table pre_rebuild [id=49963fb943c5464c9475e2591b45f601]) successfully deleted
I20251212 09:11:22.221527 2916 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47050:
name: "post_rebuild"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251212 09:11:22.221792 2916 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table post_rebuild in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251212 09:11:22.223361 3175 tablet_service.cc:1505] Processing CreateTablet for tablet bbf919545aff49809f878a147021c43e (DEFAULT_TABLE table=post_rebuild [id=24792c562f2341f29264a574a9e1d2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:22.223387 3039 tablet_service.cc:1505] Processing CreateTablet for tablet bbf919545aff49809f878a147021c43e (DEFAULT_TABLE table=post_rebuild [id=24792c562f2341f29264a574a9e1d2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:22.223397 3310 tablet_service.cc:1505] Processing CreateTablet for tablet bbf919545aff49809f878a147021c43e (DEFAULT_TABLE table=post_rebuild [id=24792c562f2341f29264a574a9e1d2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251212 09:11:22.223534 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf919545aff49809f878a147021c43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:22.223528 3175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf919545aff49809f878a147021c43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:22.223568 3310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf919545aff49809f878a147021c43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251212 09:11:22.224915 3471 tablet_bootstrap.cc:492] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1: Bootstrap starting.
I20251212 09:11:22.224957 3470 tablet_bootstrap.cc:492] T bbf919545aff49809f878a147021c43e P 949bbf50f52549a193a8ed8d7441765a: Bootstrap starting.
I20251212 09:11:22.225059 3472 tablet_bootstrap.cc:492] T bbf919545aff49809f878a147021c43e P daf397d05bbb4e1fbbb354962f2127a6: Bootstrap starting.
I20251212 09:11:22.225291 3471 tablet_bootstrap.cc:654] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:22.225350 3470 tablet_bootstrap.cc:654] T bbf919545aff49809f878a147021c43e P 949bbf50f52549a193a8ed8d7441765a: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:22.225406 3472 tablet_bootstrap.cc:654] T bbf919545aff49809f878a147021c43e P daf397d05bbb4e1fbbb354962f2127a6: Neither blocks nor log segments found. Creating new log.
I20251212 09:11:22.225788 3471 tablet_bootstrap.cc:492] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1: No bootstrap required, opened a new log
I20251212 09:11:22.225836 3471 ts_tablet_manager.cc:1403] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:22.225932 3470 tablet_bootstrap.cc:492] T bbf919545aff49809f878a147021c43e P 949bbf50f52549a193a8ed8d7441765a: No bootstrap required, opened a new log
I20251212 09:11:22.225982 3470 ts_tablet_manager.cc:1403] T bbf919545aff49809f878a147021c43e P 949bbf50f52549a193a8ed8d7441765a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:22.226058 3472 tablet_bootstrap.cc:492] T bbf919545aff49809f878a147021c43e P daf397d05bbb4e1fbbb354962f2127a6: No bootstrap required, opened a new log
I20251212 09:11:22.226032 3471 raft_consensus.cc:359] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:22.226109 3472 ts_tablet_manager.cc:1403] T bbf919545aff49809f878a147021c43e P daf397d05bbb4e1fbbb354962f2127a6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251212 09:11:22.226110 3471 raft_consensus.cc:385] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:22.226115 3470 raft_consensus.cc:359] T bbf919545aff49809f878a147021c43e P 949bbf50f52549a193a8ed8d7441765a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:22.226141 3471 raft_consensus.cc:740] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba798a513464c5092d9c07bd724e2a1, State: Initialized, Role: FOLLOWER
I20251212 09:11:22.226162 3470 raft_consensus.cc:385] T bbf919545aff49809f878a147021c43e P 949bbf50f52549a193a8ed8d7441765a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:22.226181 3470 raft_consensus.cc:740] T bbf919545aff49809f878a147021c43e P 949bbf50f52549a193a8ed8d7441765a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 949bbf50f52549a193a8ed8d7441765a, State: Initialized, Role: FOLLOWER
I20251212 09:11:22.226195 3471 consensus_queue.cc:260] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:22.226219 3470 consensus_queue.cc:260] T bbf919545aff49809f878a147021c43e P 949bbf50f52549a193a8ed8d7441765a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:22.226222 3472 raft_consensus.cc:359] T bbf919545aff49809f878a147021c43e P daf397d05bbb4e1fbbb354962f2127a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:22.226281 3472 raft_consensus.cc:385] T bbf919545aff49809f878a147021c43e P daf397d05bbb4e1fbbb354962f2127a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251212 09:11:22.226303 3472 raft_consensus.cc:740] T bbf919545aff49809f878a147021c43e P daf397d05bbb4e1fbbb354962f2127a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf397d05bbb4e1fbbb354962f2127a6, State: Initialized, Role: FOLLOWER
I20251212 09:11:22.226312 3470 ts_tablet_manager.cc:1434] T bbf919545aff49809f878a147021c43e P 949bbf50f52549a193a8ed8d7441765a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:22.226359 3472 consensus_queue.cc:260] T bbf919545aff49809f878a147021c43e P daf397d05bbb4e1fbbb354962f2127a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:22.226450 3472 ts_tablet_manager.cc:1434] T bbf919545aff49809f878a147021c43e P daf397d05bbb4e1fbbb354962f2127a6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251212 09:11:22.226548 3471 ts_tablet_manager.cc:1434] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20251212 09:11:22.318076 3242 tablet.cc:2378] T bbf919545aff49809f878a147021c43e P daf397d05bbb4e1fbbb354962f2127a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251212 09:11:22.354918 3433 raft_consensus.cc:493] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251212 09:11:22.355037 3433 raft_consensus.cc:515] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:22.355335 3433 leader_election.cc:290] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers daf397d05bbb4e1fbbb354962f2127a6 (127.29.26.130:36063), 949bbf50f52549a193a8ed8d7441765a (127.29.26.131:42235)
I20251212 09:11:22.358279 3330 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bbf919545aff49809f878a147021c43e" candidate_uuid: "6ba798a513464c5092d9c07bd724e2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "949bbf50f52549a193a8ed8d7441765a" is_pre_election: true
I20251212 09:11:22.358260 3195 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bbf919545aff49809f878a147021c43e" candidate_uuid: "6ba798a513464c5092d9c07bd724e2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf397d05bbb4e1fbbb354962f2127a6" is_pre_election: true
I20251212 09:11:22.358371 3330 raft_consensus.cc:2468] T bbf919545aff49809f878a147021c43e P 949bbf50f52549a193a8ed8d7441765a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba798a513464c5092d9c07bd724e2a1 in term 0.
I20251212 09:11:22.358392 3195 raft_consensus.cc:2468] T bbf919545aff49809f878a147021c43e P daf397d05bbb4e1fbbb354962f2127a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba798a513464c5092d9c07bd724e2a1 in term 0.
I20251212 09:11:22.358515 2993 leader_election.cc:304] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba798a513464c5092d9c07bd724e2a1, 949bbf50f52549a193a8ed8d7441765a; no voters:
I20251212 09:11:22.358651 3433 raft_consensus.cc:2804] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251212 09:11:22.358717 3433 raft_consensus.cc:493] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251212 09:11:22.358749 3433 raft_consensus.cc:3060] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:22.359333 3433 raft_consensus.cc:515] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:22.359463 3433 leader_election.cc:290] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [CANDIDATE]: Term 1 election: Requested vote from peers daf397d05bbb4e1fbbb354962f2127a6 (127.29.26.130:36063), 949bbf50f52549a193a8ed8d7441765a (127.29.26.131:42235)
I20251212 09:11:22.359665 3195 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bbf919545aff49809f878a147021c43e" candidate_uuid: "6ba798a513464c5092d9c07bd724e2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf397d05bbb4e1fbbb354962f2127a6"
I20251212 09:11:22.359678 3330 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bbf919545aff49809f878a147021c43e" candidate_uuid: "6ba798a513464c5092d9c07bd724e2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "949bbf50f52549a193a8ed8d7441765a"
I20251212 09:11:22.359740 3330 raft_consensus.cc:3060] T bbf919545aff49809f878a147021c43e P 949bbf50f52549a193a8ed8d7441765a [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:22.359743 3195 raft_consensus.cc:3060] T bbf919545aff49809f878a147021c43e P daf397d05bbb4e1fbbb354962f2127a6 [term 0 FOLLOWER]: Advancing to term 1
I20251212 09:11:22.360260 3330 raft_consensus.cc:2468] T bbf919545aff49809f878a147021c43e P 949bbf50f52549a193a8ed8d7441765a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba798a513464c5092d9c07bd724e2a1 in term 1.
I20251212 09:11:22.360407 3195 raft_consensus.cc:2468] T bbf919545aff49809f878a147021c43e P daf397d05bbb4e1fbbb354962f2127a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba798a513464c5092d9c07bd724e2a1 in term 1.
I20251212 09:11:22.360424 2993 leader_election.cc:304] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba798a513464c5092d9c07bd724e2a1, 949bbf50f52549a193a8ed8d7441765a; no voters:
I20251212 09:11:22.360561 3433 raft_consensus.cc:2804] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20251212 09:11:22.360723 3433 raft_consensus.cc:697] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [term 1 LEADER]: Becoming Leader. State: Replica: 6ba798a513464c5092d9c07bd724e2a1, State: Running, Role: LEADER
I20251212 09:11:22.360821 3433 consensus_queue.cc:237] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } } peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } }
I20251212 09:11:22.361517 2917 catalog_manager.cc:5654] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba798a513464c5092d9c07bd724e2a1 (127.29.26.129). New cstate: current_term: 1 leader_uuid: "6ba798a513464c5092d9c07bd724e2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba798a513464c5092d9c07bd724e2a1" member_type: VOTER last_known_addr { host: "127.29.26.129" port: 33699 } health_report { overall_health: HEALTHY } } }
I20251212 09:11:22.379940 3195 raft_consensus.cc:1275] T bbf919545aff49809f878a147021c43e P daf397d05bbb4e1fbbb354962f2127a6 [term 1 FOLLOWER]: Refusing update from remote peer 6ba798a513464c5092d9c07bd724e2a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251212 09:11:22.380179 3330 raft_consensus.cc:1275] T bbf919545aff49809f878a147021c43e P 949bbf50f52549a193a8ed8d7441765a [term 1 FOLLOWER]: Refusing update from remote peer 6ba798a513464c5092d9c07bd724e2a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251212 09:11:22.380281 3433 consensus_queue.cc:1048] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf397d05bbb4e1fbbb354962f2127a6" member_type: VOTER last_known_addr { host: "127.29.26.130" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251212 09:11:22.380403 3478 consensus_queue.cc:1048] T bbf919545aff49809f878a147021c43e P 6ba798a513464c5092d9c07bd724e2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "949bbf50f52549a193a8ed8d7441765a" member_type: VOTER last_known_addr { host: "127.29.26.131" port: 42235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251212 09:11:22.547163 3039 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20251212 09:11:22.547341 3310 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20251212 09:11:22.548285 3175 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
025c4ecefd044a838a505d42023da36c | 127.29.26.190:42029 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.29.26.148:40777 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
6ba798a513464c5092d9c07bd724e2a1 | 127.29.26.129:33699 | HEALTHY | <none> | 1 | 0
949bbf50f52549a193a8ed8d7441765a | 127.29.26.131:42235 | HEALTHY | <none> | 0 | 0
daf397d05bbb4e1fbbb354962f2127a6 | 127.29.26.130:36063 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.29.26.129 | experimental | 127.29.26.129:33699
local_ip_for_outbound_sockets | 127.29.26.130 | experimental | 127.29.26.130:36063
local_ip_for_outbound_sockets | 127.29.26.131 | experimental | 127.29.26.131:42235
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-0/data/info.pb | hidden | 127.29.26.129:33699
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-1/data/info.pb | hidden | 127.29.26.130:36063
server_dump_info_path | /tmp/dist-test-taskEI9Tzd/test-tmp/kudu-admin-test.5.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMaster_0.1765530660439309-29802-0/minicluster-data/ts-2/data/info.pb | hidden | 127.29.26.131:42235
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.29.26.148:40777 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
--------------+----+---------+---------------+---------+------------+------------------+-------------
post_rebuild | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20251212 09:11:22.558151 29802 log_verifier.cc:126] Checking tablet 939cd927cf4147fbb006027a44bf5e82
I20251212 09:11:22.558228 29802 log_verifier.cc:177] Verified matching terms for 0 ops in tablet 939cd927cf4147fbb006027a44bf5e82
I20251212 09:11:22.558254 29802 log_verifier.cc:126] Checking tablet bbf919545aff49809f878a147021c43e
I20251212 09:11:22.592350 29802 log_verifier.cc:177] Verified matching terms for 207 ops in tablet bbf919545aff49809f878a147021c43e
I20251212 09:11:22.594164 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 2973
I20251212 09:11:22.600036 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 3110
I20251212 09:11:22.605708 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 3244
I20251212 09:11:22.610424 29802 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskEI9Tzd/build/release/bin/kudu with pid 2885
2025-12-12T09:11:22Z chronyd exiting
[ OK ] IsSecure/SecureClusterAdminCliParamTest.TestRebuildMaster/0 (3752 ms)
[----------] 1 test from IsSecure/SecureClusterAdminCliParamTest (3752 ms total)
[----------] Global test environment tear-down
[==========] 9 tests from 5 test suites ran. (22188 ms total)
[ PASSED ] 8 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] AdminCliTest.TestRebuildTables
1 FAILED TEST