Note: This is test shard 3 of 8.
[==========] Running 10 tests from 5 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from AdminCliTest
[ RUN ] AdminCliTest.TestChangeConfig
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260805 19:52:37.102133 28462 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.269s user 0.486s sys 0.780s
W20260805 19:52:37.102993 28462 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.270s user 0.486s sys 0.780s
I20260805 19:52:37.105806 28462 ts_itest-base.cc:115] Starting cluster with:
I20260805 19:52:37.106082 28462 ts_itest-base.cc:116] --------------
I20260805 19:52:37.106305 28462 ts_itest-base.cc:117] 3 tablet servers
I20260805 19:52:37.106539 28462 ts_itest-base.cc:118] 2 replicas per TS
I20260805 19:52:37.106777 28462 ts_itest-base.cc:119] --------------
2026-08-05T19:52:37Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-05T19:52:37Z Disabled control of system clock
I20260805 19:52:37.160338 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:35761
--webserver_interface=127.27.203.190
--webserver_port=0
--builtin_ntp_servers=127.27.203.148:40117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.203.190:35761
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--allow_unsafe_replication_factor=true
--catalog_manager_evict_excess_replicas=false with env {}
W20260805 19:52:37.492909 28476 flags.cc:432] Enabled unsafe flag: --allow_unsafe_replication_factor=true
W20260805 19:52:37.493947 28476 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:52:37.494359 28476 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:52:37.494943 28476 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:52:37.529757 28476 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 19:52:37.530071 28476 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:52:37.530279 28476 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 19:52:37.530481 28476 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260805 19:52:37.569907 28476 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:40117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--allow_unsafe_replication_factor=true
--catalog_manager_evict_excess_replicas=false
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.27.203.190:35761
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:35761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.27.203.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:52:37.571722 28476 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:52:37.573913 28476 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:52:37.587488 28482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:52:38.991746 28481 debug-util.cc:398] Leaking SignalData structure 0x7b080002ede0 after lost signal to thread 28476
W20260805 19:52:39.215638 28481 kernel_stack_watchdog.cc:198] Thread 28476 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 401ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260805 19:52:37.587953 28483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:52:39.217072 28476 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.630s user 0.544s sys 1.071s
W20260805 19:52:39.217772 28476 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.631s user 0.544s sys 1.071s
W20260805 19:52:39.219525 28485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:52:39.222344 28484 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1628 milliseconds
I20260805 19:52:39.222378 28476 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:52:39.223694 28476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:52:39.226708 28476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:52:39.228080 28476 hybrid_clock.cc:648] HybridClock initialized: now 1785959559228041 us; error 70 us; skew 500 ppm
I20260805 19:52:39.228981 28476 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:52:39.236085 28476 webserver.cc:533] Webserver started at http://127.27.203.190:46805/ using document root <none> and password file <none>
I20260805 19:52:39.237133 28476 fs_manager.cc:362] Metadata directory not provided
I20260805 19:52:39.237383 28476 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:52:39.237879 28476 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:52:39.242614 28476 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "06f5e24d2d4141d1b21c7e348b19d5e8"
format_stamp: "Formatted at 2026-08-05 19:52:39 on dist-test-slave-27sr"
I20260805 19:52:39.243816 28476 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "06f5e24d2d4141d1b21c7e348b19d5e8"
format_stamp: "Formatted at 2026-08-05 19:52:39 on dist-test-slave-27sr"
I20260805 19:52:39.252635 28476 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260805 19:52:39.259403 28492 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:52:39.260906 28476 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260805 19:52:39.261287 28476 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
uuid: "06f5e24d2d4141d1b21c7e348b19d5e8"
format_stamp: "Formatted at 2026-08-05 19:52:39 on dist-test-slave-27sr"
I20260805 19:52:39.261698 28476 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:52:39.313395 28476 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:52:39.315176 28476 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:52:39.315651 28476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:52:39.395262 28476 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.190:35761
I20260805 19:52:39.395368 28543 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.190:35761 every 8 connection(s)
I20260805 19:52:39.398422 28476 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260805 19:52:39.405895 28544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:52:39.408692 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 28476
I20260805 19:52:39.409329 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260805 19:52:39.433399 28544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8: Bootstrap starting.
I20260805 19:52:39.442270 28544 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8: Neither blocks nor log segments found. Creating new log.
I20260805 19:52:39.444603 28544 log.cc:826] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8: Log is configured to *not* fsync() on all Append() calls
I20260805 19:52:39.450456 28544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8: No bootstrap required, opened a new log
I20260805 19:52:39.472299 28544 raft_consensus.cc:359] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f5e24d2d4141d1b21c7e348b19d5e8" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 35761 } }
I20260805 19:52:39.472956 28544 raft_consensus.cc:385] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:52:39.473166 28544 raft_consensus.cc:740] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f5e24d2d4141d1b21c7e348b19d5e8, State: Initialized, Role: FOLLOWER
I20260805 19:52:39.473882 28544 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f5e24d2d4141d1b21c7e348b19d5e8" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 35761 } }
I20260805 19:52:39.474388 28544 raft_consensus.cc:399] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:52:39.474623 28544 raft_consensus.cc:493] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:52:39.474902 28544 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:52:39.479498 28544 raft_consensus.cc:515] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f5e24d2d4141d1b21c7e348b19d5e8" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 35761 } }
I20260805 19:52:39.480247 28544 leader_election.cc:304] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 06f5e24d2d4141d1b21c7e348b19d5e8; no voters:
I20260805 19:52:39.481887 28544 leader_election.cc:290] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:52:39.482707 28550 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:52:39.485188 28550 raft_consensus.cc:697] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [term 1 LEADER]: Becoming Leader. State: Replica: 06f5e24d2d4141d1b21c7e348b19d5e8, State: Running, Role: LEADER
I20260805 19:52:39.486092 28550 consensus_queue.cc:237] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f5e24d2d4141d1b21c7e348b19d5e8" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 35761 } }
I20260805 19:52:39.486619 28544 sys_catalog.cc:565] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 19:52:39.499260 28551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "06f5e24d2d4141d1b21c7e348b19d5e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f5e24d2d4141d1b21c7e348b19d5e8" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 35761 } } }
I20260805 19:52:39.500029 28551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [sys.catalog]: This master's current role is: LEADER
I20260805 19:52:39.499253 28552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06f5e24d2d4141d1b21c7e348b19d5e8. Latest consensus state: current_term: 1 leader_uuid: "06f5e24d2d4141d1b21c7e348b19d5e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f5e24d2d4141d1b21c7e348b19d5e8" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 35761 } } }
I20260805 19:52:39.500551 28552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8 [sys.catalog]: This master's current role is: LEADER
I20260805 19:52:39.503865 28557 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260805 19:52:39.520670 28557 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260805 19:52:39.540452 28557 catalog_manager.cc:1383] Generated new cluster ID: a17154f22689495b8f040fddb015c75a
I20260805 19:52:39.540776 28557 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260805 19:52:39.564769 28557 catalog_manager.cc:1406] Generated new certificate authority record
I20260805 19:52:39.566377 28557 catalog_manager.cc:1540] Loading token signing keys...
I20260805 19:52:39.578260 28557 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 06f5e24d2d4141d1b21c7e348b19d5e8: Generated new TSK 0
I20260805 19:52:39.579619 28557 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260805 19:52:39.600606 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.129:0
--local_ip_for_outbound_sockets=127.27.203.129
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:35761
--builtin_ntp_servers=127.27.203.148:40117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260805 19:52:39.935858 28570 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 19:52:39.936576 28570 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:52:39.936892 28570 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:52:39.937390 28570 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:52:39.972625 28570 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:52:39.973567 28570 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.129
I20260805 19:52:40.013892 28570 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:40117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:35761
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:52:40.015329 28570 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:52:40.017333 28570 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:52:40.032902 28576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:52:41.436775 28575 debug-util.cc:398] Leaking SignalData structure 0x7b08000372a0 after lost signal to thread 28570
W20260805 19:52:40.034749 28577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:52:41.894658 28570 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.859s user 0.589s sys 1.198s
W20260805 19:52:41.895220 28570 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.861s user 0.590s sys 1.198s
W20260805 19:52:41.896066 28579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:52:41.899468 28578 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1865 milliseconds
I20260805 19:52:41.899539 28570 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:52:41.900843 28570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:52:41.903728 28570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:52:41.905272 28570 hybrid_clock.cc:648] HybridClock initialized: now 1785959561905219 us; error 65 us; skew 500 ppm
I20260805 19:52:41.906332 28570 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:52:41.914134 28570 webserver.cc:533] Webserver started at http://127.27.203.129:43201/ using document root <none> and password file <none>
I20260805 19:52:41.915143 28570 fs_manager.cc:362] Metadata directory not provided
I20260805 19:52:41.915374 28570 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:52:41.915869 28570 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:52:41.922857 28570 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "87d10378b448440ab8874dcfd4c985c4"
format_stamp: "Formatted at 2026-08-05 19:52:41 on dist-test-slave-27sr"
I20260805 19:52:41.924192 28570 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "87d10378b448440ab8874dcfd4c985c4"
format_stamp: "Formatted at 2026-08-05 19:52:41 on dist-test-slave-27sr"
I20260805 19:52:41.932389 28570 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.001s sys 0.006s
I20260805 19:52:41.938937 28587 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:52:41.940328 28570 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.002s sys 0.005s
I20260805 19:52:41.940687 28570 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "87d10378b448440ab8874dcfd4c985c4"
format_stamp: "Formatted at 2026-08-05 19:52:41 on dist-test-slave-27sr"
I20260805 19:52:41.941032 28570 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:52:42.024217 28570 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:52:42.025890 28570 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:52:42.026364 28570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:52:42.029935 28570 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:52:42.034740 28570 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:52:42.034963 28570 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:52:42.035264 28570 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:52:42.035447 28570 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:52:42.222105 28570 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.129:35363
I20260805 19:52:42.222314 28701 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.129:35363 every 8 connection(s)
I20260805 19:52:42.225057 28570 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260805 19:52:42.230940 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 28570
I20260805 19:52:42.231444 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260805 19:52:42.240554 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.130:0
--local_ip_for_outbound_sockets=127.27.203.130
--webserver_interface=127.27.203.130
--webserver_port=0
--tserver_master_addrs=127.27.203.190:35761
--builtin_ntp_servers=127.27.203.148:40117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260805 19:52:42.262745 28702 heartbeater.cc:344] Connected to a master server at 127.27.203.190:35761
I20260805 19:52:42.263353 28702 heartbeater.cc:461] Registering TS with master...
I20260805 19:52:42.265159 28702 heartbeater.cc:507] Master 127.27.203.190:35761 requested a full tablet report, sending...
I20260805 19:52:42.270048 28509 ts_manager.cc:194] Registered new tserver with Master: 87d10378b448440ab8874dcfd4c985c4 (127.27.203.129:35363)
I20260805 19:52:42.273460 28509 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.129:59305
W20260805 19:52:42.590341 28706 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 19:52:42.591009 28706 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:52:42.591336 28706 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:52:42.591837 28706 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:52:42.627384 28706 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:52:42.628360 28706 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.130
I20260805 19:52:42.669328 28706 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:40117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.27.203.130
--webserver_port=0
--tserver_master_addrs=127.27.203.190:35761
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:52:42.670840 28706 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:52:42.672668 28706 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:52:42.687283 28712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:52:43.278920 28702 heartbeater.cc:499] Master 127.27.203.190:35761 was elected leader, sending a full tablet report...
W20260805 19:52:42.687547 28713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:52:43.902953 28714 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
W20260805 19:52:43.905023 28715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:52:43.908872 28706 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.221s user 0.463s sys 0.757s
W20260805 19:52:43.909215 28706 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.222s user 0.463s sys 0.757s
I20260805 19:52:43.909523 28706 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:52:43.910760 28706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:52:43.915170 28706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:52:43.916620 28706 hybrid_clock.cc:648] HybridClock initialized: now 1785959563916568 us; error 73 us; skew 500 ppm
I20260805 19:52:43.917532 28706 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:52:43.925858 28706 webserver.cc:533] Webserver started at http://127.27.203.130:33397/ using document root <none> and password file <none>
I20260805 19:52:43.927053 28706 fs_manager.cc:362] Metadata directory not provided
I20260805 19:52:43.927340 28706 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:52:43.927832 28706 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:52:43.932588 28706 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "a70ab1c6647b4290a026b93edbad6a47"
format_stamp: "Formatted at 2026-08-05 19:52:43 on dist-test-slave-27sr"
I20260805 19:52:43.933744 28706 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "a70ab1c6647b4290a026b93edbad6a47"
format_stamp: "Formatted at 2026-08-05 19:52:43 on dist-test-slave-27sr"
I20260805 19:52:43.942368 28706 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.006s sys 0.003s
I20260805 19:52:43.949193 28722 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:52:43.950598 28706 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.002s sys 0.002s
I20260805 19:52:43.951002 28706 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "a70ab1c6647b4290a026b93edbad6a47"
format_stamp: "Formatted at 2026-08-05 19:52:43 on dist-test-slave-27sr"
I20260805 19:52:43.951377 28706 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:52:44.020787 28706 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:52:44.022372 28706 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:52:44.022871 28706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:52:44.025718 28706 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:52:44.030625 28706 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:52:44.030869 28706 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:52:44.031155 28706 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:52:44.031335 28706 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:52:44.182499 28706 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.130:38041
I20260805 19:52:44.182632 28836 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.130:38041 every 8 connection(s)
I20260805 19:52:44.185436 28706 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260805 19:52:44.190933 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 28706
I20260805 19:52:44.191447 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260805 19:52:44.198463 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.131:0
--local_ip_for_outbound_sockets=127.27.203.131
--webserver_interface=127.27.203.131
--webserver_port=0
--tserver_master_addrs=127.27.203.190:35761
--builtin_ntp_servers=127.27.203.148:40117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260805 19:52:44.210276 28837 heartbeater.cc:344] Connected to a master server at 127.27.203.190:35761
I20260805 19:52:44.210844 28837 heartbeater.cc:461] Registering TS with master...
I20260805 19:52:44.212415 28837 heartbeater.cc:507] Master 127.27.203.190:35761 requested a full tablet report, sending...
I20260805 19:52:44.215308 28509 ts_manager.cc:194] Registered new tserver with Master: a70ab1c6647b4290a026b93edbad6a47 (127.27.203.130:38041)
I20260805 19:52:44.216718 28509 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.130:34555
W20260805 19:52:44.531540 28841 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 19:52:44.532189 28841 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:52:44.532413 28841 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:52:44.532838 28841 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:52:44.568292 28841 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:52:44.569113 28841 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.131
I20260805 19:52:44.608042 28841 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:40117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.27.203.131
--webserver_port=0
--tserver_master_addrs=127.27.203.190:35761
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:52:44.609411 28841 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:52:44.611205 28841 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:52:44.627055 28847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:52:45.221366 28837 heartbeater.cc:499] Master 127.27.203.190:35761 was elected leader, sending a full tablet report...
W20260805 19:52:44.627632 28848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:52:44.631093 28841 server_base.cc:1061] running on GCE node
W20260805 19:52:44.630298 28850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:52:45.943979 28841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:52:45.946471 28841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:52:45.947985 28841 hybrid_clock.cc:648] HybridClock initialized: now 1785959565947879 us; error 51 us; skew 500 ppm
I20260805 19:52:45.948865 28841 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:52:45.955432 28841 webserver.cc:533] Webserver started at http://127.27.203.131:43445/ using document root <none> and password file <none>
I20260805 19:52:45.956499 28841 fs_manager.cc:362] Metadata directory not provided
I20260805 19:52:45.956758 28841 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:52:45.957270 28841 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:52:45.961881 28841 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "1eaec1e996194e5dbfc151892961eb37"
format_stamp: "Formatted at 2026-08-05 19:52:45 on dist-test-slave-27sr"
I20260805 19:52:45.963050 28841 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "1eaec1e996194e5dbfc151892961eb37"
format_stamp: "Formatted at 2026-08-05 19:52:45 on dist-test-slave-27sr"
I20260805 19:52:45.970949 28841 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.006s sys 0.004s
I20260805 19:52:45.977231 28859 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:52:45.978956 28841 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.000s sys 0.005s
I20260805 19:52:45.979372 28841 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "1eaec1e996194e5dbfc151892961eb37"
format_stamp: "Formatted at 2026-08-05 19:52:45 on dist-test-slave-27sr"
I20260805 19:52:45.979739 28841 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:52:46.057916 28841 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:52:46.059618 28841 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:52:46.060130 28841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:52:46.063054 28841 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:52:46.067746 28841 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:52:46.068019 28841 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260805 19:52:46.068326 28841 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:52:46.068511 28841 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:52:46.236514 28841 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.131:34965
I20260805 19:52:46.236634 28971 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.131:34965 every 8 connection(s)
I20260805 19:52:46.239300 28841 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260805 19:52:46.241871 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 28841
I20260805 19:52:46.242653 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260805 19:52:46.270402 28972 heartbeater.cc:344] Connected to a master server at 127.27.203.190:35761
I20260805 19:52:46.270958 28972 heartbeater.cc:461] Registering TS with master...
I20260805 19:52:46.272356 28972 heartbeater.cc:507] Master 127.27.203.190:35761 requested a full tablet report, sending...
I20260805 19:52:46.274813 28509 ts_manager.cc:194] Registered new tserver with Master: 1eaec1e996194e5dbfc151892961eb37 (127.27.203.131:34965)
I20260805 19:52:46.276175 28509 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.131:58533
I20260805 19:52:46.281865 28462 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260805 19:52:46.331243 28509 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44338:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20260805 19:52:46.413745 28907 tablet_service.cc:1511] Processing CreateTablet for tablet 60898b76b4c8427e94b83333ab53cea6 (DEFAULT_TABLE table=TestTable [id=a2caa572b6a54b34913a2f1baa9ab8e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:52:46.416138 28907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60898b76b4c8427e94b83333ab53cea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:52:46.415993 28770 tablet_service.cc:1511] Processing CreateTablet for tablet 60898b76b4c8427e94b83333ab53cea6 (DEFAULT_TABLE table=TestTable [id=a2caa572b6a54b34913a2f1baa9ab8e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:52:46.418087 28770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60898b76b4c8427e94b83333ab53cea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:52:46.441275 28989 tablet_bootstrap.cc:492] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37: Bootstrap starting.
I20260805 19:52:46.447844 28990 tablet_bootstrap.cc:492] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47: Bootstrap starting.
I20260805 19:52:46.450758 28989 tablet_bootstrap.cc:654] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37: Neither blocks nor log segments found. Creating new log.
I20260805 19:52:46.453298 28989 log.cc:826] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37: Log is configured to *not* fsync() on all Append() calls
I20260805 19:52:46.454841 28990 tablet_bootstrap.cc:654] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47: Neither blocks nor log segments found. Creating new log.
I20260805 19:52:46.457530 28990 log.cc:826] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47: Log is configured to *not* fsync() on all Append() calls
I20260805 19:52:46.459613 28989 tablet_bootstrap.cc:492] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37: No bootstrap required, opened a new log
I20260805 19:52:46.460446 28989 ts_tablet_manager.cc:1403] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37: Time spent bootstrapping tablet: real 0.020s user 0.013s sys 0.004s
I20260805 19:52:46.463120 28990 tablet_bootstrap.cc:492] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47: No bootstrap required, opened a new log
I20260805 19:52:46.463776 28990 ts_tablet_manager.cc:1403] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.008s
I20260805 19:52:46.484441 28990 raft_consensus.cc:359] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } }
I20260805 19:52:46.485514 28990 raft_consensus.cc:740] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70ab1c6647b4290a026b93edbad6a47, State: Initialized, Role: FOLLOWER
I20260805 19:52:46.486029 28989 raft_consensus.cc:359] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } }
I20260805 19:52:46.486155 28990 consensus_queue.cc:260] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } }
I20260805 19:52:46.486665 28989 raft_consensus.cc:740] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eaec1e996194e5dbfc151892961eb37, State: Initialized, Role: FOLLOWER
I20260805 19:52:46.487267 28989 consensus_queue.cc:260] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } }
I20260805 19:52:46.490161 28972 heartbeater.cc:499] Master 127.27.203.190:35761 was elected leader, sending a full tablet report...
I20260805 19:52:46.490473 28990 ts_tablet_manager.cc:1434] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47: Time spent starting tablet: real 0.026s user 0.021s sys 0.003s
I20260805 19:52:46.491078 28989 ts_tablet_manager.cc:1434] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37: Time spent starting tablet: real 0.030s user 0.026s sys 0.005s
W20260805 19:52:46.494445 28973 tablet.cc:2406] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 19:52:46.520828 28462 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260805 19:52:46.525699 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver a70ab1c6647b4290a026b93edbad6a47 to finish bootstrapping
I20260805 19:52:46.542121 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 1eaec1e996194e5dbfc151892961eb37 to finish bootstrapping
I20260805 19:52:46.567317 28927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60898b76b4c8427e94b83333ab53cea6"
dest_uuid: "1eaec1e996194e5dbfc151892961eb37"
from {username='slave'} at 127.0.0.1:41312
I20260805 19:52:46.568087 28927 raft_consensus.cc:493] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260805 19:52:46.568431 28927 raft_consensus.cc:3060] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:52:46.573257 28927 raft_consensus.cc:515] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } }
I20260805 19:52:46.575350 28927 leader_election.cc:290] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [CANDIDATE]: Term 1 election: Requested vote from peers a70ab1c6647b4290a026b93edbad6a47 (127.27.203.130:38041)
I20260805 19:52:46.586560 28790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60898b76b4c8427e94b83333ab53cea6" candidate_uuid: "1eaec1e996194e5dbfc151892961eb37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a70ab1c6647b4290a026b93edbad6a47"
I20260805 19:52:46.587565 28790 raft_consensus.cc:3060] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:52:46.593730 28790 raft_consensus.cc:2468] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eaec1e996194e5dbfc151892961eb37 in term 1.
I20260805 19:52:46.595443 28860 leader_election.cc:304] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1eaec1e996194e5dbfc151892961eb37, a70ab1c6647b4290a026b93edbad6a47; no voters:
I20260805 19:52:46.596673 28994 raft_consensus.cc:2804] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:52:46.599417 28994 raft_consensus.cc:697] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [term 1 LEADER]: Becoming Leader. State: Replica: 1eaec1e996194e5dbfc151892961eb37, State: Running, Role: LEADER
I20260805 19:52:46.600420 28994 consensus_queue.cc:237] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } }
I20260805 19:52:46.612716 28462 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 1.1
I20260805 19:52:46.614009 28507 catalog_manager.cc:5697] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1eaec1e996194e5dbfc151892961eb37 (127.27.203.131). New cstate: current_term: 1 leader_uuid: "1eaec1e996194e5dbfc151892961eb37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } health_report { overall_health: UNKNOWN } } }
W20260805 19:52:46.693549 28838 tablet.cc:2406] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 19:52:46.717650 28462 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 1.1
I20260805 19:52:46.922600 28462 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 1.1
I20260805 19:52:47.090452 28994 consensus_queue.cc:1048] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 19:52:47.261456 28462 test_workload.cc:405] TestWorkload: Skipping table creation because table TestTable already exists
I20260805 19:52:47.272181 28462 kudu-admin-test.cc:313] Adding replica at tserver with UUID 87d10378b448440ab8874dcfd4c985c4 as VOTER...
I20260805 19:52:49.876084 28927 consensus_queue.cc:237] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 1.125, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } } peers { permanent_uuid: "87d10378b448440ab8874dcfd4c985c4" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35363 } }
I20260805 19:52:49.882211 28790 raft_consensus.cc:1275] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47 [term 1 FOLLOWER]: Refusing update from remote peer 1eaec1e996194e5dbfc151892961eb37: Log matching property violated. Preceding OpId in replica: term: 1 index: 125. Preceding OpId from leader: term: 1 index: 127. (index mismatch)
I20260805 19:52:49.883832 29030 consensus_queue.cc:1048] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.001s
I20260805 19:52:49.891824 29022 raft_consensus.cc:2955] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [term 1 LEADER]: Committing config change with OpId 1.126: config changed from index -1 to 126, VOTER 87d10378b448440ab8874dcfd4c985c4 (127.27.203.129) added. New config: { opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } } peers { permanent_uuid: "87d10378b448440ab8874dcfd4c985c4" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35363 } } }
I20260805 19:52:49.893371 28790 raft_consensus.cc:2955] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47 [term 1 FOLLOWER]: Committing config change with OpId 1.126: config changed from index -1 to 126, VOTER 87d10378b448440ab8874dcfd4c985c4 (127.27.203.129) added. New config: { opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } } peers { permanent_uuid: "87d10378b448440ab8874dcfd4c985c4" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35363 } } }
W20260805 19:52:49.897294 28863 consensus_peers.cc:597] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 -> Peer 87d10378b448440ab8874dcfd4c985c4 (127.27.203.129:35363): Couldn't send request to peer 87d10378b448440ab8874dcfd4c985c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 60898b76b4c8427e94b83333ab53cea6. This is attempt 1: this message will repeat every 5th retry.
I20260805 19:52:49.905828 28507 catalog_manager.cc:5697] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 reported cstate change: config changed from index -1 to 126, VOTER 87d10378b448440ab8874dcfd4c985c4 (127.27.203.129) added. New cstate: current_term: 1 leader_uuid: "1eaec1e996194e5dbfc151892961eb37" committed_config { opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87d10378b448440ab8874dcfd4c985c4" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35363 } health_report { overall_health: UNKNOWN } } }
I20260805 19:52:50.276746 29048 ts_tablet_manager.cc:933] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: Initiating tablet copy from peer 1eaec1e996194e5dbfc151892961eb37 (127.27.203.131:34965)
I20260805 19:52:50.283041 29048 tablet_copy_client.cc:323] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: tablet copy: Beginning tablet copy session from remote peer at address 127.27.203.131:34965
I20260805 19:52:50.303215 28947 tablet_copy_service.cc:140] P 1eaec1e996194e5dbfc151892961eb37: Received BeginTabletCopySession request for tablet 60898b76b4c8427e94b83333ab53cea6 from peer 87d10378b448440ab8874dcfd4c985c4 ({username='slave'} at 127.27.203.129:60557)
I20260805 19:52:50.303833 28947 tablet_copy_service.cc:161] P 1eaec1e996194e5dbfc151892961eb37: Beginning new tablet copy session on tablet 60898b76b4c8427e94b83333ab53cea6 from peer 87d10378b448440ab8874dcfd4c985c4 at {username='slave'} at 127.27.203.129:60557: session id = 87d10378b448440ab8874dcfd4c985c4-60898b76b4c8427e94b83333ab53cea6
I20260805 19:52:50.312728 28947 tablet_copy_source_session.cc:215] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37: Tablet Copy: opened 0 blocks and 1 log segments
I20260805 19:52:50.322563 29048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60898b76b4c8427e94b83333ab53cea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:52:50.348099 29048 tablet_copy_client.cc:806] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: tablet copy: Starting download of 0 data blocks...
I20260805 19:52:50.348778 29048 tablet_copy_client.cc:670] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: tablet copy: Starting download of 1 WAL segments...
I20260805 19:52:50.356639 29048 tablet_copy_client.cc:538] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260805 19:52:50.365461 29048 tablet_bootstrap.cc:492] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: Bootstrap starting.
I20260805 19:52:50.472513 29048 log.cc:826] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: Log is configured to *not* fsync() on all Append() calls
I20260805 19:52:50.908716 29048 tablet_bootstrap.cc:492] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=158 overwritten=0 applied=158 ignored=0} inserts{seen=156 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 19:52:50.909726 29048 tablet_bootstrap.cc:492] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: Bootstrap complete.
I20260805 19:52:50.910543 29048 ts_tablet_manager.cc:1403] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: Time spent bootstrapping tablet: real 0.546s user 0.491s sys 0.048s
I20260805 19:52:50.928767 29048 raft_consensus.cc:359] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } } peers { permanent_uuid: "87d10378b448440ab8874dcfd4c985c4" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35363 } }
I20260805 19:52:50.929898 29048 raft_consensus.cc:740] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87d10378b448440ab8874dcfd4c985c4, State: Initialized, Role: FOLLOWER
I20260805 19:52:50.930657 29048 consensus_queue.cc:260] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 158, Last appended: 1.158, Last appended by leader: 158, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } } peers { permanent_uuid: "87d10378b448440ab8874dcfd4c985c4" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35363 } }
I20260805 19:52:50.958997 29048 ts_tablet_manager.cc:1434] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: Time spent starting tablet: real 0.048s user 0.026s sys 0.020s
I20260805 19:52:50.961098 28947 tablet_copy_service.cc:342] P 1eaec1e996194e5dbfc151892961eb37: Request end of tablet copy session 87d10378b448440ab8874dcfd4c985c4-60898b76b4c8427e94b83333ab53cea6 received from {username='slave'} at 127.27.203.129:60557
I20260805 19:52:50.961508 28947 tablet_copy_service.cc:434] P 1eaec1e996194e5dbfc151892961eb37: ending tablet copy session 87d10378b448440ab8874dcfd4c985c4-60898b76b4c8427e94b83333ab53cea6 on tablet 60898b76b4c8427e94b83333ab53cea6 with peer 87d10378b448440ab8874dcfd4c985c4
I20260805 19:52:50.993831 28462 kudu-admin-test.cc:333] Waiting for replicas to agree...
I20260805 19:52:51.011941 28462 cluster_itest_util.cc:258] Not converged past 208 yet: 1.158 1.208 1.208
I20260805 19:52:51.118950 28462 cluster_itest_util.cc:258] Not converged past 208 yet: 1.158 1.208 1.208
I20260805 19:52:51.136384 28656 raft_consensus.cc:1217] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.125->[1.126-1.208] Dedup: 1.158->[1.159-1.208]
I20260805 19:52:51.327071 28462 kudu-admin-test.cc:344] Number of rows inserted: 206
I20260805 19:52:51.636320 28907 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260805 19:52:51.651796 28635 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260805 19:52:51.659318 28770 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
06f5e24d2d4141d1b21c7e348b19d5e8 | 127.27.203.190:35761 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
allow_unsafe_replication_factor | true | runtime,unsafe | all 1 server(s) checked
catalog_manager_evict_excess_replicas | false | runtime,hidden | all 1 server(s) checked
catalog_manager_wait_for_new_tablets_to_elect_leader | false | hidden | all 1 server(s) checked
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.27.203.148:40117 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
1eaec1e996194e5dbfc151892961eb37 | 127.27.203.131:34965 | HEALTHY | <none> | 1 | 0
87d10378b448440ab8874dcfd4c985c4 | 127.27.203.129:35363 | HEALTHY | <none> | 0 | 0
a70ab1c6647b4290a026b93edbad6a47 | 127.27.203.130:38041 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
enable_leader_failure_detection | false | unsafe | all 3 server(s) checked
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.27.203.129 | experimental | 127.27.203.129:35363
local_ip_for_outbound_sockets | 127.27.203.130 | experimental | 127.27.203.130:38041
local_ip_for_outbound_sockets | 127.27.203.131 | experimental | 127.27.203.131:34965
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.27.203.129:35363
server_dump_info_path | /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.27.203.130:38041
server_dump_info_path | /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.27.203.131:34965
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.27.203.148:40117 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 2 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260805 19:52:51.896631 28462 log_verifier.cc:126] Checking tablet 60898b76b4c8427e94b83333ab53cea6
I20260805 19:52:52.254621 28462 log_verifier.cc:177] Verified matching terms for 208 ops in tablet 60898b76b4c8427e94b83333ab53cea6
I20260805 19:52:52.316398 28462 kudu-admin-test.cc:351] Removing replica at tserver with UUID 87d10378b448440ab8874dcfd4c985c4 from the config...
I20260805 19:52:54.801285 28927 consensus_queue.cc:237] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 208, Committed index: 208, Last appended: 1.208, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } }
I20260805 19:52:54.806416 28790 raft_consensus.cc:1275] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47 [term 1 FOLLOWER]: Refusing update from remote peer 1eaec1e996194e5dbfc151892961eb37: Log matching property violated. Preceding OpId in replica: term: 1 index: 208. Preceding OpId from leader: term: 1 index: 209. (index mismatch)
I20260805 19:52:54.807739 29022 consensus_queue.cc:1048] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 209, Last known committed idx: 208, Time since last communication: 0.000s
I20260805 19:52:54.815419 29119 raft_consensus.cc:2955] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 [term 1 LEADER]: Committing config change with OpId 1.209: config changed from index 126 to 209, VOTER 87d10378b448440ab8874dcfd4c985c4 (127.27.203.129) evicted. New config: { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } } }
I20260805 19:52:54.816823 28790 raft_consensus.cc:2955] T 60898b76b4c8427e94b83333ab53cea6 P a70ab1c6647b4290a026b93edbad6a47 [term 1 FOLLOWER]: Committing config change with OpId 1.209: config changed from index 126 to 209, VOTER 87d10378b448440ab8874dcfd4c985c4 (127.27.203.129) evicted. New config: { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } } }
I20260805 19:52:54.829115 28507 catalog_manager.cc:5697] T 60898b76b4c8427e94b83333ab53cea6 P 1eaec1e996194e5dbfc151892961eb37 reported cstate change: config changed from index 126 to 209, VOTER 87d10378b448440ab8874dcfd4c985c4 (127.27.203.129) evicted. New cstate: current_term: 1 leader_uuid: "1eaec1e996194e5dbfc151892961eb37" committed_config { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "1eaec1e996194e5dbfc151892961eb37" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 34965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a70ab1c6647b4290a026b93edbad6a47" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38041 } health_report { overall_health: HEALTHY } } }
I20260805 19:52:54.851991 28635 tablet_service.cc:1558] Processing DeleteTablet for tablet 60898b76b4c8427e94b83333ab53cea6 with delete_type TABLET_DATA_TOMBSTONED (TS 87d10378b448440ab8874dcfd4c985c4 not found in new config with opid_index 209) from {username='slave'} at 127.0.0.1:56266
I20260805 19:52:54.853798 29128 tablet_replica.cc:333] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: stopping tablet replica
I20260805 19:52:54.854511 29128 raft_consensus.cc:2243] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 19:52:54.855994 29128 raft_consensus.cc:2272] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 19:52:54.859107 29128 ts_tablet_manager.cc:1916] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260805 19:52:54.869472 29128 ts_tablet_manager.cc:1929] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.208
I20260805 19:52:54.869834 29128 log.cc:1199] T 60898b76b4c8427e94b83333ab53cea6 P 87d10378b448440ab8874dcfd4c985c4: Deleting WAL directory at /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestChangeConfig.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/wals/60898b76b4c8427e94b83333ab53cea6
I20260805 19:52:54.871681 28496 catalog_manager.cc:5028] TS 87d10378b448440ab8874dcfd4c985c4 (127.27.203.129:35363): tablet 60898b76b4c8427e94b83333ab53cea6 (table TestTable [id=a2caa572b6a54b34913a2f1baa9ab8e9]) successfully deleted
I20260805 19:52:55.924742 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 28570
I20260805 19:52:55.959717 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 28706
I20260805 19:52:55.997622 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 28841
I20260805 19:52:56.043332 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 28476
2026-08-05T19:52:56Z chronyd exiting
[ OK ] AdminCliTest.TestChangeConfig (20329 ms)
[ RUN ] AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs
I20260805 19:52:56.114914 28462 ts_itest-base.cc:115] Starting cluster with:
I20260805 19:52:56.115104 28462 ts_itest-base.cc:116] --------------
I20260805 19:52:56.115232 28462 ts_itest-base.cc:117] 9 tablet servers
I20260805 19:52:56.115336 28462 ts_itest-base.cc:118] 5 replicas per TS
I20260805 19:52:56.115451 28462 ts_itest-base.cc:119] --------------
2026-08-05T19:52:56Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-05T19:52:56Z Disabled control of system clock
I20260805 19:52:56.162230 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:42041
--webserver_interface=127.27.203.190
--webserver_port=0
--builtin_ntp_servers=127.27.203.148:34649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.203.190:42041 with env {}
W20260805 19:52:56.490146 29137 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:52:56.490834 29137 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:52:56.491324 29137 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:52:56.525709 29137 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 19:52:56.526118 29137 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:52:56.526407 29137 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 19:52:56.526674 29137 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260805 19:52:56.566233 29137 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:34649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.203.190:42041
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:42041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.27.203.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:52:56.567716 29137 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:52:56.569582 29137 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:52:56.581887 29143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:52:56.582038 29144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:52:57.808595 29146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:52:57.810312 29145 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1222 milliseconds
W20260805 19:52:57.811981 29137 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.230s user 0.363s sys 0.865s
W20260805 19:52:57.812270 29137 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.231s user 0.363s sys 0.867s
I20260805 19:52:57.812453 29137 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:52:57.813572 29137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:52:57.816579 29137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:52:57.818063 29137 hybrid_clock.cc:648] HybridClock initialized: now 1785959577817992 us; error 84 us; skew 500 ppm
I20260805 19:52:57.818995 29137 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:52:57.827191 29137 webserver.cc:533] Webserver started at http://127.27.203.190:34085/ using document root <none> and password file <none>
I20260805 19:52:57.828444 29137 fs_manager.cc:362] Metadata directory not provided
I20260805 19:52:57.828722 29137 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:52:57.829286 29137 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:52:57.833928 29137 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "e3757234f40a4f29b6a19aa27036b995"
format_stamp: "Formatted at 2026-08-05 19:52:57 on dist-test-slave-27sr"
I20260805 19:52:57.835237 29137 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "e3757234f40a4f29b6a19aa27036b995"
format_stamp: "Formatted at 2026-08-05 19:52:57 on dist-test-slave-27sr"
I20260805 19:52:57.844135 29137 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.005s sys 0.006s
I20260805 19:52:57.851560 29153 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:52:57.853327 29137 fs_manager.cc:730] Time spent opening block manager: real 0.006s user 0.004s sys 0.003s
I20260805 19:52:57.853767 29137 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
uuid: "e3757234f40a4f29b6a19aa27036b995"
format_stamp: "Formatted at 2026-08-05 19:52:57 on dist-test-slave-27sr"
I20260805 19:52:57.854180 29137 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:52:57.934397 29137 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:52:57.936125 29137 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:52:57.936625 29137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:52:58.014560 29137 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.190:42041
I20260805 19:52:58.014642 29205 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.190:42041 every 8 connection(s)
I20260805 19:52:58.017915 29137 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260805 19:52:58.019906 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 29137
I20260805 19:52:58.020378 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260805 19:52:58.027451 29206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:52:58.049687 29206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995: Bootstrap starting.
I20260805 19:52:58.056779 29206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995: Neither blocks nor log segments found. Creating new log.
I20260805 19:52:58.058815 29206 log.cc:826] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995: Log is configured to *not* fsync() on all Append() calls
I20260805 19:52:58.064615 29206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995: No bootstrap required, opened a new log
I20260805 19:52:58.088536 29206 raft_consensus.cc:359] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3757234f40a4f29b6a19aa27036b995" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42041 } }
I20260805 19:52:58.089557 29206 raft_consensus.cc:385] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:52:58.089824 29206 raft_consensus.cc:740] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3757234f40a4f29b6a19aa27036b995, State: Initialized, Role: FOLLOWER
I20260805 19:52:58.090628 29206 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3757234f40a4f29b6a19aa27036b995" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42041 } }
I20260805 19:52:58.091217 29206 raft_consensus.cc:399] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:52:58.091488 29206 raft_consensus.cc:493] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:52:58.091990 29206 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:52:58.096818 29206 raft_consensus.cc:515] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3757234f40a4f29b6a19aa27036b995" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42041 } }
I20260805 19:52:58.097633 29206 leader_election.cc:304] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3757234f40a4f29b6a19aa27036b995; no voters:
I20260805 19:52:58.099602 29206 leader_election.cc:290] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:52:58.100419 29212 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:52:58.103582 29212 raft_consensus.cc:697] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [term 1 LEADER]: Becoming Leader. State: Replica: e3757234f40a4f29b6a19aa27036b995, State: Running, Role: LEADER
I20260805 19:52:58.104461 29212 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3757234f40a4f29b6a19aa27036b995" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42041 } }
I20260805 19:52:58.105424 29206 sys_catalog.cc:565] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 19:52:58.112500 29213 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3757234f40a4f29b6a19aa27036b995" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3757234f40a4f29b6a19aa27036b995" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42041 } } }
I20260805 19:52:58.112682 29214 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3757234f40a4f29b6a19aa27036b995. Latest consensus state: current_term: 1 leader_uuid: "e3757234f40a4f29b6a19aa27036b995" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3757234f40a4f29b6a19aa27036b995" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42041 } } }
I20260805 19:52:58.113391 29213 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [sys.catalog]: This master's current role is: LEADER
I20260805 19:52:58.113633 29214 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995 [sys.catalog]: This master's current role is: LEADER
I20260805 19:52:58.119536 29220 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260805 19:52:58.131834 29220 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260805 19:52:58.150707 29220 catalog_manager.cc:1383] Generated new cluster ID: f77ceb620dc44f5ab9a5f278108ae778
I20260805 19:52:58.151053 29220 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260805 19:52:58.189648 29220 catalog_manager.cc:1406] Generated new certificate authority record
I20260805 19:52:58.191727 29220 catalog_manager.cc:1540] Loading token signing keys...
I20260805 19:52:58.211772 29220 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e3757234f40a4f29b6a19aa27036b995: Generated new TSK 0
I20260805 19:52:58.212875 29220 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260805 19:52:58.229673 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.129:0
--local_ip_for_outbound_sockets=127.27.203.129
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--builtin_ntp_servers=127.27.203.148:34649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20260805 19:52:58.576251 29231 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:52:58.576751 29231 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:52:58.577181 29231 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:52:58.612393 29231 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:52:58.613233 29231 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.129
I20260805 19:52:58.654158 29231 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:34649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:52:58.655536 29231 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:52:58.657325 29231 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:52:58.671607 29238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:52:58.676530 29241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:52:58.674571 29239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:00.235052 29240 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1559 milliseconds
I20260805 19:53:00.235201 29231 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:53:00.236660 29231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:53:00.239602 29231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:53:00.241091 29231 hybrid_clock.cc:648] HybridClock initialized: now 1785959580241033 us; error 67 us; skew 500 ppm
I20260805 19:53:00.241925 29231 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:53:00.248400 29231 webserver.cc:533] Webserver started at http://127.27.203.129:45379/ using document root <none> and password file <none>
I20260805 19:53:00.249408 29231 fs_manager.cc:362] Metadata directory not provided
I20260805 19:53:00.249599 29231 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:53:00.250027 29231 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:53:00.254585 29231 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "e76542db2ad84812b1ef9a4b24125379"
format_stamp: "Formatted at 2026-08-05 19:53:00 on dist-test-slave-27sr"
I20260805 19:53:00.255750 29231 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "e76542db2ad84812b1ef9a4b24125379"
format_stamp: "Formatted at 2026-08-05 19:53:00 on dist-test-slave-27sr"
I20260805 19:53:00.263800 29231 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260805 19:53:00.270074 29250 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:00.271371 29231 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260805 19:53:00.271759 29231 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "e76542db2ad84812b1ef9a4b24125379"
format_stamp: "Formatted at 2026-08-05 19:53:00 on dist-test-slave-27sr"
I20260805 19:53:00.272203 29231 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:53:00.322402 29231 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:53:00.324568 29231 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:53:00.325160 29231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:53:00.328408 29231 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:53:00.333420 29231 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:53:00.333724 29231 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:00.334067 29231 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:53:00.334278 29231 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:00.486729 29231 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.129:42841
I20260805 19:53:00.486868 29365 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.129:42841 every 8 connection(s)
I20260805 19:53:00.489538 29231 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260805 19:53:00.496479 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 29231
I20260805 19:53:00.497018 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260805 19:53:00.504181 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.130:0
--local_ip_for_outbound_sockets=127.27.203.130
--webserver_interface=127.27.203.130
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--builtin_ntp_servers=127.27.203.148:34649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:53:00.513929 29366 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42041
I20260805 19:53:00.514503 29366 heartbeater.cc:461] Registering TS with master...
I20260805 19:53:00.515702 29366 heartbeater.cc:507] Master 127.27.203.190:42041 requested a full tablet report, sending...
I20260805 19:53:00.518565 29170 ts_manager.cc:194] Registered new tserver with Master: e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841)
I20260805 19:53:00.520725 29170 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.129:44049
W20260805 19:53:00.838657 29370 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:00.839246 29370 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:53:00.839767 29370 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:00.874892 29370 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:53:00.875834 29370 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.130
I20260805 19:53:00.914497 29370 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:34649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.27.203.130
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:53:00.915942 29370 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:53:00.917802 29370 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:53:00.930531 29376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:53:01.525106 29366 heartbeater.cc:499] Master 127.27.203.190:42041 was elected leader, sending a full tablet report...
W20260805 19:53:00.935536 29377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:00.940775 29379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:02.279343 29378 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1345 milliseconds
I20260805 19:53:02.279489 29370 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:53:02.280853 29370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:53:02.283775 29370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:53:02.285256 29370 hybrid_clock.cc:648] HybridClock initialized: now 1785959582285193 us; error 70 us; skew 500 ppm
I20260805 19:53:02.286115 29370 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:53:02.293267 29370 webserver.cc:533] Webserver started at http://127.27.203.130:43981/ using document root <none> and password file <none>
I20260805 19:53:02.294272 29370 fs_manager.cc:362] Metadata directory not provided
I20260805 19:53:02.294515 29370 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:53:02.295011 29370 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:53:02.299449 29370 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "9f0d4403b3d041728ce5ced3f9bf2c22"
format_stamp: "Formatted at 2026-08-05 19:53:02 on dist-test-slave-27sr"
I20260805 19:53:02.300608 29370 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "9f0d4403b3d041728ce5ced3f9bf2c22"
format_stamp: "Formatted at 2026-08-05 19:53:02 on dist-test-slave-27sr"
I20260805 19:53:02.308619 29370 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260805 19:53:02.315196 29386 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:02.316656 29370 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260805 19:53:02.317147 29370 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "9f0d4403b3d041728ce5ced3f9bf2c22"
format_stamp: "Formatted at 2026-08-05 19:53:02 on dist-test-slave-27sr"
I20260805 19:53:02.317577 29370 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:53:02.374718 29370 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:53:02.376477 29370 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:53:02.377105 29370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:53:02.380173 29370 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:53:02.384974 29370 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:53:02.385257 29370 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:02.385550 29370 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:53:02.385761 29370 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:02.543159 29370 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.130:43229
I20260805 19:53:02.543264 29500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.130:43229 every 8 connection(s)
I20260805 19:53:02.546244 29370 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260805 19:53:02.546756 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 29370
I20260805 19:53:02.547153 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260805 19:53:02.554716 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.131:0
--local_ip_for_outbound_sockets=127.27.203.131
--webserver_interface=127.27.203.131
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--builtin_ntp_servers=127.27.203.148:34649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:53:02.572803 29501 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42041
I20260805 19:53:02.573269 29501 heartbeater.cc:461] Registering TS with master...
I20260805 19:53:02.574388 29501 heartbeater.cc:507] Master 127.27.203.190:42041 requested a full tablet report, sending...
I20260805 19:53:02.577025 29170 ts_manager.cc:194] Registered new tserver with Master: 9f0d4403b3d041728ce5ced3f9bf2c22 (127.27.203.130:43229)
I20260805 19:53:02.579260 29170 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.130:59533
W20260805 19:53:02.895720 29505 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:02.896318 29505 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:53:02.896772 29505 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:02.931941 29505 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:53:02.933691 29505 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.131
I20260805 19:53:02.974350 29505 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:34649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.27.203.131
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:53:02.975733 29505 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:53:02.977638 29505 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:53:02.990809 29512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:53:03.583402 29501 heartbeater.cc:499] Master 127.27.203.190:42041 was elected leader, sending a full tablet report...
W20260805 19:53:02.992563 29513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:04.358389 29514 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1365 milliseconds
W20260805 19:53:04.358812 29505 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.367s user 0.352s sys 0.974s
W20260805 19:53:04.359167 29505 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.368s user 0.352s sys 0.974s
W20260805 19:53:04.359690 29515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:53:04.359735 29505 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:53:04.361137 29505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:53:04.363651 29505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:53:04.365056 29505 hybrid_clock.cc:648] HybridClock initialized: now 1785959584365022 us; error 45 us; skew 500 ppm
I20260805 19:53:04.365933 29505 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:53:04.373588 29505 webserver.cc:533] Webserver started at http://127.27.203.131:42289/ using document root <none> and password file <none>
I20260805 19:53:04.374704 29505 fs_manager.cc:362] Metadata directory not provided
I20260805 19:53:04.374990 29505 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:53:04.375519 29505 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:53:04.380379 29505 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "a1000b4299fe4823b17fe31352fde4db"
format_stamp: "Formatted at 2026-08-05 19:53:04 on dist-test-slave-27sr"
I20260805 19:53:04.381578 29505 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "a1000b4299fe4823b17fe31352fde4db"
format_stamp: "Formatted at 2026-08-05 19:53:04 on dist-test-slave-27sr"
I20260805 19:53:04.390228 29505 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.006s sys 0.002s
I20260805 19:53:04.396917 29522 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:04.398212 29505 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260805 19:53:04.398569 29505 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "a1000b4299fe4823b17fe31352fde4db"
format_stamp: "Formatted at 2026-08-05 19:53:04 on dist-test-slave-27sr"
I20260805 19:53:04.398942 29505 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:53:04.478578 29505 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:53:04.480329 29505 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:53:04.480770 29505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:53:04.483436 29505 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:53:04.487946 29505 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:53:04.488193 29505 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260805 19:53:04.488479 29505 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:53:04.488657 29505 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:04.637764 29505 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.131:44695
I20260805 19:53:04.638042 29637 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.131:44695 every 8 connection(s)
I20260805 19:53:04.641021 29505 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260805 19:53:04.649745 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 29505
I20260805 19:53:04.650367 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260805 19:53:04.659507 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.132:0
--local_ip_for_outbound_sockets=127.27.203.132
--webserver_interface=127.27.203.132
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--builtin_ntp_servers=127.27.203.148:34649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:53:04.675818 29638 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42041
I20260805 19:53:04.676519 29638 heartbeater.cc:461] Registering TS with master...
I20260805 19:53:04.678227 29638 heartbeater.cc:507] Master 127.27.203.190:42041 requested a full tablet report, sending...
I20260805 19:53:04.681679 29170 ts_manager.cc:194] Registered new tserver with Master: a1000b4299fe4823b17fe31352fde4db (127.27.203.131:44695)
I20260805 19:53:04.683929 29170 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.131:35849
W20260805 19:53:05.006043 29643 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:05.006559 29643 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:53:05.007099 29643 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:05.043758 29643 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:53:05.044745 29643 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.132
I20260805 19:53:05.086757 29643 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:34649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.27.203.132
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.132
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:53:05.088261 29643 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:53:05.089994 29643 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:53:05.102916 29649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:53:05.689220 29638 heartbeater.cc:499] Master 127.27.203.190:42041 was elected leader, sending a full tablet report...
W20260805 19:53:05.104879 29650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:06.353380 29652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:06.355836 29651 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1247 milliseconds
I20260805 19:53:06.356060 29643 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:53:06.357352 29643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:53:06.359776 29643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:53:06.361307 29643 hybrid_clock.cc:648] HybridClock initialized: now 1785959586361233 us; error 53 us; skew 500 ppm
I20260805 19:53:06.362253 29643 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:53:06.369279 29643 webserver.cc:533] Webserver started at http://127.27.203.132:32847/ using document root <none> and password file <none>
I20260805 19:53:06.370362 29643 fs_manager.cc:362] Metadata directory not provided
I20260805 19:53:06.370628 29643 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:53:06.371152 29643 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:53:06.375779 29643 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "8b0580ac924d4abeb23860468eb5af1c"
format_stamp: "Formatted at 2026-08-05 19:53:06 on dist-test-slave-27sr"
I20260805 19:53:06.377116 29643 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "8b0580ac924d4abeb23860468eb5af1c"
format_stamp: "Formatted at 2026-08-05 19:53:06 on dist-test-slave-27sr"
I20260805 19:53:06.385607 29643 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s
I20260805 19:53:06.392293 29660 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:06.393790 29643 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260805 19:53:06.394217 29643 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "8b0580ac924d4abeb23860468eb5af1c"
format_stamp: "Formatted at 2026-08-05 19:53:06 on dist-test-slave-27sr"
I20260805 19:53:06.394640 29643 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:53:06.451148 29643 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:53:06.453141 29643 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:53:06.453675 29643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:53:06.456848 29643 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:53:06.461884 29643 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:53:06.462177 29643 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:06.462478 29643 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:53:06.462677 29643 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:06.632289 29643 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.132:35043
I20260805 19:53:06.632397 29777 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.132:35043 every 8 connection(s)
I20260805 19:53:06.635169 29643 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260805 19:53:06.645303 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 29643
I20260805 19:53:06.646117 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20260805 19:53:06.656373 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.133:0
--local_ip_for_outbound_sockets=127.27.203.133
--webserver_interface=127.27.203.133
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--builtin_ntp_servers=127.27.203.148:34649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:53:06.667758 29778 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42041
I20260805 19:53:06.668344 29778 heartbeater.cc:461] Registering TS with master...
I20260805 19:53:06.669565 29778 heartbeater.cc:507] Master 127.27.203.190:42041 requested a full tablet report, sending...
I20260805 19:53:06.672623 29170 ts_manager.cc:194] Registered new tserver with Master: 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043)
I20260805 19:53:06.674088 29170 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.132:34285
W20260805 19:53:06.998198 29782 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:06.998788 29782 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:53:06.999289 29782 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:07.036671 29782 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:53:07.037570 29782 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.133
I20260805 19:53:07.076835 29782 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:34649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.133:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.27.203.133
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.133
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:53:07.078281 29782 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:53:07.080183 29782 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:53:07.093822 29788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:53:07.677631 29778 heartbeater.cc:499] Master 127.27.203.190:42041 was elected leader, sending a full tablet report...
W20260805 19:53:07.094971 29789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:08.387259 29791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:08.391136 29790 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1296 milliseconds
I20260805 19:53:08.391232 29782 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:53:08.392732 29782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:53:08.395030 29782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:53:08.396409 29782 hybrid_clock.cc:648] HybridClock initialized: now 1785959588396368 us; error 43 us; skew 500 ppm
I20260805 19:53:08.397238 29782 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:53:08.403836 29782 webserver.cc:533] Webserver started at http://127.27.203.133:34729/ using document root <none> and password file <none>
I20260805 19:53:08.405012 29782 fs_manager.cc:362] Metadata directory not provided
I20260805 19:53:08.405268 29782 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:53:08.405761 29782 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:53:08.410497 29782 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "04f5834a0ae64a4aae8891b860ba894e"
format_stamp: "Formatted at 2026-08-05 19:53:08 on dist-test-slave-27sr"
I20260805 19:53:08.412036 29782 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "04f5834a0ae64a4aae8891b860ba894e"
format_stamp: "Formatted at 2026-08-05 19:53:08 on dist-test-slave-27sr"
I20260805 19:53:08.420363 29782 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260805 19:53:08.426802 29798 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:08.428198 29782 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.006s sys 0.001s
I20260805 19:53:08.428577 29782 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "04f5834a0ae64a4aae8891b860ba894e"
format_stamp: "Formatted at 2026-08-05 19:53:08 on dist-test-slave-27sr"
I20260805 19:53:08.429010 29782 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:53:08.499207 29782 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:53:08.500885 29782 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:53:08.501359 29782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:53:08.504200 29782 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:53:08.508733 29782 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:53:08.508997 29782 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:08.509270 29782 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:53:08.509416 29782 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:08.683329 29782 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.133:34249
I20260805 19:53:08.683447 29919 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.133:34249 every 8 connection(s)
I20260805 19:53:08.686761 29782 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260805 19:53:08.690238 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 29782
I20260805 19:53:08.690838 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20260805 19:53:08.698724 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.134:0
--local_ip_for_outbound_sockets=127.27.203.134
--webserver_interface=127.27.203.134
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--builtin_ntp_servers=127.27.203.148:34649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:53:08.719188 29920 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42041
I20260805 19:53:08.720062 29920 heartbeater.cc:461] Registering TS with master...
I20260805 19:53:08.721885 29920 heartbeater.cc:507] Master 127.27.203.190:42041 requested a full tablet report, sending...
I20260805 19:53:08.725200 29170 ts_manager.cc:194] Registered new tserver with Master: 04f5834a0ae64a4aae8891b860ba894e (127.27.203.133:34249)
I20260805 19:53:08.726677 29170 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.133:41761
W20260805 19:53:09.059058 29924 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:09.059630 29924 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:53:09.060235 29924 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:09.095710 29924 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:53:09.096681 29924 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.134
I20260805 19:53:09.136420 29924 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:34649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.134:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.27.203.134
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.134
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:53:09.137871 29924 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:53:09.139567 29924 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:53:09.153455 29930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:53:09.730608 29920 heartbeater.cc:499] Master 127.27.203.190:42041 was elected leader, sending a full tablet report...
W20260805 19:53:10.557183 29929 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee20 after lost signal to thread 29924
W20260805 19:53:10.901010 29924 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.748s user 0.549s sys 1.131s
W20260805 19:53:10.901441 29924 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.748s user 0.549s sys 1.131s
W20260805 19:53:09.154956 29931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:10.903738 29933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:10.906306 29932 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1748 milliseconds
I20260805 19:53:10.906365 29924 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:53:10.907876 29924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:53:10.910701 29924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:53:10.912091 29924 hybrid_clock.cc:648] HybridClock initialized: now 1785959590912035 us; error 66 us; skew 500 ppm
I20260805 19:53:10.913174 29924 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:53:10.920693 29924 webserver.cc:533] Webserver started at http://127.27.203.134:32775/ using document root <none> and password file <none>
I20260805 19:53:10.921756 29924 fs_manager.cc:362] Metadata directory not provided
I20260805 19:53:10.922032 29924 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:53:10.922549 29924 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:53:10.927703 29924 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/data/instance:
uuid: "e78c3b5c173d4d1c854a19614a9a0e2b"
format_stamp: "Formatted at 2026-08-05 19:53:10 on dist-test-slave-27sr"
I20260805 19:53:10.928826 29924 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/wal/instance:
uuid: "e78c3b5c173d4d1c854a19614a9a0e2b"
format_stamp: "Formatted at 2026-08-05 19:53:10 on dist-test-slave-27sr"
I20260805 19:53:10.939863 29924 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.009s sys 0.001s
I20260805 19:53:10.947309 29942 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:10.948843 29924 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.001s sys 0.002s
I20260805 19:53:10.949254 29924 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "e78c3b5c173d4d1c854a19614a9a0e2b"
format_stamp: "Formatted at 2026-08-05 19:53:10 on dist-test-slave-27sr"
I20260805 19:53:10.949620 29924 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:53:11.012003 29924 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:53:11.013693 29924 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:53:11.014220 29924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:53:11.017529 29924 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:53:11.022563 29924 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:53:11.022833 29924 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:11.023129 29924 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:53:11.023408 29924 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.001s
I20260805 19:53:11.196488 29924 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.134:36883
I20260805 19:53:11.196578 30056 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.134:36883 every 8 connection(s)
I20260805 19:53:11.199280 29924 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20260805 19:53:11.200348 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 29924
I20260805 19:53:11.200788 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-5/wal/instance
I20260805 19:53:11.210290 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.135:0
--local_ip_for_outbound_sockets=127.27.203.135
--webserver_interface=127.27.203.135
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--builtin_ntp_servers=127.27.203.148:34649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:53:11.230631 30057 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42041
I20260805 19:53:11.231223 30057 heartbeater.cc:461] Registering TS with master...
I20260805 19:53:11.232793 30057 heartbeater.cc:507] Master 127.27.203.190:42041 requested a full tablet report, sending...
I20260805 19:53:11.236168 29170 ts_manager.cc:194] Registered new tserver with Master: e78c3b5c173d4d1c854a19614a9a0e2b (127.27.203.134:36883)
I20260805 19:53:11.238221 29170 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.134:53455
W20260805 19:53:11.609385 30061 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:11.610000 30061 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:53:11.610553 30061 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:11.655031 30061 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:53:11.655983 30061 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.135
I20260805 19:53:11.707561 30061 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:34649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.135:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.27.203.135
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.135
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:53:11.709030 30061 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:53:11.710922 30061 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:53:11.726598 30067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:53:12.244357 30057 heartbeater.cc:499] Master 127.27.203.190:42041 was elected leader, sending a full tablet report...
W20260805 19:53:13.131068 30066 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee20 after lost signal to thread 30061
W20260805 19:53:13.691983 30061 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.965s user 0.727s sys 1.216s
W20260805 19:53:11.727496 30068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:13.695268 30069 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1966 milliseconds
W20260805 19:53:13.694051 30061 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.967s user 0.728s sys 1.216s
W20260805 19:53:13.696942 30070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:53:13.697450 30061 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:53:13.700136 30061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:53:13.703096 30061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:53:13.704608 30061 hybrid_clock.cc:648] HybridClock initialized: now 1785959593704562 us; error 50 us; skew 500 ppm
I20260805 19:53:13.705585 30061 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:53:13.713496 30061 webserver.cc:533] Webserver started at http://127.27.203.135:36129/ using document root <none> and password file <none>
I20260805 19:53:13.714633 30061 fs_manager.cc:362] Metadata directory not provided
I20260805 19:53:13.714953 30061 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:53:13.715502 30061 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:53:13.720804 30061 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/data/instance:
uuid: "e39fac85b9ed4768904828983ce2dc91"
format_stamp: "Formatted at 2026-08-05 19:53:13 on dist-test-slave-27sr"
I20260805 19:53:13.722158 30061 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/wal/instance:
uuid: "e39fac85b9ed4768904828983ce2dc91"
format_stamp: "Formatted at 2026-08-05 19:53:13 on dist-test-slave-27sr"
I20260805 19:53:13.732645 30061 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.009s sys 0.001s
I20260805 19:53:13.740396 30079 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:13.741856 30061 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260805 19:53:13.742210 30061 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "e39fac85b9ed4768904828983ce2dc91"
format_stamp: "Formatted at 2026-08-05 19:53:13 on dist-test-slave-27sr"
I20260805 19:53:13.742561 30061 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260805 19:53:13.749634 29634 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6e00 after lost signal to thread 29506
W20260805 19:53:13.751683 29634 debug-util.cc:398] Leaking SignalData structure 0x7b08000b40a0 after lost signal to thread 29637
I20260805 19:53:13.848336 30061 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:53:13.850842 30061 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:53:13.851500 30061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:53:13.856348 30061 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:53:13.863572 30061 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:53:13.863780 30061 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:13.864132 30061 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:53:13.864339 30061 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:14.129036 30061 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.135:38391
I20260805 19:53:14.129160 30194 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.135:38391 every 8 connection(s)
I20260805 19:53:14.131865 30061 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20260805 19:53:14.142124 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 30061
I20260805 19:53:14.142665 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-6/wal/instance
I20260805 19:53:14.151628 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.136:0
--local_ip_for_outbound_sockets=127.27.203.136
--webserver_interface=127.27.203.136
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--builtin_ntp_servers=127.27.203.148:34649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:53:14.161808 30195 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42041
I20260805 19:53:14.162335 30195 heartbeater.cc:461] Registering TS with master...
I20260805 19:53:14.163544 30195 heartbeater.cc:507] Master 127.27.203.190:42041 requested a full tablet report, sending...
I20260805 19:53:14.166277 29170 ts_manager.cc:194] Registered new tserver with Master: e39fac85b9ed4768904828983ce2dc91 (127.27.203.135:38391)
I20260805 19:53:14.167783 29170 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.135:54267
W20260805 19:53:14.570441 30199 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:14.571197 30199 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:53:14.571770 30199 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:14.607335 30199 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:53:14.608278 30199 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.136
I20260805 19:53:14.655107 30199 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:34649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.136:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.27.203.136
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.136
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:53:14.656639 30199 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:53:14.658834 30199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:53:14.675323 30205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:53:15.172364 30195 heartbeater.cc:499] Master 127.27.203.190:42041 was elected leader, sending a full tablet report...
W20260805 19:53:16.078871 30204 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee20 after lost signal to thread 30199
W20260805 19:53:16.558704 30199 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.882s user 0.510s sys 1.003s
W20260805 19:53:16.560420 30199 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.883s user 0.510s sys 1.003s
W20260805 19:53:16.560444 30207 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1882 milliseconds
W20260805 19:53:16.559612 30208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:53:16.560901 30199 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
W20260805 19:53:14.677796 30206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:53:16.566726 30199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:53:16.569591 30199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:53:16.571050 30199 hybrid_clock.cc:648] HybridClock initialized: now 1785959596571024 us; error 62 us; skew 500 ppm
I20260805 19:53:16.572053 30199 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:53:16.579433 30199 webserver.cc:533] Webserver started at http://127.27.203.136:36229/ using document root <none> and password file <none>
I20260805 19:53:16.580541 30199 fs_manager.cc:362] Metadata directory not provided
I20260805 19:53:16.580826 30199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:53:16.581326 30199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:53:16.586131 30199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/data/instance:
uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5"
format_stamp: "Formatted at 2026-08-05 19:53:16 on dist-test-slave-27sr"
I20260805 19:53:16.588160 30199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/wal/instance:
uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5"
format_stamp: "Formatted at 2026-08-05 19:53:16 on dist-test-slave-27sr"
I20260805 19:53:16.597107 30199 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.002s sys 0.006s
I20260805 19:53:16.604756 30218 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:16.606344 30199 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260805 19:53:16.606776 30199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5"
format_stamp: "Formatted at 2026-08-05 19:53:16 on dist-test-slave-27sr"
I20260805 19:53:16.607378 30199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:53:16.666100 30199 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:53:16.668121 30199 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:53:16.668731 30199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:53:16.672331 30199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:53:16.677126 30199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:53:16.677342 30199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:16.677546 30199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:53:16.677687 30199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:16.888670 30199 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.136:40435
I20260805 19:53:16.888808 30334 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.136:40435 every 8 connection(s)
I20260805 19:53:16.891597 30199 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20260805 19:53:16.897998 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 30199
I20260805 19:53:16.898953 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-7/wal/instance
I20260805 19:53:16.909080 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.137:0
--local_ip_for_outbound_sockets=127.27.203.137
--webserver_interface=127.27.203.137
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--builtin_ntp_servers=127.27.203.148:34649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:53:16.928339 30335 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42041
I20260805 19:53:16.928862 30335 heartbeater.cc:461] Registering TS with master...
I20260805 19:53:16.930119 30335 heartbeater.cc:507] Master 127.27.203.190:42041 requested a full tablet report, sending...
I20260805 19:53:16.936460 29169 ts_manager.cc:194] Registered new tserver with Master: 3dd67d0015fe4e12bd7fc6b7b2ef59e5 (127.27.203.136:40435)
I20260805 19:53:16.938845 29169 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.136:35137
W20260805 19:53:17.318792 30339 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:17.319386 30339 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:53:17.319952 30339 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:17.356217 30339 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:53:17.357131 30339 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.137
I20260805 19:53:17.397491 30339 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:34649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.137:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/data/info.pb
--webserver_interface=127.27.203.137
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42041
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.137
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:53:17.398994 30339 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:53:17.400847 30339 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:53:17.415234 30346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:53:17.944453 30335 heartbeater.cc:499] Master 127.27.203.190:42041 was elected leader, sending a full tablet report...
W20260805 19:53:17.417865 30347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:18.799744 30349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:18.802027 30348 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1378 milliseconds
I20260805 19:53:18.802127 30339 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:53:18.803426 30339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:53:18.806458 30339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:53:18.807968 30339 hybrid_clock.cc:648] HybridClock initialized: now 1785959598807849 us; error 46 us; skew 500 ppm
I20260805 19:53:18.808982 30339 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:53:18.819427 30339 webserver.cc:533] Webserver started at http://127.27.203.137:41787/ using document root <none> and password file <none>
I20260805 19:53:18.820704 30339 fs_manager.cc:362] Metadata directory not provided
I20260805 19:53:18.821002 30339 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:53:18.821612 30339 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:53:18.827538 30339 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/data/instance:
uuid: "cd36f97e947143e7b83775495de7bd87"
format_stamp: "Formatted at 2026-08-05 19:53:18 on dist-test-slave-27sr"
I20260805 19:53:18.829003 30339 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/wal/instance:
uuid: "cd36f97e947143e7b83775495de7bd87"
format_stamp: "Formatted at 2026-08-05 19:53:18 on dist-test-slave-27sr"
I20260805 19:53:18.840194 30339 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.006s sys 0.005s
I20260805 19:53:18.848889 30357 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:18.850265 30339 fs_manager.cc:730] Time spent opening block manager: real 0.006s user 0.000s sys 0.004s
I20260805 19:53:18.850623 30339 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/wal
uuid: "cd36f97e947143e7b83775495de7bd87"
format_stamp: "Formatted at 2026-08-05 19:53:18 on dist-test-slave-27sr"
I20260805 19:53:18.851050 30339 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:53:18.914789 30339 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:53:18.917649 30339 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:53:18.918358 30339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:53:18.923558 30339 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:53:18.931092 30339 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:53:18.931439 30339 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:18.931859 30339 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:53:18.932137 30339 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.002s
I20260805 19:53:19.219489 30339 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.137:44781
I20260805 19:53:19.219609 30471 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.137:44781 every 8 connection(s)
I20260805 19:53:19.222404 30339 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/data/info.pb
I20260805 19:53:19.230939 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 30339
I20260805 19:53:19.231545 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-8/wal/instance
I20260805 19:53:19.246248 30472 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42041
I20260805 19:53:19.246786 30472 heartbeater.cc:461] Registering TS with master...
I20260805 19:53:19.248107 30472 heartbeater.cc:507] Master 127.27.203.190:42041 requested a full tablet report, sending...
I20260805 19:53:19.250634 29169 ts_manager.cc:194] Registered new tserver with Master: cd36f97e947143e7b83775495de7bd87 (127.27.203.137:44781)
I20260805 19:53:19.252429 29169 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.137:38743
I20260805 19:53:19.257117 28462 external_mini_cluster.cc:955] 9 TS(s) registered with all masters
I20260805 19:53:19.300192 29169 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38416:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20260805 19:53:19.410811 30266 tablet_service.cc:1511] Processing CreateTablet for tablet 0cc9d79670ed4f3896304a5e988dc8ba (DEFAULT_TABLE table=TestTable [id=e168ad97dee6422fb6d20b90fda7a8bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:53:19.410877 29435 tablet_service.cc:1511] Processing CreateTablet for tablet 0cc9d79670ed4f3896304a5e988dc8ba (DEFAULT_TABLE table=TestTable [id=e168ad97dee6422fb6d20b90fda7a8bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:53:19.413177 29435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cc9d79670ed4f3896304a5e988dc8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:53:19.413147 30266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cc9d79670ed4f3896304a5e988dc8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:53:19.423848 29713 tablet_service.cc:1511] Processing CreateTablet for tablet 0cc9d79670ed4f3896304a5e988dc8ba (DEFAULT_TABLE table=TestTable [id=e168ad97dee6422fb6d20b90fda7a8bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:53:19.426956 29713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cc9d79670ed4f3896304a5e988dc8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:53:19.432905 30407 tablet_service.cc:1511] Processing CreateTablet for tablet 0cc9d79670ed4f3896304a5e988dc8ba (DEFAULT_TABLE table=TestTable [id=e168ad97dee6422fb6d20b90fda7a8bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:53:19.435724 30407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cc9d79670ed4f3896304a5e988dc8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:53:19.459743 30494 tablet_bootstrap.cc:492] T 0cc9d79670ed4f3896304a5e988dc8ba P 9f0d4403b3d041728ce5ced3f9bf2c22: Bootstrap starting.
I20260805 19:53:19.471935 30495 tablet_bootstrap.cc:492] T 0cc9d79670ed4f3896304a5e988dc8ba P 3dd67d0015fe4e12bd7fc6b7b2ef59e5: Bootstrap starting.
I20260805 19:53:19.473572 29298 tablet_service.cc:1511] Processing CreateTablet for tablet 0cc9d79670ed4f3896304a5e988dc8ba (DEFAULT_TABLE table=TestTable [id=e168ad97dee6422fb6d20b90fda7a8bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:53:19.477131 30494 tablet_bootstrap.cc:654] T 0cc9d79670ed4f3896304a5e988dc8ba P 9f0d4403b3d041728ce5ced3f9bf2c22: Neither blocks nor log segments found. Creating new log.
I20260805 19:53:19.477241 29298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cc9d79670ed4f3896304a5e988dc8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:53:19.486217 30494 log.cc:826] T 0cc9d79670ed4f3896304a5e988dc8ba P 9f0d4403b3d041728ce5ced3f9bf2c22: Log is configured to *not* fsync() on all Append() calls
I20260805 19:53:19.491964 30496 tablet_bootstrap.cc:492] T 0cc9d79670ed4f3896304a5e988dc8ba P 8b0580ac924d4abeb23860468eb5af1c: Bootstrap starting.
I20260805 19:53:19.505434 30495 tablet_bootstrap.cc:654] T 0cc9d79670ed4f3896304a5e988dc8ba P 3dd67d0015fe4e12bd7fc6b7b2ef59e5: Neither blocks nor log segments found. Creating new log.
I20260805 19:53:19.509239 30498 tablet_bootstrap.cc:492] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87: Bootstrap starting.
I20260805 19:53:19.509297 30495 log.cc:826] T 0cc9d79670ed4f3896304a5e988dc8ba P 3dd67d0015fe4e12bd7fc6b7b2ef59e5: Log is configured to *not* fsync() on all Append() calls
I20260805 19:53:19.514603 30496 tablet_bootstrap.cc:654] T 0cc9d79670ed4f3896304a5e988dc8ba P 8b0580ac924d4abeb23860468eb5af1c: Neither blocks nor log segments found. Creating new log.
I20260805 19:53:19.515512 30494 tablet_bootstrap.cc:492] T 0cc9d79670ed4f3896304a5e988dc8ba P 9f0d4403b3d041728ce5ced3f9bf2c22: No bootstrap required, opened a new log
I20260805 19:53:19.516577 30494 ts_tablet_manager.cc:1403] T 0cc9d79670ed4f3896304a5e988dc8ba P 9f0d4403b3d041728ce5ced3f9bf2c22: Time spent bootstrapping tablet: real 0.058s user 0.021s sys 0.000s
I20260805 19:53:19.517448 30496 log.cc:826] T 0cc9d79670ed4f3896304a5e988dc8ba P 8b0580ac924d4abeb23860468eb5af1c: Log is configured to *not* fsync() on all Append() calls
I20260805 19:53:19.528046 30495 tablet_bootstrap.cc:492] T 0cc9d79670ed4f3896304a5e988dc8ba P 3dd67d0015fe4e12bd7fc6b7b2ef59e5: No bootstrap required, opened a new log
I20260805 19:53:19.528826 30495 ts_tablet_manager.cc:1403] T 0cc9d79670ed4f3896304a5e988dc8ba P 3dd67d0015fe4e12bd7fc6b7b2ef59e5: Time spent bootstrapping tablet: real 0.058s user 0.013s sys 0.010s
I20260805 19:53:19.530371 30498 tablet_bootstrap.cc:654] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87: Neither blocks nor log segments found. Creating new log.
I20260805 19:53:19.533488 30498 log.cc:826] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87: Log is configured to *not* fsync() on all Append() calls
I20260805 19:53:19.536711 30502 tablet_bootstrap.cc:492] T 0cc9d79670ed4f3896304a5e988dc8ba P e76542db2ad84812b1ef9a4b24125379: Bootstrap starting.
I20260805 19:53:19.543711 30498 tablet_bootstrap.cc:492] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87: No bootstrap required, opened a new log
I20260805 19:53:19.544335 30498 ts_tablet_manager.cc:1403] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87: Time spent bootstrapping tablet: real 0.036s user 0.012s sys 0.010s
I20260805 19:53:19.546103 30502 tablet_bootstrap.cc:654] T 0cc9d79670ed4f3896304a5e988dc8ba P e76542db2ad84812b1ef9a4b24125379: Neither blocks nor log segments found. Creating new log.
I20260805 19:53:19.549003 30502 log.cc:826] T 0cc9d79670ed4f3896304a5e988dc8ba P e76542db2ad84812b1ef9a4b24125379: Log is configured to *not* fsync() on all Append() calls
I20260805 19:53:19.561493 30502 tablet_bootstrap.cc:492] T 0cc9d79670ed4f3896304a5e988dc8ba P e76542db2ad84812b1ef9a4b24125379: No bootstrap required, opened a new log
I20260805 19:53:19.542943 30496 tablet_bootstrap.cc:492] T 0cc9d79670ed4f3896304a5e988dc8ba P 8b0580ac924d4abeb23860468eb5af1c: No bootstrap required, opened a new log
I20260805 19:53:19.562130 30502 ts_tablet_manager.cc:1403] T 0cc9d79670ed4f3896304a5e988dc8ba P e76542db2ad84812b1ef9a4b24125379: Time spent bootstrapping tablet: real 0.027s user 0.009s sys 0.013s
I20260805 19:53:19.562536 30496 ts_tablet_manager.cc:1403] T 0cc9d79670ed4f3896304a5e988dc8ba P 8b0580ac924d4abeb23860468eb5af1c: Time spent bootstrapping tablet: real 0.072s user 0.014s sys 0.007s
I20260805 19:53:19.572530 30495 raft_consensus.cc:359] T 0cc9d79670ed4f3896304a5e988dc8ba P 3dd67d0015fe4e12bd7fc6b7b2ef59e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }
I20260805 19:53:19.573662 30495 raft_consensus.cc:385] T 0cc9d79670ed4f3896304a5e988dc8ba P 3dd67d0015fe4e12bd7fc6b7b2ef59e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:53:19.573982 30495 raft_consensus.cc:740] T 0cc9d79670ed4f3896304a5e988dc8ba P 3dd67d0015fe4e12bd7fc6b7b2ef59e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dd67d0015fe4e12bd7fc6b7b2ef59e5, State: Initialized, Role: FOLLOWER
I20260805 19:53:19.575269 30495 consensus_queue.cc:260] T 0cc9d79670ed4f3896304a5e988dc8ba P 3dd67d0015fe4e12bd7fc6b7b2ef59e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }
I20260805 19:53:19.577453 30498 raft_consensus.cc:359] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }
I20260805 19:53:19.578552 30498 raft_consensus.cc:385] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:53:19.578899 30498 raft_consensus.cc:740] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd36f97e947143e7b83775495de7bd87, State: Initialized, Role: FOLLOWER
I20260805 19:53:19.580147 30498 consensus_queue.cc:260] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }
I20260805 19:53:19.601540 30495 ts_tablet_manager.cc:1434] T 0cc9d79670ed4f3896304a5e988dc8ba P 3dd67d0015fe4e12bd7fc6b7b2ef59e5: Time spent starting tablet: real 0.072s user 0.028s sys 0.024s
I20260805 19:53:19.617986 30472 heartbeater.cc:499] Master 127.27.203.190:42041 was elected leader, sending a full tablet report...
I20260805 19:53:19.618618 30498 ts_tablet_manager.cc:1434] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87: Time spent starting tablet: real 0.074s user 0.031s sys 0.039s
I20260805 19:53:19.625777 30502 raft_consensus.cc:359] T 0cc9d79670ed4f3896304a5e988dc8ba P e76542db2ad84812b1ef9a4b24125379 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }
I20260805 19:53:19.626911 30502 raft_consensus.cc:385] T 0cc9d79670ed4f3896304a5e988dc8ba P e76542db2ad84812b1ef9a4b24125379 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:53:19.627224 30502 raft_consensus.cc:740] T 0cc9d79670ed4f3896304a5e988dc8ba P e76542db2ad84812b1ef9a4b24125379 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e76542db2ad84812b1ef9a4b24125379, State: Initialized, Role: FOLLOWER
I20260805 19:53:19.628264 30502 consensus_queue.cc:260] T 0cc9d79670ed4f3896304a5e988dc8ba P e76542db2ad84812b1ef9a4b24125379 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }
I20260805 19:53:19.628252 30494 raft_consensus.cc:359] T 0cc9d79670ed4f3896304a5e988dc8ba P 9f0d4403b3d041728ce5ced3f9bf2c22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }
I20260805 19:53:19.629627 30494 raft_consensus.cc:385] T 0cc9d79670ed4f3896304a5e988dc8ba P 9f0d4403b3d041728ce5ced3f9bf2c22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:53:19.630038 30494 raft_consensus.cc:740] T 0cc9d79670ed4f3896304a5e988dc8ba P 9f0d4403b3d041728ce5ced3f9bf2c22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0d4403b3d041728ce5ced3f9bf2c22, State: Initialized, Role: FOLLOWER
I20260805 19:53:19.631453 30494 consensus_queue.cc:260] T 0cc9d79670ed4f3896304a5e988dc8ba P 9f0d4403b3d041728ce5ced3f9bf2c22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }
I20260805 19:53:19.638724 30496 raft_consensus.cc:359] T 0cc9d79670ed4f3896304a5e988dc8ba P 8b0580ac924d4abeb23860468eb5af1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }
I20260805 19:53:19.639990 30496 raft_consensus.cc:385] T 0cc9d79670ed4f3896304a5e988dc8ba P 8b0580ac924d4abeb23860468eb5af1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:53:19.640357 30496 raft_consensus.cc:740] T 0cc9d79670ed4f3896304a5e988dc8ba P 8b0580ac924d4abeb23860468eb5af1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b0580ac924d4abeb23860468eb5af1c, State: Initialized, Role: FOLLOWER
I20260805 19:53:19.641594 30496 consensus_queue.cc:260] T 0cc9d79670ed4f3896304a5e988dc8ba P 8b0580ac924d4abeb23860468eb5af1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }
I20260805 19:53:19.643471 30494 ts_tablet_manager.cc:1434] T 0cc9d79670ed4f3896304a5e988dc8ba P 9f0d4403b3d041728ce5ced3f9bf2c22: Time spent starting tablet: real 0.126s user 0.036s sys 0.010s
I20260805 19:53:19.648808 30496 ts_tablet_manager.cc:1434] T 0cc9d79670ed4f3896304a5e988dc8ba P 8b0580ac924d4abeb23860468eb5af1c: Time spent starting tablet: real 0.086s user 0.031s sys 0.008s
I20260805 19:53:19.650909 30502 ts_tablet_manager.cc:1434] T 0cc9d79670ed4f3896304a5e988dc8ba P e76542db2ad84812b1ef9a4b24125379: Time spent starting tablet: real 0.088s user 0.035s sys 0.005s
W20260805 19:53:19.651114 30336 tablet.cc:2406] T 0cc9d79670ed4f3896304a5e988dc8ba P 3dd67d0015fe4e12bd7fc6b7b2ef59e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 19:53:19.661551 29779 tablet.cc:2406] T 0cc9d79670ed4f3896304a5e988dc8ba P 8b0580ac924d4abeb23860468eb5af1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 19:53:19.730271 30473 tablet.cc:2406] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 19:53:19.772019 30506 raft_consensus.cc:493] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 19:53:19.772608 30506 raft_consensus.cc:515] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }
W20260805 19:53:19.778216 29367 tablet.cc:2406] T 0cc9d79670ed4f3896304a5e988dc8ba P e76542db2ad84812b1ef9a4b24125379: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 19:53:19.780360 30506 leader_election.cc:290] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dd67d0015fe4e12bd7fc6b7b2ef59e5 (127.27.203.136:40435), 9f0d4403b3d041728ce5ced3f9bf2c22 (127.27.203.130:43229), 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043), e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841)
I20260805 19:53:19.795130 30287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cc9d79670ed4f3896304a5e988dc8ba" candidate_uuid: "cd36f97e947143e7b83775495de7bd87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" is_pre_election: true
I20260805 19:53:19.796222 30287 raft_consensus.cc:2468] T 0cc9d79670ed4f3896304a5e988dc8ba P 3dd67d0015fe4e12bd7fc6b7b2ef59e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd36f97e947143e7b83775495de7bd87 in term 0.
I20260805 19:53:19.801702 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cc9d79670ed4f3896304a5e988dc8ba" candidate_uuid: "cd36f97e947143e7b83775495de7bd87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" is_pre_election: true
I20260805 19:53:19.802011 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cc9d79670ed4f3896304a5e988dc8ba" candidate_uuid: "cd36f97e947143e7b83775495de7bd87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e76542db2ad84812b1ef9a4b24125379" is_pre_election: true
I20260805 19:53:19.802645 29455 raft_consensus.cc:2468] T 0cc9d79670ed4f3896304a5e988dc8ba P 9f0d4403b3d041728ce5ced3f9bf2c22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd36f97e947143e7b83775495de7bd87 in term 0.
I20260805 19:53:19.802889 29319 raft_consensus.cc:2468] T 0cc9d79670ed4f3896304a5e988dc8ba P e76542db2ad84812b1ef9a4b24125379 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd36f97e947143e7b83775495de7bd87 in term 0.
I20260805 19:53:19.804471 30359 leader_election.cc:304] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 3dd67d0015fe4e12bd7fc6b7b2ef59e5, 9f0d4403b3d041728ce5ced3f9bf2c22, cd36f97e947143e7b83775495de7bd87; no voters:
I20260805 19:53:19.805300 29733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cc9d79670ed4f3896304a5e988dc8ba" candidate_uuid: "cd36f97e947143e7b83775495de7bd87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b0580ac924d4abeb23860468eb5af1c" is_pre_election: true
I20260805 19:53:19.805583 30506 raft_consensus.cc:2804] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 19:53:19.806087 30506 raft_consensus.cc:493] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 19:53:19.806248 29733 raft_consensus.cc:2468] T 0cc9d79670ed4f3896304a5e988dc8ba P 8b0580ac924d4abeb23860468eb5af1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd36f97e947143e7b83775495de7bd87 in term 0.
I20260805 19:53:19.806488 30506 raft_consensus.cc:3060] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:53:19.813834 30506 raft_consensus.cc:515] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }
I20260805 19:53:19.817234 30506 leader_election.cc:290] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 1 election: Requested vote from peers 3dd67d0015fe4e12bd7fc6b7b2ef59e5 (127.27.203.136:40435), 9f0d4403b3d041728ce5ced3f9bf2c22 (127.27.203.130:43229), 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043), e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841)
I20260805 19:53:19.817103 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cc9d79670ed4f3896304a5e988dc8ba" candidate_uuid: "cd36f97e947143e7b83775495de7bd87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22"
I20260805 19:53:19.817265 30287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cc9d79670ed4f3896304a5e988dc8ba" candidate_uuid: "cd36f97e947143e7b83775495de7bd87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5"
I20260805 19:53:19.817512 29733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cc9d79670ed4f3896304a5e988dc8ba" candidate_uuid: "cd36f97e947143e7b83775495de7bd87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b0580ac924d4abeb23860468eb5af1c"
I20260805 19:53:19.817742 29455 raft_consensus.cc:3060] T 0cc9d79670ed4f3896304a5e988dc8ba P 9f0d4403b3d041728ce5ced3f9bf2c22 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:53:19.817950 30287 raft_consensus.cc:3060] T 0cc9d79670ed4f3896304a5e988dc8ba P 3dd67d0015fe4e12bd7fc6b7b2ef59e5 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:53:19.818090 29733 raft_consensus.cc:3060] T 0cc9d79670ed4f3896304a5e988dc8ba P 8b0580ac924d4abeb23860468eb5af1c [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:53:19.819172 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cc9d79670ed4f3896304a5e988dc8ba" candidate_uuid: "cd36f97e947143e7b83775495de7bd87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e76542db2ad84812b1ef9a4b24125379"
I20260805 19:53:19.819792 29319 raft_consensus.cc:3060] T 0cc9d79670ed4f3896304a5e988dc8ba P e76542db2ad84812b1ef9a4b24125379 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:53:19.826380 29455 raft_consensus.cc:2468] T 0cc9d79670ed4f3896304a5e988dc8ba P 9f0d4403b3d041728ce5ced3f9bf2c22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd36f97e947143e7b83775495de7bd87 in term 1.
I20260805 19:53:19.826614 29733 raft_consensus.cc:2468] T 0cc9d79670ed4f3896304a5e988dc8ba P 8b0580ac924d4abeb23860468eb5af1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd36f97e947143e7b83775495de7bd87 in term 1.
I20260805 19:53:19.826612 30287 raft_consensus.cc:2468] T 0cc9d79670ed4f3896304a5e988dc8ba P 3dd67d0015fe4e12bd7fc6b7b2ef59e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd36f97e947143e7b83775495de7bd87 in term 1.
W20260805 19:53:19.826659 29502 tablet.cc:2406] T 0cc9d79670ed4f3896304a5e988dc8ba P 9f0d4403b3d041728ce5ced3f9bf2c22: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 19:53:19.828274 30360 leader_election.cc:304] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 3dd67d0015fe4e12bd7fc6b7b2ef59e5, 8b0580ac924d4abeb23860468eb5af1c, cd36f97e947143e7b83775495de7bd87; no voters:
I20260805 19:53:19.829272 30506 raft_consensus.cc:2804] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:53:19.829957 29319 raft_consensus.cc:2468] T 0cc9d79670ed4f3896304a5e988dc8ba P e76542db2ad84812b1ef9a4b24125379 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd36f97e947143e7b83775495de7bd87 in term 1.
I20260805 19:53:19.832617 30506 raft_consensus.cc:697] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 1 LEADER]: Becoming Leader. State: Replica: cd36f97e947143e7b83775495de7bd87, State: Running, Role: LEADER
I20260805 19:53:19.833746 30506 consensus_queue.cc:237] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }
I20260805 19:53:19.846029 29168 catalog_manager.cc:5697] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd36f97e947143e7b83775495de7bd87 (127.27.203.137). New cstate: current_term: 1 leader_uuid: "cd36f97e947143e7b83775495de7bd87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } health_report { overall_health: UNKNOWN } } }
I20260805 19:53:19.876595 28462 external_mini_cluster.cc:955] 9 TS(s) registered with all masters
I20260805 19:53:19.881083 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver e76542db2ad84812b1ef9a4b24125379 to finish bootstrapping
I20260805 19:53:19.896958 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 9f0d4403b3d041728ce5ced3f9bf2c22 to finish bootstrapping
I20260805 19:53:19.911386 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 8b0580ac924d4abeb23860468eb5af1c to finish bootstrapping
I20260805 19:53:19.925904 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 3dd67d0015fe4e12bd7fc6b7b2ef59e5 to finish bootstrapping
I20260805 19:53:19.939056 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver cd36f97e947143e7b83775495de7bd87 to finish bootstrapping
I20260805 19:53:19.954229 28462 kudu-admin-test.cc:1159] Waiting for Master to see the current replicas...
I20260805 19:53:19.958600 28462 kudu-admin-test.cc:1166] Tablet locations:
tablet_locations {
tablet_id: "0cc9d79670ed4f3896304a5e988dc8ba"
DEPRECATED_stale: false
partition {
partition_key_start: ""
partition_key_end: ""
}
interned_replicas {
ts_info_idx: 0
role: FOLLOWER
}
interned_replicas {
ts_info_idx: 1
role: FOLLOWER
}
interned_replicas {
ts_info_idx: 2
role: FOLLOWER
}
interned_replicas {
ts_info_idx: 3
role: LEADER
}
interned_replicas {
ts_info_idx: 4
role: FOLLOWER
}
}
ts_infos {
permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5"
rpc_addresses {
host: "127.27.203.136"
port: 40435
}
}
ts_infos {
permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22"
rpc_addresses {
host: "127.27.203.130"
port: 43229
}
}
ts_infos {
permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c"
rpc_addresses {
host: "127.27.203.132"
port: 35043
}
}
ts_infos {
permanent_uuid: "cd36f97e947143e7b83775495de7bd87"
rpc_addresses {
host: "127.27.203.137"
port: 44781
}
}
ts_infos {
permanent_uuid: "e76542db2ad84812b1ef9a4b24125379"
rpc_addresses {
host: "127.27.203.129"
port: 42841
}
}
I20260805 19:53:20.027531 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 29231
I20260805 19:53:20.060972 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 29643
I20260805 19:53:20.092023 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 29370
I20260805 19:53:20.126087 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 30199
I20260805 19:53:20.157836 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 29137
W20260805 19:53:20.210974 30195 heartbeater.cc:646] Failed to heartbeat to 127.27.203.190:42041 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.203.190:42041: connect: Connection refused (error 111)
W20260805 19:53:20.293126 30057 heartbeater.cc:646] Failed to heartbeat to 127.27.203.190:42041 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.203.190:42041: connect: Connection refused (error 111)
W20260805 19:53:20.317840 30360 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.203.136:40435: connect: Connection refused (error 111)
W20260805 19:53:20.322211 30360 consensus_peers.cc:597] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 -> Peer 3dd67d0015fe4e12bd7fc6b7b2ef59e5 (127.27.203.136:40435): Couldn't send request to peer 3dd67d0015fe4e12bd7fc6b7b2ef59e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.203.136:40435: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260805 19:53:20.408028 30359 consensus_peers.cc:597] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 -> Peer 9f0d4403b3d041728ce5ced3f9bf2c22 (127.27.203.130:43229): Couldn't send request to peer 9f0d4403b3d041728ce5ced3f9bf2c22. Status: Network error: Client connection negotiation failed: client connection to 127.27.203.130:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260805 19:53:20.428447 30358 consensus_peers.cc:597] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 -> Peer e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841): Couldn't send request to peer e76542db2ad84812b1ef9a4b24125379. Status: Network error: Client connection negotiation failed: client connection to 127.27.203.129:42841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260805 19:53:20.455106 30361 consensus_peers.cc:597] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 -> Peer 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043): Couldn't send request to peer 8b0580ac924d4abeb23860468eb5af1c. Status: Network error: Client connection negotiation failed: client connection to 127.27.203.132:35043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260805 19:53:20.551649 30520 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:20.552338 30520 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:20.780802 29638 heartbeater.cc:646] Failed to heartbeat to 127.27.203.190:42041 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.203.190:42041: connect: Connection refused (error 111)
W20260805 19:53:20.800678 29920 heartbeater.cc:646] Failed to heartbeat to 127.27.203.190:42041 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.203.190:42041: connect: Connection refused (error 111)
W20260805 19:53:20.861346 30472 heartbeater.cc:646] Failed to heartbeat to 127.27.203.190:42041 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.203.190:42041: connect: Connection refused (error 111)
W20260805 19:53:21.957537 30520 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.317s user 0.442s sys 0.869s
W20260805 19:53:21.957852 30520 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.317s user 0.442s sys 0.869s
W20260805 19:53:22.757473 30361 consensus_peers.cc:597] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 -> Peer 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043): Couldn't send request to peer 8b0580ac924d4abeb23860468eb5af1c. Status: Network error: Client connection negotiation failed: client connection to 127.27.203.132:35043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260805 19:53:22.839779 30543 sasl_common.cc:323] Time spent creating new SASL kudu client: real 0.857s user 0.004s sys 0.000s
I20260805 19:53:22.865998 30427 tablet_service.cc:2009] Received UnsafeChangeConfig RPC: dest_uuid: "cd36f97e947143e7b83775495de7bd87"
tablet_id: "0cc9d79670ed4f3896304a5e988dc8ba"
caller_id: "kudu-tools"
new_config {
peers {
permanent_uuid: "cd36f97e947143e7b83775495de7bd87"
}
peers {
permanent_uuid: "e76542db2ad84812b1ef9a4b24125379"
}
peers {
permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c"
}
peers {
permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22"
}
peers {
permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5"
}
}
from {username='slave'} at 127.0.0.1:57180
W20260805 19:53:22.867630 30427 raft_consensus.cc:2218] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 1 LEADER]: PROCEEDING WITH UNSAFE CONFIG CHANGE ON THIS SERVER, COMMITTED CONFIG: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }NEW CONFIG: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true
I20260805 19:53:22.868956 30427 raft_consensus.cc:3055] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 1 LEADER]: Stepping down as leader of term 1
I20260805 19:53:22.869181 30427 raft_consensus.cc:740] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd36f97e947143e7b83775495de7bd87, State: Running, Role: LEADER
I20260805 19:53:22.869762 30427 consensus_queue.cc:260] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }
I20260805 19:53:22.870895 30427 raft_consensus.cc:3060] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 1 FOLLOWER]: Advancing to term 2
W20260805 19:53:24.253428 30560 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:24.253958 30560 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260805 19:53:24.381080 30572 raft_consensus.cc:493] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader kudu-tools)
I20260805 19:53:24.381946 30572 raft_consensus.cc:515] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true
I20260805 19:53:24.386919 30572 leader_election.cc:290] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dd67d0015fe4e12bd7fc6b7b2ef59e5 (127.27.203.136:40435), 9f0d4403b3d041728ce5ced3f9bf2c22 (127.27.203.130:43229), 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043), e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841)
W20260805 19:53:24.411226 30361 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043): Network error: Client connection negotiation failed: client connection to 127.27.203.132:35043: connect: Connection refused (error 111)
W20260805 19:53:24.413058 30358 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841): Network error: Client connection negotiation failed: client connection to 127.27.203.129:42841: connect: Connection refused (error 111)
W20260805 19:53:24.419317 30359 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9f0d4403b3d041728ce5ced3f9bf2c22 (127.27.203.130:43229): Network error: Client connection negotiation failed: client connection to 127.27.203.130:43229: connect: Connection refused (error 111)
I20260805 19:53:24.420045 30359 leader_election.cc:304] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: cd36f97e947143e7b83775495de7bd87; no voters: 8b0580ac924d4abeb23860468eb5af1c, 9f0d4403b3d041728ce5ced3f9bf2c22, e76542db2ad84812b1ef9a4b24125379
W20260805 19:53:24.421058 30360 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3dd67d0015fe4e12bd7fc6b7b2ef59e5 (127.27.203.136:40435): Network error: Client connection negotiation failed: client connection to 127.27.203.136:40435: connect: Connection refused (error 111)
I20260805 19:53:24.421303 30572 raft_consensus.cc:2749] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260805 19:53:25.565403 30560 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.229s user 0.459s sys 0.754s
W20260805 19:53:25.565716 30560 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.229s user 0.459s sys 0.754s
I20260805 19:53:25.616714 30427 tablet_service.cc:2009] Received UnsafeChangeConfig RPC: dest_uuid: "cd36f97e947143e7b83775495de7bd87"
tablet_id: "0cc9d79670ed4f3896304a5e988dc8ba"
caller_id: "kudu-tools"
new_config {
peers {
permanent_uuid: "cd36f97e947143e7b83775495de7bd87"
}
peers {
permanent_uuid: "e76542db2ad84812b1ef9a4b24125379"
}
peers {
permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c"
}
peers {
permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22"
}
}
from {username='slave'} at 127.0.0.1:57200
W20260805 19:53:25.617444 30427 raft_consensus.cc:2119] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 2 FOLLOWER]: Replica has a pending config, but the new config will be unsafely changed anyway. Currently pending config on the node: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true
W20260805 19:53:25.618543 30427 raft_consensus.cc:2218] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 2 FOLLOWER]: PROCEEDING WITH UNSAFE CONFIG CHANGE ON THIS SERVER, COMMITTED CONFIG: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }NEW CONFIG: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true
I20260805 19:53:25.619592 30427 raft_consensus.cc:3060] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 2 FOLLOWER]: Advancing to term 3
I20260805 19:53:25.625545 30427 raft_consensus.cc:3132] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 3 FOLLOWER]: Allowing unsafe config change even though there is a pending config! Existing pending config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true; New pending config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true
W20260805 19:53:27.038502 30599 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:27.039124 30599 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260805 19:53:27.142477 30611 raft_consensus.cc:493] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader kudu-tools)
I20260805 19:53:27.143098 30611 raft_consensus.cc:515] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true
I20260805 19:53:27.151938 30611 leader_election.cc:290] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9f0d4403b3d041728ce5ced3f9bf2c22 (127.27.203.130:43229), 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043), e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841)
W20260805 19:53:27.157526 30359 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.203.130:43229: connect: Connection refused (error 111) [suppressed 24 similar messages]
W20260805 19:53:27.174961 30361 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043): Network error: Client connection negotiation failed: client connection to 127.27.203.132:35043: connect: Connection refused (error 111)
W20260805 19:53:27.175947 30359 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9f0d4403b3d041728ce5ced3f9bf2c22 (127.27.203.130:43229): Network error: Client connection negotiation failed: client connection to 127.27.203.130:43229: connect: Connection refused (error 111)
I20260805 19:53:27.176565 30361 leader_election.cc:304] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd36f97e947143e7b83775495de7bd87; no voters: 8b0580ac924d4abeb23860468eb5af1c, 9f0d4403b3d041728ce5ced3f9bf2c22
I20260805 19:53:27.177649 30611 raft_consensus.cc:2749] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260805 19:53:27.177731 30358 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841): Network error: Client connection negotiation failed: client connection to 127.27.203.129:42841: connect: Connection refused (error 111)
W20260805 19:53:28.401156 30599 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.281s user 0.489s sys 0.789s
W20260805 19:53:28.401486 30599 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.282s user 0.489s sys 0.789s
I20260805 19:53:28.774755 30629 raft_consensus.cc:493] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader kudu-tools)
I20260805 19:53:28.775399 30629 raft_consensus.cc:515] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true
I20260805 19:53:28.777909 30629 leader_election.cc:290] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9f0d4403b3d041728ce5ced3f9bf2c22 (127.27.203.130:43229), 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043), e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841)
W20260805 19:53:28.784507 30361 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043): Network error: Client connection negotiation failed: client connection to 127.27.203.132:35043: connect: Connection refused (error 111)
W20260805 19:53:28.785229 30358 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841): Network error: Client connection negotiation failed: client connection to 127.27.203.129:42841: connect: Connection refused (error 111)
I20260805 19:53:28.785683 30358 leader_election.cc:304] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd36f97e947143e7b83775495de7bd87; no voters: 8b0580ac924d4abeb23860468eb5af1c, e76542db2ad84812b1ef9a4b24125379
W20260805 19:53:28.786458 30359 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9f0d4403b3d041728ce5ced3f9bf2c22 (127.27.203.130:43229): Network error: Client connection negotiation failed: client connection to 127.27.203.130:43229: connect: Connection refused (error 111)
I20260805 19:53:28.786541 30629 raft_consensus.cc:2749] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260805 19:53:29.588187 30627 sasl_common.cc:323] Time spent creating new SASL kudu client: real 1.162s user 0.003s sys 0.000s
I20260805 19:53:29.612485 30427 tablet_service.cc:2009] Received UnsafeChangeConfig RPC: dest_uuid: "cd36f97e947143e7b83775495de7bd87"
tablet_id: "0cc9d79670ed4f3896304a5e988dc8ba"
caller_id: "kudu-tools"
new_config {
peers {
permanent_uuid: "cd36f97e947143e7b83775495de7bd87"
}
peers {
permanent_uuid: "e76542db2ad84812b1ef9a4b24125379"
}
peers {
permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c"
}
}
from {username='slave'} at 127.0.0.1:57218
W20260805 19:53:29.613385 30427 raft_consensus.cc:2119] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 3 FOLLOWER]: Replica has a pending config, but the new config will be unsafely changed anyway. Currently pending config on the node: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true
W20260805 19:53:29.614430 30427 raft_consensus.cc:2218] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 3 FOLLOWER]: PROCEEDING WITH UNSAFE CONFIG CHANGE ON THIS SERVER, COMMITTED CONFIG: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dd67d0015fe4e12bd7fc6b7b2ef59e5" member_type: VOTER last_known_addr { host: "127.27.203.136" port: 40435 } } peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } }NEW CONFIG: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true
I20260805 19:53:29.615442 30427 raft_consensus.cc:3060] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 3 FOLLOWER]: Advancing to term 4
I20260805 19:53:29.621914 30427 raft_consensus.cc:3132] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 4 FOLLOWER]: Allowing unsafe config change even though there is a pending config! Existing pending config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9f0d4403b3d041728ce5ced3f9bf2c22" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 43229 } } peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true; New pending config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true
W20260805 19:53:31.014442 30652 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:31.015174 30652 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260805 19:53:31.123777 30664 raft_consensus.cc:493] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader kudu-tools)
I20260805 19:53:31.124310 30664 raft_consensus.cc:515] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true
I20260805 19:53:31.129235 30664 leader_election.cc:290] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043), e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841)
W20260805 19:53:31.134250 30361 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043): Network error: Client connection negotiation failed: client connection to 127.27.203.132:35043: connect: Connection refused (error 111)
W20260805 19:53:31.135025 30358 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841): Network error: Client connection negotiation failed: client connection to 127.27.203.129:42841: connect: Connection refused (error 111)
I20260805 19:53:31.135468 30358 leader_election.cc:304] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd36f97e947143e7b83775495de7bd87; no voters: 8b0580ac924d4abeb23860468eb5af1c, e76542db2ad84812b1ef9a4b24125379
I20260805 19:53:31.136750 30664 raft_consensus.cc:2749] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260805 19:53:32.436412 30652 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.332s user 0.502s sys 0.824s
W20260805 19:53:32.436774 30652 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.333s user 0.502s sys 0.824s
I20260805 19:53:33.225096 30681 raft_consensus.cc:493] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader kudu-tools)
I20260805 19:53:33.225872 30681 raft_consensus.cc:515] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true
I20260805 19:53:33.228013 30681 leader_election.cc:290] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043), e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841)
W20260805 19:53:33.231071 30361 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.203.132:35043: connect: Connection refused (error 111) [suppressed 7 similar messages]
W20260805 19:53:33.236122 30361 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043): Network error: Client connection negotiation failed: client connection to 127.27.203.132:35043: connect: Connection refused (error 111)
W20260805 19:53:33.236663 30358 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841): Network error: Client connection negotiation failed: client connection to 127.27.203.129:42841: connect: Connection refused (error 111)
I20260805 19:53:33.237092 30358 leader_election.cc:304] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd36f97e947143e7b83775495de7bd87; no voters: 8b0580ac924d4abeb23860468eb5af1c, e76542db2ad84812b1ef9a4b24125379
I20260805 19:53:33.237740 30681 raft_consensus.cc:2749] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260805 19:53:35.106735 30694 raft_consensus.cc:493] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader kudu-tools)
I20260805 19:53:35.107205 30694 raft_consensus.cc:515] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8b0580ac924d4abeb23860468eb5af1c" member_type: VOTER last_known_addr { host: "127.27.203.132" port: 35043 } } peers { permanent_uuid: "cd36f97e947143e7b83775495de7bd87" member_type: VOTER last_known_addr { host: "127.27.203.137" port: 44781 } } peers { permanent_uuid: "e76542db2ad84812b1ef9a4b24125379" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 42841 } } unsafe_config_change: true
I20260805 19:53:35.109071 30694 leader_election.cc:290] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043), e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841)
W20260805 19:53:35.114562 30361 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8b0580ac924d4abeb23860468eb5af1c (127.27.203.132:35043): Network error: Client connection negotiation failed: client connection to 127.27.203.132:35043: connect: Connection refused (error 111)
W20260805 19:53:35.115108 30358 leader_election.cc:336] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e76542db2ad84812b1ef9a4b24125379 (127.27.203.129:42841): Network error: Client connection negotiation failed: client connection to 127.27.203.129:42841: connect: Connection refused (error 111)
I20260805 19:53:35.115466 30358 leader_election.cc:304] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd36f97e947143e7b83775495de7bd87; no voters: 8b0580ac924d4abeb23860468eb5af1c, e76542db2ad84812b1ef9a4b24125379
I20260805 19:53:35.116017 30694 raft_consensus.cc:2749] T 0cc9d79670ed4f3896304a5e988dc8ba P cd36f97e947143e7b83775495de7bd87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260805 19:53:35.550154 30675 negotiation.cc:336] Failed RPC negotiation. Trace:
0805 19:53:32.441510 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:43218 (local address 127.27.203.137:44781)
0805 19:53:32.442882 (+ 1372us) server_negotiation.cc:207] Beginning negotiation
0805 19:53:32.442904 (+ 22us) server_negotiation.cc:400] Waiting for connection header
0805 19:53:32.446434 (+ 3530us) server_negotiation.cc:408] Connection header received
0805 19:53:32.451977 (+ 5543us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0805 19:53:32.452012 (+ 35us) server_negotiation.cc:462] Received NEGOTIATE request from client
0805 19:53:32.452222 (+ 210us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0805 19:53:32.452416 (+ 194us) server_negotiation.cc:227] Negotiated authn=SASL
0805 19:53:32.454706 (+ 2290us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0805 19:53:32.455618 (+ 912us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0805 19:53:32.457251 (+ 1633us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0805 19:53:32.457785 (+ 534us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
0805 19:53:35.548739 (+3090954us) negotiation.cc:326] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:43218: received 0 of 4 requested bytes
Metrics: {"server-negotiator.queue_time_us":914,"thread_start_us":627,"threads_started":1}
W20260805 19:53:35.841056 30676 sasl_common.cc:323] Time spent creating new SASL kudu client: real 3.383s user 0.002s sys 0.001s
W20260805 19:53:35.845820 30676 negotiation.cc:336] Failed RPC negotiation. Trace:
0805 19:53:32.442195 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.27.203.137:44781 (local address 127.0.0.1:43218)
0805 19:53:32.446057 (+ 3862us) negotiation.cc:107] Waiting for socket to connect
0805 19:53:32.446175 (+ 118us) client_negotiation.cc:175] Beginning negotiation
0805 19:53:32.451455 (+ 5280us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0805 19:53:32.452850 (+ 1395us) client_negotiation.cc:281] Received NEGOTIATE NegotiatePB response
0805 19:53:32.452885 (+ 35us) client_negotiation.cc:404] Received NEGOTIATE response from server
0805 19:53:32.453035 (+ 150us) client_negotiation.cc:190] Negotiated authn=SASL
0805 19:53:32.454384 (+ 1349us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0805 19:53:32.454431 (+ 47us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0805 19:53:32.455993 (+ 1562us) client_negotiation.cc:281] Received TLS_HANDSHAKE NegotiatePB response
0805 19:53:32.456015 (+ 22us) client_negotiation.cc:543] Received TLS_HANDSHAKE response from server
0805 19:53:32.456983 (+ 968us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0805 19:53:32.457023 (+ 40us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0805 19:53:32.457478 (+ 455us) client_negotiation.cc:564] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
0805 19:53:35.841425 (+3383947us) client_negotiation.cc:639] Initiating SASL PLAIN handshake
0805 19:53:35.841455 (+ 30us) client_negotiation.cc:672] calling sasl_client_start()
0805 19:53:35.841606 (+ 151us) client_negotiation.cc:830] callback for SASL_CB_AUTHNAME
0805 19:53:35.841888 (+ 282us) client_negotiation.cc:262] Sending SASL_INITIATE NegotiatePB request
0805 19:53:35.842828 (+ 940us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.27.203.137:44781: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2665,"thread_start_us":1681,"threads_started":1}
Timed out: Client connection negotiation failed: client connection to 127.27.203.137:44781: sent 0 of 16 requested bytes
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tools/kudu-admin-test.cc:1201: Failure
Failed
Bad status: Runtime error: /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu: process exited with non-zero status 1
I20260805 19:53:36.888635 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 29505
I20260805 19:53:36.917742 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 29782
I20260805 19:53:36.951817 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 29924
I20260805 19:53:36.980486 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 30061
I20260805 19:53:37.009473 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 30339
2026-08-05T19:53:37Z chronyd exiting
I20260805 19:53:37.066458 28462 test_util.cc:182] -----------------------------------------------
I20260805 19:53:37.066672 28462 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs.1785959555696825-28462-0
[ FAILED ] AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs (40960 ms)
[ RUN ] AdminCliTest.TestListSoftDeletedTables
I20260805 19:53:37.074601 28462 ts_itest-base.cc:115] Starting cluster with:
I20260805 19:53:37.074779 28462 ts_itest-base.cc:116] --------------
I20260805 19:53:37.074901 28462 ts_itest-base.cc:117] 1 tablet servers
I20260805 19:53:37.075011 28462 ts_itest-base.cc:118] 1 replicas per TS
I20260805 19:53:37.075125 28462 ts_itest-base.cc:119] --------------
2026-08-05T19:53:37Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-05T19:53:37Z Disabled control of system clock
I20260805 19:53:37.120230 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:34759
--webserver_interface=127.27.203.190
--webserver_port=0
--builtin_ntp_servers=127.27.203.148:43585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.203.190:34759 with env {}
W20260805 19:53:37.449760 30715 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:37.450371 30715 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:53:37.450814 30715 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:37.486276 30715 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 19:53:37.486582 30715 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:53:37.486811 30715 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 19:53:37.487136 30715 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260805 19:53:37.525624 30715 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:43585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.203.190:34759
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:34759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.27.203.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:53:37.526993 30715 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:53:37.528793 30715 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:53:37.541169 30722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:37.541839 30723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:38.836220 30725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:38.838655 30724 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1292 milliseconds
I20260805 19:53:38.838882 30715 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:53:38.840312 30715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:53:38.842881 30715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:53:38.844233 30715 hybrid_clock.cc:648] HybridClock initialized: now 1785959618844182 us; error 60 us; skew 500 ppm
I20260805 19:53:38.845105 30715 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:53:38.852241 30715 webserver.cc:533] Webserver started at http://127.27.203.190:41783/ using document root <none> and password file <none>
I20260805 19:53:38.853235 30715 fs_manager.cc:362] Metadata directory not provided
I20260805 19:53:38.853447 30715 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:53:38.853893 30715 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:53:38.858417 30715 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "e0067c999cf143f1a98540528598c53e"
format_stamp: "Formatted at 2026-08-05 19:53:38 on dist-test-slave-27sr"
I20260805 19:53:38.859655 30715 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "e0067c999cf143f1a98540528598c53e"
format_stamp: "Formatted at 2026-08-05 19:53:38 on dist-test-slave-27sr"
I20260805 19:53:38.867743 30715 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.002s sys 0.005s
I20260805 19:53:38.874297 30732 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:38.875545 30715 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.001s
I20260805 19:53:38.876009 30715 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
uuid: "e0067c999cf143f1a98540528598c53e"
format_stamp: "Formatted at 2026-08-05 19:53:38 on dist-test-slave-27sr"
I20260805 19:53:38.876387 30715 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:53:38.942070 30715 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:53:38.944067 30715 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:53:38.944602 30715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:53:39.025146 30715 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.190:34759
I20260805 19:53:39.025234 30784 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.190:34759 every 8 connection(s)
I20260805 19:53:39.028487 30715 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260805 19:53:39.033116 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 30715
I20260805 19:53:39.033625 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260805 19:53:39.035667 30785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:53:39.061188 30785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e: Bootstrap starting.
I20260805 19:53:39.068193 30785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e: Neither blocks nor log segments found. Creating new log.
I20260805 19:53:39.070124 30785 log.cc:826] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e: Log is configured to *not* fsync() on all Append() calls
I20260805 19:53:39.075546 30785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e: No bootstrap required, opened a new log
I20260805 19:53:39.095396 30785 raft_consensus.cc:359] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0067c999cf143f1a98540528598c53e" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 34759 } }
I20260805 19:53:39.096288 30785 raft_consensus.cc:385] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:53:39.096590 30785 raft_consensus.cc:740] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0067c999cf143f1a98540528598c53e, State: Initialized, Role: FOLLOWER
I20260805 19:53:39.097383 30785 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0067c999cf143f1a98540528598c53e" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 34759 } }
I20260805 19:53:39.097908 30785 raft_consensus.cc:399] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:53:39.098229 30785 raft_consensus.cc:493] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:53:39.098560 30785 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:53:39.102978 30785 raft_consensus.cc:515] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0067c999cf143f1a98540528598c53e" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 34759 } }
I20260805 19:53:39.103921 30785 leader_election.cc:304] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0067c999cf143f1a98540528598c53e; no voters:
I20260805 19:53:39.105688 30785 leader_election.cc:290] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:53:39.106674 30790 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:53:39.109030 30790 raft_consensus.cc:697] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [term 1 LEADER]: Becoming Leader. State: Replica: e0067c999cf143f1a98540528598c53e, State: Running, Role: LEADER
I20260805 19:53:39.109777 30790 consensus_queue.cc:237] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0067c999cf143f1a98540528598c53e" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 34759 } }
I20260805 19:53:39.110074 30785 sys_catalog.cc:565] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [sys.catalog]: configured and running, proceeding with master startup.
I20260805 19:53:39.123929 30793 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0067c999cf143f1a98540528598c53e. Latest consensus state: current_term: 1 leader_uuid: "e0067c999cf143f1a98540528598c53e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0067c999cf143f1a98540528598c53e" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 34759 } } }
I20260805 19:53:39.124017 30792 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e0067c999cf143f1a98540528598c53e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0067c999cf143f1a98540528598c53e" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 34759 } } }
I20260805 19:53:39.125020 30793 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [sys.catalog]: This master's current role is: LEADER
I20260805 19:53:39.125238 30792 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e [sys.catalog]: This master's current role is: LEADER
I20260805 19:53:39.129838 30801 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260805 19:53:39.142678 30801 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260805 19:53:39.161630 30801 catalog_manager.cc:1383] Generated new cluster ID: 4c99e6efd8c04f9e8b1da4867a8375e7
I20260805 19:53:39.161964 30801 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260805 19:53:39.180493 30801 catalog_manager.cc:1406] Generated new certificate authority record
I20260805 19:53:39.182664 30801 catalog_manager.cc:1540] Loading token signing keys...
I20260805 19:53:39.198751 30801 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e: Generated new TSK 0
I20260805 19:53:39.199980 30801 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260805 19:53:39.217108 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.129:0
--local_ip_for_outbound_sockets=127.27.203.129
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:34759
--builtin_ntp_servers=127.27.203.148:43585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20260805 19:53:39.557117 30810 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:39.557739 30810 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:53:39.558246 30810 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:39.593892 30810 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:53:39.594822 30810 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.129
I20260805 19:53:39.634303 30810 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:43585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:34759
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:53:39.636065 30810 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:53:39.637924 30810 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:53:39.652594 30816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:41.055347 30815 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee20 after lost signal to thread 30810
W20260805 19:53:41.392764 30810 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.740s user 0.539s sys 1.157s
W20260805 19:53:39.655332 30817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:41.393184 30810 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.741s user 0.539s sys 1.157s
W20260805 19:53:41.395315 30819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:41.399668 30818 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1746 milliseconds
I20260805 19:53:41.399678 30810 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:53:41.401154 30810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:53:41.403986 30810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:53:41.405611 30810 hybrid_clock.cc:648] HybridClock initialized: now 1785959621405524 us; error 85 us; skew 500 ppm
I20260805 19:53:41.406646 30810 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:53:41.414997 30810 webserver.cc:533] Webserver started at http://127.27.203.129:32917/ using document root <none> and password file <none>
I20260805 19:53:41.416242 30810 fs_manager.cc:362] Metadata directory not provided
I20260805 19:53:41.416517 30810 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:53:41.417096 30810 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:53:41.422480 30810 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "412b905770f14585b5550213e04d4a17"
format_stamp: "Formatted at 2026-08-05 19:53:41 on dist-test-slave-27sr"
I20260805 19:53:41.424461 30810 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "412b905770f14585b5550213e04d4a17"
format_stamp: "Formatted at 2026-08-05 19:53:41 on dist-test-slave-27sr"
I20260805 19:53:41.435137 30810 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.001s sys 0.009s
I20260805 19:53:41.442864 30826 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:41.444519 30810 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.005s sys 0.002s
I20260805 19:53:41.444955 30810 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "412b905770f14585b5550213e04d4a17"
format_stamp: "Formatted at 2026-08-05 19:53:41 on dist-test-slave-27sr"
I20260805 19:53:41.445377 30810 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:53:41.516338 30810 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:53:41.518198 30810 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:53:41.518759 30810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:53:41.521720 30810 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:53:41.526397 30810 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:53:41.526655 30810 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:41.526952 30810 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:53:41.527231 30810 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.001s
I20260805 19:53:41.708580 30810 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.129:37121
I20260805 19:53:41.708714 30943 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.129:37121 every 8 connection(s)
I20260805 19:53:41.711411 30810 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260805 19:53:41.713092 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 30810
I20260805 19:53:41.713593 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestListSoftDeletedTables.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260805 19:53:41.740981 30944 heartbeater.cc:344] Connected to a master server at 127.27.203.190:34759
I20260805 19:53:41.741523 30944 heartbeater.cc:461] Registering TS with master...
I20260805 19:53:41.742966 30944 heartbeater.cc:507] Master 127.27.203.190:34759 requested a full tablet report, sending...
I20260805 19:53:41.746294 30749 ts_manager.cc:194] Registered new tserver with Master: 412b905770f14585b5550213e04d4a17 (127.27.203.129:37121)
I20260805 19:53:41.748957 30749 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.129:48567
I20260805 19:53:41.750452 28462 external_mini_cluster.cc:955] 1 TS(s) registered with all masters
I20260805 19:53:41.786439 30749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48342:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20260805 19:53:41.865454 30876 tablet_service.cc:1511] Processing CreateTablet for tablet c066b9bf3e734de1a55a69853ece32ab (DEFAULT_TABLE table=TestTable [id=723d8b52fbe347c2b67dbe1549ca6010]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:53:41.867321 30876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c066b9bf3e734de1a55a69853ece32ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:53:41.889349 30959 tablet_bootstrap.cc:492] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17: Bootstrap starting.
I20260805 19:53:41.895483 30959 tablet_bootstrap.cc:654] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17: Neither blocks nor log segments found. Creating new log.
I20260805 19:53:41.898099 30959 log.cc:826] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17: Log is configured to *not* fsync() on all Append() calls
I20260805 19:53:41.903725 30959 tablet_bootstrap.cc:492] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17: No bootstrap required, opened a new log
I20260805 19:53:41.904287 30959 ts_tablet_manager.cc:1403] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.009s
I20260805 19:53:41.924329 30959 raft_consensus.cc:359] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "412b905770f14585b5550213e04d4a17" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 37121 } }
I20260805 19:53:41.925148 30959 raft_consensus.cc:385] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:53:41.925551 30959 raft_consensus.cc:740] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 412b905770f14585b5550213e04d4a17, State: Initialized, Role: FOLLOWER
I20260805 19:53:41.926460 30959 consensus_queue.cc:260] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "412b905770f14585b5550213e04d4a17" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 37121 } }
I20260805 19:53:41.927132 30959 raft_consensus.cc:399] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:53:41.927460 30959 raft_consensus.cc:493] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:53:41.927835 30959 raft_consensus.cc:3060] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:53:41.932567 30959 raft_consensus.cc:515] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "412b905770f14585b5550213e04d4a17" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 37121 } }
I20260805 19:53:41.933324 30959 leader_election.cc:304] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 412b905770f14585b5550213e04d4a17; no voters:
I20260805 19:53:41.935348 30959 leader_election.cc:290] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:53:41.936391 30961 raft_consensus.cc:2804] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:53:41.939249 30944 heartbeater.cc:499] Master 127.27.203.190:34759 was elected leader, sending a full tablet report...
I20260805 19:53:41.939459 30959 ts_tablet_manager.cc:1434] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17: Time spent starting tablet: real 0.035s user 0.026s sys 0.008s
I20260805 19:53:41.941226 30961 raft_consensus.cc:697] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17 [term 1 LEADER]: Becoming Leader. State: Replica: 412b905770f14585b5550213e04d4a17, State: Running, Role: LEADER
I20260805 19:53:41.942113 30961 consensus_queue.cc:237] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "412b905770f14585b5550213e04d4a17" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 37121 } }
I20260805 19:53:41.954783 30749 catalog_manager.cc:5697] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17 reported cstate change: term changed from 0 to 1, leader changed from <none> to 412b905770f14585b5550213e04d4a17 (127.27.203.129). New cstate: current_term: 1 leader_uuid: "412b905770f14585b5550213e04d4a17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "412b905770f14585b5550213e04d4a17" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 37121 } health_report { overall_health: HEALTHY } } }
I20260805 19:53:41.977685 28462 external_mini_cluster.cc:955] 1 TS(s) registered with all masters
I20260805 19:53:41.981897 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 412b905770f14585b5550213e04d4a17 to finish bootstrapping
W20260805 19:53:45.196928 30980 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:45.197614 30980 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:46.624650 30980 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.351s user 0.546s sys 0.804s
W20260805 19:53:46.625063 30980 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.351s user 0.546s sys 0.804s
W20260805 19:53:48.038552 30996 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:48.039248 30996 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:49.469892 30996 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.350s user 0.601s sys 0.747s
W20260805 19:53:49.470283 30996 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.351s user 0.601s sys 0.747s
I20260805 19:53:49.517320 30749 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48368:
table { table_name: "TestTable" } modify_external_catalogs: true reserve_seconds: 300
I20260805 19:53:49.541888 30749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48368:
table { table_name: "TestTable" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260805 19:53:49.574496 31018 tablet.cc:1724] T c066b9bf3e734de1a55a69853ece32ab P 412b905770f14585b5550213e04d4a17: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20260805 19:53:49.602137 30749 catalog_manager.cc:6242] T 00000000000000000000000000000000 P e0067c999cf143f1a98540528598c53e: TestTable [id=723d8b52fbe347c2b67dbe1549ca6010] alter complete (version 1)
W20260805 19:53:49.749426 30945 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:c066b9bf3e734de1a55a69853ece32ab)
W20260805 19:53:49.750222 30945 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:c066b9bf3e734de1a55a69853ece32ab)
W20260805 19:53:49.750571 30945 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:c066b9bf3e734de1a55a69853ece32ab)
I20260805 19:53:53.494721 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 30810
I20260805 19:53:53.525408 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 30715
2026-08-05T19:53:53Z chronyd exiting
[ OK ] AdminCliTest.TestListSoftDeletedTables (16517 ms)
[ RUN ] AdminCliTest.TestLocateRowAndCheckRowPresence
I20260805 19:53:53.593201 28462 ts_itest-base.cc:115] Starting cluster with:
I20260805 19:53:53.593401 28462 ts_itest-base.cc:116] --------------
I20260805 19:53:53.593540 28462 ts_itest-base.cc:117] 1 tablet servers
I20260805 19:53:53.593645 28462 ts_itest-base.cc:118] 1 replicas per TS
I20260805 19:53:53.593760 28462 ts_itest-base.cc:119] --------------
2026-08-05T19:53:53Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-05T19:53:53Z Disabled control of system clock
I20260805 19:53:53.639281 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:38095
--webserver_interface=127.27.203.190
--webserver_port=0
--builtin_ntp_servers=127.27.203.148:34409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.203.190:38095 with env {}
W20260805 19:53:53.970816 31039 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:53.971489 31039 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:53:53.971999 31039 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:54.007360 31039 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 19:53:54.007751 31039 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:53:54.008061 31039 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 19:53:54.008347 31039 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260805 19:53:54.047407 31039 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:34409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.203.190:38095
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:38095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.27.203.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:53:54.048897 31039 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:53:54.050668 31039 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:53:54.062898 31045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:55.469302 31044 debug-util.cc:398] Leaking SignalData structure 0x7b08000290e0 after lost signal to thread 31039
W20260805 19:53:54.063019 31046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:55.995467 31039 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.933s user 0.692s sys 1.240s
W20260805 19:53:55.995872 31039 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.933s user 0.692s sys 1.240s
W20260805 19:53:55.999223 31048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:56.005872 31047 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1934 milliseconds
I20260805 19:53:56.005944 31039 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:53:56.007992 31039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:53:56.012490 31039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:53:56.014194 31039 hybrid_clock.cc:648] HybridClock initialized: now 1785959636014091 us; error 104 us; skew 500 ppm
I20260805 19:53:56.015318 31039 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:53:56.024449 31039 webserver.cc:533] Webserver started at http://127.27.203.190:41535/ using document root <none> and password file <none>
I20260805 19:53:56.026077 31039 fs_manager.cc:362] Metadata directory not provided
I20260805 19:53:56.026443 31039 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:53:56.027173 31039 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:53:56.036012 31039 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "f75532becc284985a7260696e5919f9c"
format_stamp: "Formatted at 2026-08-05 19:53:56 on dist-test-slave-27sr"
I20260805 19:53:56.038277 31039 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "f75532becc284985a7260696e5919f9c"
format_stamp: "Formatted at 2026-08-05 19:53:56 on dist-test-slave-27sr"
I20260805 19:53:56.049008 31039 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.006s sys 0.006s
I20260805 19:53:56.055641 31056 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:56.057102 31039 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260805 19:53:56.057483 31039 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
uuid: "f75532becc284985a7260696e5919f9c"
format_stamp: "Formatted at 2026-08-05 19:53:56 on dist-test-slave-27sr"
I20260805 19:53:56.057870 31039 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:53:56.153879 31039 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:53:56.155455 31039 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:53:56.155997 31039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:53:56.232084 31039 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.190:38095
I20260805 19:53:56.232205 31108 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.190:38095 every 8 connection(s)
I20260805 19:53:56.235107 31039 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260805 19:53:56.241295 31109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:53:56.244693 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 31039
I20260805 19:53:56.245297 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260805 19:53:56.269338 31109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c: Bootstrap starting.
I20260805 19:53:56.276662 31109 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c: Neither blocks nor log segments found. Creating new log.
I20260805 19:53:56.278627 31109 log.cc:826] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c: Log is configured to *not* fsync() on all Append() calls
I20260805 19:53:56.284543 31109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c: No bootstrap required, opened a new log
I20260805 19:53:56.305183 31109 raft_consensus.cc:359] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f75532becc284985a7260696e5919f9c" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 38095 } }
I20260805 19:53:56.305936 31109 raft_consensus.cc:385] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:53:56.306188 31109 raft_consensus.cc:740] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75532becc284985a7260696e5919f9c, State: Initialized, Role: FOLLOWER
I20260805 19:53:56.306955 31109 consensus_queue.cc:260] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f75532becc284985a7260696e5919f9c" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 38095 } }
I20260805 19:53:56.307523 31109 raft_consensus.cc:399] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:53:56.307796 31109 raft_consensus.cc:493] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:53:56.308118 31109 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:53:56.312917 31109 raft_consensus.cc:515] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f75532becc284985a7260696e5919f9c" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 38095 } }
I20260805 19:53:56.313838 31109 leader_election.cc:304] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f75532becc284985a7260696e5919f9c; no voters:
I20260805 19:53:56.315872 31109 leader_election.cc:290] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:53:56.316829 31114 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:53:56.319813 31114 raft_consensus.cc:697] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [term 1 LEADER]: Becoming Leader. State: Replica: f75532becc284985a7260696e5919f9c, State: Running, Role: LEADER
I20260805 19:53:56.320956 31114 consensus_queue.cc:237] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f75532becc284985a7260696e5919f9c" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 38095 } }
I20260805 19:53:56.322978 31109 sys_catalog.cc:565] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [sys.catalog]: configured and running, proceeding with master startup.
I20260805 19:53:56.332283 31116 sys_catalog.cc:455] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f75532becc284985a7260696e5919f9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f75532becc284985a7260696e5919f9c" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 38095 } } }
I20260805 19:53:56.333060 31116 sys_catalog.cc:458] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [sys.catalog]: This master's current role is: LEADER
I20260805 19:53:56.332866 31115 sys_catalog.cc:455] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f75532becc284985a7260696e5919f9c. Latest consensus state: current_term: 1 leader_uuid: "f75532becc284985a7260696e5919f9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f75532becc284985a7260696e5919f9c" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 38095 } } }
I20260805 19:53:56.333817 31115 sys_catalog.cc:458] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c [sys.catalog]: This master's current role is: LEADER
I20260805 19:53:56.337688 31120 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260805 19:53:56.352605 31120 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260805 19:53:56.372354 31120 catalog_manager.cc:1383] Generated new cluster ID: 56acf73911394cbf8eb15018475e2003
I20260805 19:53:56.372671 31120 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260805 19:53:56.406526 31120 catalog_manager.cc:1406] Generated new certificate authority record
I20260805 19:53:56.408262 31120 catalog_manager.cc:1540] Loading token signing keys...
I20260805 19:53:56.425772 31120 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f75532becc284985a7260696e5919f9c: Generated new TSK 0
I20260805 19:53:56.426844 31120 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260805 19:53:56.454443 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.129:0
--local_ip_for_outbound_sockets=127.27.203.129
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:38095
--builtin_ntp_servers=127.27.203.148:34409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20260805 19:53:56.780519 31135 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:53:56.781090 31135 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:53:56.781601 31135 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:53:56.817476 31135 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:53:56.818431 31135 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.129
I20260805 19:53:56.858017 31135 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:34409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:38095
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:53:56.859498 31135 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:53:56.861280 31135 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:53:56.874958 31141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:58.277737 31140 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee20 after lost signal to thread 31135
W20260805 19:53:58.473664 31140 kernel_stack_watchdog.cc:198] Thread 31135 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 400ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260805 19:53:58.474704 31135 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.599s user 0.520s sys 1.019s
W20260805 19:53:58.475195 31135 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.600s user 0.520s sys 1.019s
W20260805 19:53:58.474995 31143 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1598 milliseconds
W20260805 19:53:56.877112 31142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:53:58.476564 31144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:53:58.476505 31135 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:53:58.481058 31135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:53:58.483850 31135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:53:58.485379 31135 hybrid_clock.cc:648] HybridClock initialized: now 1785959638485342 us; error 57 us; skew 500 ppm
I20260805 19:53:58.486544 31135 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:53:58.494576 31135 webserver.cc:533] Webserver started at http://127.27.203.129:43287/ using document root <none> and password file <none>
I20260805 19:53:58.495939 31135 fs_manager.cc:362] Metadata directory not provided
I20260805 19:53:58.496277 31135 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:53:58.496930 31135 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:53:58.503858 31135 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "a9410433c68a4714bc15d75b6ef7aa46"
format_stamp: "Formatted at 2026-08-05 19:53:58 on dist-test-slave-27sr"
I20260805 19:53:58.505585 31135 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "a9410433c68a4714bc15d75b6ef7aa46"
format_stamp: "Formatted at 2026-08-05 19:53:58 on dist-test-slave-27sr"
I20260805 19:53:58.516213 31135 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.006s sys 0.005s
I20260805 19:53:58.524699 31151 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:58.526281 31135 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.001s sys 0.003s
I20260805 19:53:58.526700 31135 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "a9410433c68a4714bc15d75b6ef7aa46"
format_stamp: "Formatted at 2026-08-05 19:53:58 on dist-test-slave-27sr"
I20260805 19:53:58.527084 31135 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:53:58.617256 31135 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:53:58.618974 31135 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:53:58.619490 31135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:53:58.623080 31135 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:53:58.628357 31135 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:53:58.628588 31135 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:58.628961 31135 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:53:58.629132 31135 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:53:58.818208 31135 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.129:34697
I20260805 19:53:58.818437 31268 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.129:34697 every 8 connection(s)
I20260805 19:53:58.821156 31135 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260805 19:53:58.831364 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 31135
I20260805 19:53:58.831918 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestLocateRowAndCheckRowPresence.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260805 19:53:58.854274 31269 heartbeater.cc:344] Connected to a master server at 127.27.203.190:38095
I20260805 19:53:58.854828 31269 heartbeater.cc:461] Registering TS with master...
I20260805 19:53:58.856133 31269 heartbeater.cc:507] Master 127.27.203.190:38095 requested a full tablet report, sending...
I20260805 19:53:58.859184 31073 ts_manager.cc:194] Registered new tserver with Master: a9410433c68a4714bc15d75b6ef7aa46 (127.27.203.129:34697)
I20260805 19:53:58.861948 31073 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.129:36119
I20260805 19:53:58.869956 28462 external_mini_cluster.cc:955] 1 TS(s) registered with all masters
I20260805 19:53:58.911188 31073 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34194:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20260805 19:53:58.992424 31200 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc7dbd395da42bfb350e2af1ece1c25 (DEFAULT_TABLE table=TestTable [id=f844bdc8f63648309c8896c26c2a3b0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:53:58.994500 31200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc7dbd395da42bfb350e2af1ece1c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:53:59.020823 31284 tablet_bootstrap.cc:492] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46: Bootstrap starting.
I20260805 19:53:59.028147 31284 tablet_bootstrap.cc:654] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46: Neither blocks nor log segments found. Creating new log.
I20260805 19:53:59.030251 31284 log.cc:826] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46: Log is configured to *not* fsync() on all Append() calls
I20260805 19:53:59.035503 31284 tablet_bootstrap.cc:492] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46: No bootstrap required, opened a new log
I20260805 19:53:59.036128 31284 ts_tablet_manager.cc:1403] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.011s
I20260805 19:53:59.055377 31284 raft_consensus.cc:359] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9410433c68a4714bc15d75b6ef7aa46" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34697 } }
I20260805 19:53:59.056061 31284 raft_consensus.cc:385] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:53:59.056358 31284 raft_consensus.cc:740] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9410433c68a4714bc15d75b6ef7aa46, State: Initialized, Role: FOLLOWER
I20260805 19:53:59.057243 31284 consensus_queue.cc:260] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9410433c68a4714bc15d75b6ef7aa46" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34697 } }
I20260805 19:53:59.057792 31284 raft_consensus.cc:399] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:53:59.058118 31284 raft_consensus.cc:493] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:53:59.058472 31284 raft_consensus.cc:3060] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:53:59.062915 31284 raft_consensus.cc:515] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9410433c68a4714bc15d75b6ef7aa46" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34697 } }
I20260805 19:53:59.063678 31284 leader_election.cc:304] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9410433c68a4714bc15d75b6ef7aa46; no voters:
I20260805 19:53:59.065864 31284 leader_election.cc:290] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:53:59.066368 31286 raft_consensus.cc:2804] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:53:59.068861 31269 heartbeater.cc:499] Master 127.27.203.190:38095 was elected leader, sending a full tablet report...
I20260805 19:53:59.070227 31284 ts_tablet_manager.cc:1434] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46: Time spent starting tablet: real 0.034s user 0.025s sys 0.007s
I20260805 19:53:59.070179 31286 raft_consensus.cc:697] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46 [term 1 LEADER]: Becoming Leader. State: Replica: a9410433c68a4714bc15d75b6ef7aa46, State: Running, Role: LEADER
I20260805 19:53:59.071168 31286 consensus_queue.cc:237] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9410433c68a4714bc15d75b6ef7aa46" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34697 } }
W20260805 19:53:59.077849 31270 tablet.cc:2406] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 19:53:59.087441 31073 catalog_manager.cc:5697] T 9bc7dbd395da42bfb350e2af1ece1c25 P a9410433c68a4714bc15d75b6ef7aa46 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9410433c68a4714bc15d75b6ef7aa46 (127.27.203.129). New cstate: current_term: 1 leader_uuid: "a9410433c68a4714bc15d75b6ef7aa46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9410433c68a4714bc15d75b6ef7aa46" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34697 } health_report { overall_health: HEALTHY } } }
I20260805 19:53:59.125985 28462 external_mini_cluster.cc:955] 1 TS(s) registered with all masters
I20260805 19:53:59.129554 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver a9410433c68a4714bc15d75b6ef7aa46 to finish bootstrapping
I20260805 19:54:05.209234 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 31135
I20260805 19:54:05.246757 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 31039
2026-08-05T19:54:05Z chronyd exiting
[ OK ] AdminCliTest.TestLocateRowAndCheckRowPresence (11712 ms)
[ RUN ] AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable
I20260805 19:54:05.305717 28462 ts_itest-base.cc:115] Starting cluster with:
I20260805 19:54:05.305917 28462 ts_itest-base.cc:116] --------------
I20260805 19:54:05.306161 28462 ts_itest-base.cc:117] 1 tablet servers
I20260805 19:54:05.306347 28462 ts_itest-base.cc:118] 1 replicas per TS
I20260805 19:54:05.306540 28462 ts_itest-base.cc:119] --------------
2026-08-05T19:54:05Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-05T19:54:05Z Disabled control of system clock
I20260805 19:54:05.355018 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:35025
--webserver_interface=127.27.203.190
--webserver_port=0
--builtin_ntp_servers=127.27.203.148:42751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.203.190:35025 with env {}
W20260805 19:54:05.678256 31346 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:05.678939 31346 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:54:05.679422 31346 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:05.713217 31346 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 19:54:05.713600 31346 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:54:05.713881 31346 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 19:54:05.714152 31346 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260805 19:54:05.751479 31346 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:42751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.203.190:35025
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:35025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.27.203.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:54:05.752959 31346 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:54:05.754662 31346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:54:05.765910 31352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:07.171517 31351 debug-util.cc:398] Leaking SignalData structure 0x7b08000290e0 after lost signal to thread 31346
W20260805 19:54:07.521437 31346 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.755s user 0.644s sys 1.111s
W20260805 19:54:05.766605 31353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:07.521890 31346 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.756s user 0.644s sys 1.111s
W20260805 19:54:07.524214 31355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:07.527189 31354 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1756 milliseconds
I20260805 19:54:07.527235 31346 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:54:07.528743 31346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:54:07.531427 31346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:54:07.532868 31346 hybrid_clock.cc:648] HybridClock initialized: now 1785959647532811 us; error 62 us; skew 500 ppm
I20260805 19:54:07.534065 31346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:54:07.541141 31346 webserver.cc:533] Webserver started at http://127.27.203.190:40065/ using document root <none> and password file <none>
I20260805 19:54:07.542294 31346 fs_manager.cc:362] Metadata directory not provided
I20260805 19:54:07.542587 31346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:54:07.543155 31346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:54:07.548123 31346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "cd347fd87c714d389514802bc9375337"
format_stamp: "Formatted at 2026-08-05 19:54:07 on dist-test-slave-27sr"
I20260805 19:54:07.549881 31346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "cd347fd87c714d389514802bc9375337"
format_stamp: "Formatted at 2026-08-05 19:54:07 on dist-test-slave-27sr"
I20260805 19:54:07.558317 31346 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.004s sys 0.005s
I20260805 19:54:07.565057 31363 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:07.566411 31346 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.003s
I20260805 19:54:07.566795 31346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
uuid: "cd347fd87c714d389514802bc9375337"
format_stamp: "Formatted at 2026-08-05 19:54:07 on dist-test-slave-27sr"
I20260805 19:54:07.567162 31346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:54:07.620563 31346 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:54:07.622128 31346 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:54:07.622593 31346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:54:07.702090 31346 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.190:35025
I20260805 19:54:07.702162 31417 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.190:35025 every 8 connection(s)
I20260805 19:54:07.705346 31346 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260805 19:54:07.709666 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 31346
I20260805 19:54:07.710332 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260805 19:54:07.712208 31418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:54:07.739494 31418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337: Bootstrap starting.
I20260805 19:54:07.745769 31418 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337: Neither blocks nor log segments found. Creating new log.
I20260805 19:54:07.747570 31418 log.cc:826] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337: Log is configured to *not* fsync() on all Append() calls
I20260805 19:54:07.752779 31418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337: No bootstrap required, opened a new log
I20260805 19:54:07.772461 31418 raft_consensus.cc:359] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd347fd87c714d389514802bc9375337" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 35025 } }
I20260805 19:54:07.773438 31418 raft_consensus.cc:385] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:54:07.773763 31418 raft_consensus.cc:740] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd347fd87c714d389514802bc9375337, State: Initialized, Role: FOLLOWER
I20260805 19:54:07.774751 31418 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd347fd87c714d389514802bc9375337" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 35025 } }
I20260805 19:54:07.775336 31418 raft_consensus.cc:399] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:54:07.775643 31418 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:54:07.775988 31418 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:54:07.780123 31418 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd347fd87c714d389514802bc9375337" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 35025 } }
I20260805 19:54:07.780869 31418 leader_election.cc:304] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd347fd87c714d389514802bc9375337; no voters:
I20260805 19:54:07.782816 31418 leader_election.cc:290] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:54:07.783671 31423 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:54:07.786113 31423 raft_consensus.cc:697] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [term 1 LEADER]: Becoming Leader. State: Replica: cd347fd87c714d389514802bc9375337, State: Running, Role: LEADER
I20260805 19:54:07.786871 31423 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd347fd87c714d389514802bc9375337" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 35025 } }
I20260805 19:54:07.787423 31418 sys_catalog.cc:565] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 19:54:07.799290 31425 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd347fd87c714d389514802bc9375337. Latest consensus state: current_term: 1 leader_uuid: "cd347fd87c714d389514802bc9375337" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd347fd87c714d389514802bc9375337" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 35025 } } }
I20260805 19:54:07.800185 31425 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [sys.catalog]: This master's current role is: LEADER
I20260805 19:54:07.800570 31424 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd347fd87c714d389514802bc9375337" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd347fd87c714d389514802bc9375337" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 35025 } } }
I20260805 19:54:07.801565 31424 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337 [sys.catalog]: This master's current role is: LEADER
I20260805 19:54:07.804113 31431 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260805 19:54:07.817466 31431 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260805 19:54:07.835295 31431 catalog_manager.cc:1383] Generated new cluster ID: 947027783cf944eabe5221670e8106f6
I20260805 19:54:07.835610 31431 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260805 19:54:07.857616 31431 catalog_manager.cc:1406] Generated new certificate authority record
I20260805 19:54:07.859181 31431 catalog_manager.cc:1540] Loading token signing keys...
I20260805 19:54:07.881793 31431 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337: Generated new TSK 0
I20260805 19:54:07.882665 31431 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260805 19:54:07.901114 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.129:0
--local_ip_for_outbound_sockets=127.27.203.129
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:35025
--builtin_ntp_servers=127.27.203.148:42751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20260805 19:54:08.252789 31443 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:08.253350 31443 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:54:08.253857 31443 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:08.289628 31443 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:54:08.290555 31443 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.129
I20260805 19:54:08.332528 31443 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:42751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:35025
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:54:08.333992 31443 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:54:08.335868 31443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:54:08.351145 31449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:09.752656 31448 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee20 after lost signal to thread 31443
W20260805 19:54:10.118307 31448 kernel_stack_watchdog.cc:198] Thread 31443 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 399ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260805 19:54:08.352500 31450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:10.120438 31451 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1767 milliseconds
W20260805 19:54:10.126518 31443 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.775s user 0.004s sys 0.005s
W20260805 19:54:10.126993 31443 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.776s user 0.004s sys 0.005s
W20260805 19:54:10.128710 31452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:54:10.128727 31443 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:54:10.130268 31443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:54:10.133323 31443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:54:10.134845 31443 hybrid_clock.cc:648] HybridClock initialized: now 1785959650134759 us; error 95 us; skew 500 ppm
I20260805 19:54:10.135834 31443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:54:10.144244 31443 webserver.cc:533] Webserver started at http://127.27.203.129:33039/ using document root <none> and password file <none>
I20260805 19:54:10.145422 31443 fs_manager.cc:362] Metadata directory not provided
I20260805 19:54:10.145715 31443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:54:10.146286 31443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:54:10.151396 31443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "10b20987d7e541b5b9586f5be4f6c345"
format_stamp: "Formatted at 2026-08-05 19:54:10 on dist-test-slave-27sr"
I20260805 19:54:10.152798 31443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "10b20987d7e541b5b9586f5be4f6c345"
format_stamp: "Formatted at 2026-08-05 19:54:10 on dist-test-slave-27sr"
I20260805 19:54:10.162773 31443 fs_manager.cc:696] Time spent creating directory manager: real 0.009s user 0.006s sys 0.003s
I20260805 19:54:10.170333 31459 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:10.171880 31443 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260805 19:54:10.172374 31443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "10b20987d7e541b5b9586f5be4f6c345"
format_stamp: "Formatted at 2026-08-05 19:54:10 on dist-test-slave-27sr"
I20260805 19:54:10.172798 31443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:54:10.247275 31443 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:54:10.249126 31443 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:54:10.249676 31443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:54:10.253445 31443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:54:10.258550 31443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:54:10.258821 31443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:10.259193 31443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:54:10.259369 31443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:10.461071 31443 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.129:46093
I20260805 19:54:10.461205 31575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.129:46093 every 8 connection(s)
I20260805 19:54:10.464327 31443 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260805 19:54:10.472946 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 31443
I20260805 19:54:10.473477 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260805 19:54:10.499799 31576 heartbeater.cc:344] Connected to a master server at 127.27.203.190:35025
I20260805 19:54:10.500396 31576 heartbeater.cc:461] Registering TS with master...
I20260805 19:54:10.501854 31576 heartbeater.cc:507] Master 127.27.203.190:35025 requested a full tablet report, sending...
I20260805 19:54:10.505120 31380 ts_manager.cc:194] Registered new tserver with Master: 10b20987d7e541b5b9586f5be4f6c345 (127.27.203.129:46093)
I20260805 19:54:10.507997 31380 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.129:35051
I20260805 19:54:10.513636 28462 external_mini_cluster.cc:955] 1 TS(s) registered with all masters
I20260805 19:54:10.559187 31379 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55614:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20260805 19:54:10.643874 31507 tablet_service.cc:1511] Processing CreateTablet for tablet 55936de608c942d69464b4410effec84 (DEFAULT_TABLE table=TestTable [id=71951c2e8020403da8a7f543f8352a34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:54:10.646313 31507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55936de608c942d69464b4410effec84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:54:10.671541 31591 tablet_bootstrap.cc:492] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345: Bootstrap starting.
I20260805 19:54:10.678814 31591 tablet_bootstrap.cc:654] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345: Neither blocks nor log segments found. Creating new log.
I20260805 19:54:10.681022 31591 log.cc:826] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345: Log is configured to *not* fsync() on all Append() calls
I20260805 19:54:10.686784 31591 tablet_bootstrap.cc:492] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345: No bootstrap required, opened a new log
I20260805 19:54:10.687300 31591 ts_tablet_manager.cc:1403] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.005s
I20260805 19:54:10.712126 31591 raft_consensus.cc:359] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } }
I20260805 19:54:10.712949 31591 raft_consensus.cc:385] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:54:10.713280 31591 raft_consensus.cc:740] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b20987d7e541b5b9586f5be4f6c345, State: Initialized, Role: FOLLOWER
I20260805 19:54:10.714224 31591 consensus_queue.cc:260] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } }
I20260805 19:54:10.714939 31591 raft_consensus.cc:399] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:54:10.715360 31591 raft_consensus.cc:493] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:54:10.715765 31591 raft_consensus.cc:3060] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:54:10.722432 31591 raft_consensus.cc:515] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } }
I20260805 19:54:10.723414 31591 leader_election.cc:304] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10b20987d7e541b5b9586f5be4f6c345; no voters:
I20260805 19:54:10.725801 31591 leader_election.cc:290] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:54:10.726796 31593 raft_consensus.cc:2804] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:54:10.735589 31591 ts_tablet_manager.cc:1434] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345: Time spent starting tablet: real 0.048s user 0.037s sys 0.010s
I20260805 19:54:10.736447 31576 heartbeater.cc:499] Master 127.27.203.190:35025 was elected leader, sending a full tablet report...
I20260805 19:54:10.738371 31593 raft_consensus.cc:697] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345 [term 1 LEADER]: Becoming Leader. State: Replica: 10b20987d7e541b5b9586f5be4f6c345, State: Running, Role: LEADER
I20260805 19:54:10.739384 31593 consensus_queue.cc:237] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } }
I20260805 19:54:10.755029 31379 catalog_manager.cc:5697] T 55936de608c942d69464b4410effec84 P 10b20987d7e541b5b9586f5be4f6c345 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10b20987d7e541b5b9586f5be4f6c345 (127.27.203.129). New cstate: current_term: 1 leader_uuid: "10b20987d7e541b5b9586f5be4f6c345" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } health_report { overall_health: HEALTHY } } }
I20260805 19:54:10.800005 28462 external_mini_cluster.cc:955] 1 TS(s) registered with all masters
I20260805 19:54:10.803705 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 10b20987d7e541b5b9586f5be4f6c345 to finish bootstrapping
I20260805 19:54:10.825726 31379 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55614:
name: "TestTable2"
schema {
columns {
name: "key_INT8"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "key_INT16"
type: INT16
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "key_INT32"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "key_INT64"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "key_UNIXTIME_MICROS"
type: UNIXTIME_MICROS
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "key_BINARY"
type: BINARY
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "key_STRING"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "<redacted>""\006\177\000\001\000\002\000\000\000\003\000\000\000\000\000\000\000\004\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\007\177\005\006\000\007\000\000\000\010\000\000\000\000\000\000\000\t\000\000\000\000\000\000\000\002\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\003\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000"
indirect_data: "<redacted>""abcd"
}
partition_schema {
range_schema {
columns {
name: "key_INT8"
}
columns {
name: "key_INT16"
}
columns {
name: "key_INT32"
}
columns {
name: "key_INT64"
}
columns {
name: "key_UNIXTIME_MICROS"
}
columns {
name: "key_BINARY"
}
columns {
name: "key_STRING"
}
}
}
I20260805 19:54:10.846657 31507 tablet_service.cc:1511] Processing CreateTablet for tablet a5d3aba76d0a4289956ebce127e5ae07 (DEFAULT_TABLE table=TestTable2 [id=24bbbecaf7954eb4a2c45f990ed7856b]), partition=RANGE (key_INT8, key_INT16, key_INT32, key_INT64, key_UNIXTIME_MICROS, key_BINARY, key_STRING) PARTITION (0, 1, 2, 3, 1970-01-01T00:00:00.000004Z, "a", "b") <= VALUES < (5, 6, 7, 8, 1970-01-01T00:00:00.000009Z, "c", "d")
I20260805 19:54:10.848706 31507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d3aba76d0a4289956ebce127e5ae07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:54:10.859161 31591 tablet_bootstrap.cc:492] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345: Bootstrap starting.
I20260805 19:54:10.864153 31591 tablet_bootstrap.cc:654] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345: Neither blocks nor log segments found. Creating new log.
I20260805 19:54:10.869896 31591 tablet_bootstrap.cc:492] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345: No bootstrap required, opened a new log
I20260805 19:54:10.870290 31591 ts_tablet_manager.cc:1403] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260805 19:54:10.872558 31591 raft_consensus.cc:359] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } }
I20260805 19:54:10.873020 31591 raft_consensus.cc:385] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:54:10.873260 31591 raft_consensus.cc:740] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b20987d7e541b5b9586f5be4f6c345, State: Initialized, Role: FOLLOWER
I20260805 19:54:10.873819 31591 consensus_queue.cc:260] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } }
I20260805 19:54:10.874320 31591 raft_consensus.cc:399] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:54:10.874616 31591 raft_consensus.cc:493] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:54:10.874894 31591 raft_consensus.cc:3060] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:54:10.879549 31591 raft_consensus.cc:515] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } }
I20260805 19:54:10.880178 31591 leader_election.cc:304] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10b20987d7e541b5b9586f5be4f6c345; no voters:
I20260805 19:54:10.880647 31591 leader_election.cc:290] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:54:10.880818 31593 raft_consensus.cc:2804] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:54:10.881395 31593 raft_consensus.cc:697] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345 [term 1 LEADER]: Becoming Leader. State: Replica: 10b20987d7e541b5b9586f5be4f6c345, State: Running, Role: LEADER
I20260805 19:54:10.882074 31591 ts_tablet_manager.cc:1434] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260805 19:54:10.882035 31593 consensus_queue.cc:237] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } }
I20260805 19:54:10.889190 31379 catalog_manager.cc:5697] T a5d3aba76d0a4289956ebce127e5ae07 P 10b20987d7e541b5b9586f5be4f6c345 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10b20987d7e541b5b9586f5be4f6c345 (127.27.203.129). New cstate: current_term: 1 leader_uuid: "10b20987d7e541b5b9586f5be4f6c345" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } health_report { overall_health: HEALTHY } } }
I20260805 19:54:12.658789 31380 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55142:
table { table_name: "TestTable2" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\177\n\013\000\014\000\000\000\r\000\000\000\000\000\000\000\016\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\007\177\017\020\000\021\000\000\000\022\000\000\000\000\000\000\000\023\000\000\000\000\000\000\000\002\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\003\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000" indirect_data: "<redacted>""efgh" } } } schema { columns { name: "key_INT8" type: INT8 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "key_INT16" type: INT16 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "key_INT32" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "key_INT64" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "key_UNIXTIME_MICROS" type: UNIXTIME_MICROS is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "key_BINARY" type: BINARY is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "key_STRING" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
W20260805 19:54:12.677800 31380 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05a6039d6fa54696b9fd05334faaf7c6 has no consensus state
I20260805 19:54:12.691627 31507 tablet_service.cc:1511] Processing CreateTablet for tablet 05a6039d6fa54696b9fd05334faaf7c6 (DEFAULT_TABLE table=TestTable2 [id=24bbbecaf7954eb4a2c45f990ed7856b]), partition=RANGE (key_INT8, key_INT16, key_INT32, key_INT64, key_UNIXTIME_MICROS, key_BINARY, key_STRING) PARTITION (10, 11, 12, 13, 1970-01-01T00:00:00.000014Z, "e", "f") <= VALUES < (15, 16, 17, 18, 1970-01-01T00:00:00.000019Z, "g", "h")
I20260805 19:54:12.693660 31507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a6039d6fa54696b9fd05334faaf7c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:54:12.712260 31619 tablet_bootstrap.cc:492] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345: Bootstrap starting.
I20260805 19:54:12.721123 31619 tablet_bootstrap.cc:654] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345: Neither blocks nor log segments found. Creating new log.
I20260805 19:54:12.727356 31619 tablet_bootstrap.cc:492] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345: No bootstrap required, opened a new log
I20260805 19:54:12.727837 31619 ts_tablet_manager.cc:1403] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.003s
W20260805 19:54:12.731088 31365 catalog_manager.cc:4810] Async tablet task AlterTable RPC for tablet 05a6039d6fa54696b9fd05334faaf7c6 (table TestTable2 [id=24bbbecaf7954eb4a2c45f990ed7856b], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 05a6039d6fa54696b9fd05334faaf7c6 consensus state has no leader
I20260805 19:54:12.730927 31619 raft_consensus.cc:359] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } }
I20260805 19:54:12.731514 31619 raft_consensus.cc:385] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:54:12.731822 31619 raft_consensus.cc:740] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b20987d7e541b5b9586f5be4f6c345, State: Initialized, Role: FOLLOWER
I20260805 19:54:12.732697 31619 consensus_queue.cc:260] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } }
I20260805 19:54:12.733527 31619 raft_consensus.cc:399] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:54:12.733965 31619 raft_consensus.cc:493] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:54:12.734336 31619 raft_consensus.cc:3060] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:54:12.742112 31619 raft_consensus.cc:515] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } }
I20260805 19:54:12.742964 31619 leader_election.cc:304] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10b20987d7e541b5b9586f5be4f6c345; no voters:
I20260805 19:54:12.745747 31619 leader_election.cc:290] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:54:12.746073 31621 raft_consensus.cc:2804] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:54:12.749716 31619 ts_tablet_manager.cc:1434] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345: Time spent starting tablet: real 0.022s user 0.015s sys 0.004s
I20260805 19:54:12.750538 31621 raft_consensus.cc:697] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [term 1 LEADER]: Becoming Leader. State: Replica: 10b20987d7e541b5b9586f5be4f6c345, State: Running, Role: LEADER
I20260805 19:54:12.751431 31621 consensus_queue.cc:237] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } }
I20260805 19:54:12.759167 31380 catalog_manager.cc:5697] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10b20987d7e541b5b9586f5be4f6c345 (127.27.203.129). New cstate: current_term: 1 leader_uuid: "10b20987d7e541b5b9586f5be4f6c345" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10b20987d7e541b5b9586f5be4f6c345" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 46093 } health_report { overall_health: HEALTHY } } }
I20260805 19:54:12.773283 31380 catalog_manager.cc:6242] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337: TestTable2 [id=24bbbecaf7954eb4a2c45f990ed7856b] alter complete (version 0)
I20260805 19:54:16.067731 31380 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55156:
table { table_name: "TestTable2" } alter_schema_steps { type: DROP_RANGE_PARTITION drop_range_partition { range_bounds { rows: "<redacted>""\006\177\n\013\000\014\000\000\000\r\000\000\000\000\000\000\000\016\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\007\177\017\020\000\021\000\000\000\022\000\000\000\000\000\000\000\023\000\000\000\000\000\000\000\002\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\003\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000" indirect_data: "<redacted>""efgh" } } } schema { columns { name: "key_INT8" type: INT8 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "key_INT16" type: INT16 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "key_INT32" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "key_INT64" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "key_UNIXTIME_MICROS" type: UNIXTIME_MICROS is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "key_BINARY" type: BINARY is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "key_STRING" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
I20260805 19:54:16.088841 31380 catalog_manager.cc:5984] T 00000000000000000000000000000000 P cd347fd87c714d389514802bc9375337: Sending DeleteTablet for 1 replicas of tablet 05a6039d6fa54696b9fd05334faaf7c6
I20260805 19:54:16.091457 31506 tablet_service.cc:1558] Processing DeleteTablet for tablet 05a6039d6fa54696b9fd05334faaf7c6 with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-08-05 19:54:16 UTC) from {username='slave'} at 127.0.0.1:49840
I20260805 19:54:16.093658 31654 tablet_replica.cc:333] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345: stopping tablet replica
I20260805 19:54:16.094655 31654 raft_consensus.cc:2243] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [term 1 LEADER]: Raft consensus shutting down.
I20260805 19:54:16.095398 31654 raft_consensus.cc:2272] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 19:54:16.097579 31654 ts_tablet_manager.cc:1916] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 19:54:16.110595 31654 ts_tablet_manager.cc:1929] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 19:54:16.111013 31654 log.cc:1199] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345: Deleting WAL directory at /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/wals/05a6039d6fa54696b9fd05334faaf7c6
I20260805 19:54:16.111740 31654 ts_tablet_manager.cc:1950] T 05a6039d6fa54696b9fd05334faaf7c6 P 10b20987d7e541b5b9586f5be4f6c345: Deleting consensus metadata
I20260805 19:54:16.114661 31365 catalog_manager.cc:5028] TS 10b20987d7e541b5b9586f5be4f6c345 (127.27.203.129:46093): tablet 05a6039d6fa54696b9fd05334faaf7c6 (table TestTable2 [id=24bbbecaf7954eb4a2c45f990ed7856b]) successfully deleted
I20260805 19:54:17.161900 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 31443
I20260805 19:54:17.199517 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 31346
2026-08-05T19:54:17Z chronyd exiting
[ OK ] AdminCliTest.TestAddAndDropRangePartitionForMultipleRangeColumnsTable (11957 ms)
[ RUN ] AdminCliTest.TestAddColumnsAndRebuildMaster
I20260805 19:54:17.263584 28462 ts_itest-base.cc:115] Starting cluster with:
I20260805 19:54:17.263768 28462 ts_itest-base.cc:116] --------------
I20260805 19:54:17.263949 28462 ts_itest-base.cc:117] 3 tablet servers
I20260805 19:54:17.264106 28462 ts_itest-base.cc:118] 3 replicas per TS
I20260805 19:54:17.264274 28462 ts_itest-base.cc:119] --------------
2026-08-05T19:54:17Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-05T19:54:17Z Disabled control of system clock
I20260805 19:54:17.310339 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:37173
--webserver_interface=127.27.203.190
--webserver_port=0
--builtin_ntp_servers=127.27.203.148:38385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.203.190:37173 with env {}
W20260805 19:54:17.642279 31662 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:17.642994 31662 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:54:17.643508 31662 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:17.678030 31662 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 19:54:17.678406 31662 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:54:17.678716 31662 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 19:54:17.679013 31662 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260805 19:54:17.718505 31662 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:38385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.203.190:37173
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:37173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.27.203.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:54:17.720029 31662 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:54:17.721931 31662 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:54:17.734478 31668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:19.139246 31667 debug-util.cc:398] Leaking SignalData structure 0x7b08000290e0 after lost signal to thread 31662
W20260805 19:54:19.670308 31667 kernel_stack_watchdog.cc:198] Thread 31662 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 402ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260805 19:54:17.734642 31669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:19.671483 31662 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.938s user 0.682s sys 1.252s
W20260805 19:54:19.671942 31662 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.939s user 0.682s sys 1.253s
W20260805 19:54:19.672045 31670 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1937 milliseconds
I20260805 19:54:19.673501 31662 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
W20260805 19:54:19.673583 31671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:54:19.676565 31662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:54:19.679062 31662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:54:19.680429 31662 hybrid_clock.cc:648] HybridClock initialized: now 1785959659680387 us; error 57 us; skew 500 ppm
I20260805 19:54:19.681252 31662 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:54:19.688118 31662 webserver.cc:533] Webserver started at http://127.27.203.190:39877/ using document root <none> and password file <none>
I20260805 19:54:19.689085 31662 fs_manager.cc:362] Metadata directory not provided
I20260805 19:54:19.689281 31662 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:54:19.689706 31662 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:54:19.694144 31662 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "e4a807e639c248f48e3c8620aef5d437"
format_stamp: "Formatted at 2026-08-05 19:54:19 on dist-test-slave-27sr"
I20260805 19:54:19.695326 31662 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "e4a807e639c248f48e3c8620aef5d437"
format_stamp: "Formatted at 2026-08-05 19:54:19 on dist-test-slave-27sr"
I20260805 19:54:19.704046 31662 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.002s sys 0.005s
I20260805 19:54:19.710551 31678 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:19.712146 31662 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.005s sys 0.001s
I20260805 19:54:19.712586 31662 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
uuid: "e4a807e639c248f48e3c8620aef5d437"
format_stamp: "Formatted at 2026-08-05 19:54:19 on dist-test-slave-27sr"
I20260805 19:54:19.713002 31662 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:54:19.786152 31662 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:54:19.788065 31662 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:54:19.788612 31662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:54:19.873610 31662 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.190:37173
I20260805 19:54:19.873693 31730 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.190:37173 every 8 connection(s)
I20260805 19:54:19.876868 31662 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260805 19:54:19.881934 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 31662
I20260805 19:54:19.882395 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260805 19:54:19.883383 31731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:54:19.911226 31731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437: Bootstrap starting.
I20260805 19:54:19.917366 31731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437: Neither blocks nor log segments found. Creating new log.
I20260805 19:54:19.919680 31731 log.cc:826] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437: Log is configured to *not* fsync() on all Append() calls
I20260805 19:54:19.925136 31731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437: No bootstrap required, opened a new log
I20260805 19:54:19.954362 31731 raft_consensus.cc:359] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a807e639c248f48e3c8620aef5d437" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37173 } }
I20260805 19:54:19.955648 31731 raft_consensus.cc:385] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:54:19.956115 31731 raft_consensus.cc:740] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a807e639c248f48e3c8620aef5d437, State: Initialized, Role: FOLLOWER
I20260805 19:54:19.957204 31731 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a807e639c248f48e3c8620aef5d437" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37173 } }
I20260805 19:54:19.958012 31731 raft_consensus.cc:399] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:54:19.958412 31731 raft_consensus.cc:493] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:54:19.958902 31731 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:54:19.965121 31731 raft_consensus.cc:515] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a807e639c248f48e3c8620aef5d437" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37173 } }
I20260805 19:54:19.965942 31731 leader_election.cc:304] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4a807e639c248f48e3c8620aef5d437; no voters:
I20260805 19:54:19.968024 31731 leader_election.cc:290] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:54:19.968887 31736 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:54:19.971827 31736 raft_consensus.cc:697] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [term 1 LEADER]: Becoming Leader. State: Replica: e4a807e639c248f48e3c8620aef5d437, State: Running, Role: LEADER
I20260805 19:54:19.973018 31731 sys_catalog.cc:565] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 19:54:19.972795 31736 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a807e639c248f48e3c8620aef5d437" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37173 } }
I20260805 19:54:19.985231 31737 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4a807e639c248f48e3c8620aef5d437" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a807e639c248f48e3c8620aef5d437" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37173 } } }
I20260805 19:54:19.985193 31738 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4a807e639c248f48e3c8620aef5d437. Latest consensus state: current_term: 1 leader_uuid: "e4a807e639c248f48e3c8620aef5d437" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a807e639c248f48e3c8620aef5d437" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37173 } } }
I20260805 19:54:19.986173 31737 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [sys.catalog]: This master's current role is: LEADER
I20260805 19:54:19.986217 31738 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437 [sys.catalog]: This master's current role is: LEADER
I20260805 19:54:19.995450 31744 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260805 19:54:20.008423 31744 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260805 19:54:20.026109 31744 catalog_manager.cc:1383] Generated new cluster ID: 3b473ca10cf34769857bf1b528d70600
I20260805 19:54:20.026503 31744 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260805 19:54:20.053400 31744 catalog_manager.cc:1406] Generated new certificate authority record
I20260805 19:54:20.055042 31744 catalog_manager.cc:1540] Loading token signing keys...
I20260805 19:54:20.075563 31744 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437: Generated new TSK 0
I20260805 19:54:20.076706 31744 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260805 19:54:20.094568 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.129:0
--local_ip_for_outbound_sockets=127.27.203.129
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37173
--builtin_ntp_servers=127.27.203.148:38385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20260805 19:54:20.458971 31756 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:20.459539 31756 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:54:20.460125 31756 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:20.496847 31756 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:54:20.497774 31756 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.129
I20260805 19:54:20.537616 31756 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:38385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:54:20.539073 31756 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:54:20.540911 31756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:54:20.557044 31762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:21.956538 31761 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee20 after lost signal to thread 31756
W20260805 19:54:22.389259 31761 kernel_stack_watchdog.cc:198] Thread 31756 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 396ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260805 19:54:20.558969 31763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:22.390596 31756 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.832s user 0.554s sys 1.052s
W20260805 19:54:22.390735 31764 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1831 milliseconds
W20260805 19:54:22.391099 31756 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.833s user 0.555s sys 1.053s
I20260805 19:54:22.391690 31756 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
W20260805 19:54:22.391721 31765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:54:22.396684 31756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:54:22.399540 31756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:54:22.401080 31756 hybrid_clock.cc:648] HybridClock initialized: now 1785959662401028 us; error 51 us; skew 500 ppm
I20260805 19:54:22.402238 31756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:54:22.410458 31756 webserver.cc:533] Webserver started at http://127.27.203.129:34701/ using document root <none> and password file <none>
I20260805 19:54:22.411863 31756 fs_manager.cc:362] Metadata directory not provided
I20260805 19:54:22.412200 31756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:54:22.412863 31756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:54:22.419656 31756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "99e86245270340738be339c3b6b6c60b"
format_stamp: "Formatted at 2026-08-05 19:54:22 on dist-test-slave-27sr"
I20260805 19:54:22.421470 31756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "99e86245270340738be339c3b6b6c60b"
format_stamp: "Formatted at 2026-08-05 19:54:22 on dist-test-slave-27sr"
I20260805 19:54:22.432453 31756 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.010s sys 0.001s
I20260805 19:54:22.440713 31772 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:22.442221 31756 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260805 19:54:22.442626 31756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "99e86245270340738be339c3b6b6c60b"
format_stamp: "Formatted at 2026-08-05 19:54:22 on dist-test-slave-27sr"
I20260805 19:54:22.442975 31756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:54:22.510103 31756 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:54:22.511782 31756 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:54:22.512354 31756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:54:22.515499 31756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:54:22.521194 31756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:54:22.521425 31756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:22.521740 31756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:54:22.521895 31756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:22.699919 31756 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.129:39091
I20260805 19:54:22.700049 31890 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.129:39091 every 8 connection(s)
I20260805 19:54:22.702742 31756 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260805 19:54:22.709429 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 31756
I20260805 19:54:22.709918 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260805 19:54:22.718995 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.130:0
--local_ip_for_outbound_sockets=127.27.203.130
--webserver_interface=127.27.203.130
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37173
--builtin_ntp_servers=127.27.203.148:38385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:54:22.753580 31891 heartbeater.cc:344] Connected to a master server at 127.27.203.190:37173
I20260805 19:54:22.754168 31891 heartbeater.cc:461] Registering TS with master...
I20260805 19:54:22.755738 31891 heartbeater.cc:507] Master 127.27.203.190:37173 requested a full tablet report, sending...
I20260805 19:54:22.759449 31695 ts_manager.cc:194] Registered new tserver with Master: 99e86245270340738be339c3b6b6c60b (127.27.203.129:39091)
I20260805 19:54:22.762570 31695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.129:37697
W20260805 19:54:23.188105 31895 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:23.188746 31895 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:54:23.189189 31895 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:23.224334 31895 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:54:23.225212 31895 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.130
I20260805 19:54:23.264248 31895 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:38385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.27.203.130
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:54:23.265616 31895 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:54:23.267319 31895 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:54:23.282300 31901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:54:23.767705 31891 heartbeater.cc:499] Master 127.27.203.190:37173 was elected leader, sending a full tablet report...
W20260805 19:54:24.060709 31727 debug-util.cc:398] Leaking SignalData structure 0x7b080008cac0 after lost signal to thread 31663
W20260805 19:54:24.061746 31727 debug-util.cc:398] Leaking SignalData structure 0x7b0800070200 after lost signal to thread 31730
W20260805 19:54:24.686599 31900 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee20 after lost signal to thread 31895
W20260805 19:54:24.763500 31895 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.482s user 0.547s sys 0.921s
W20260805 19:54:24.764590 31895 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.483s user 0.548s sys 0.921s
W20260805 19:54:23.282584 31902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:24.765928 31903 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1480 milliseconds
W20260805 19:54:24.766464 31904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:54:24.766906 31895 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:54:24.771311 31895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:54:24.773979 31895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:54:24.775444 31895 hybrid_clock.cc:648] HybridClock initialized: now 1785959664775350 us; error 102 us; skew 500 ppm
I20260805 19:54:24.776678 31895 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:54:24.784263 31895 webserver.cc:533] Webserver started at http://127.27.203.130:37193/ using document root <none> and password file <none>
I20260805 19:54:24.785298 31895 fs_manager.cc:362] Metadata directory not provided
I20260805 19:54:24.785629 31895 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:54:24.786146 31895 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:54:24.790752 31895 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "a227648e641f4a5f89a8313e2f842831"
format_stamp: "Formatted at 2026-08-05 19:54:24 on dist-test-slave-27sr"
I20260805 19:54:24.792130 31895 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "a227648e641f4a5f89a8313e2f842831"
format_stamp: "Formatted at 2026-08-05 19:54:24 on dist-test-slave-27sr"
I20260805 19:54:24.801095 31895 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.002s sys 0.006s
I20260805 19:54:24.807708 31911 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:24.809286 31895 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260805 19:54:24.809710 31895 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "a227648e641f4a5f89a8313e2f842831"
format_stamp: "Formatted at 2026-08-05 19:54:24 on dist-test-slave-27sr"
I20260805 19:54:24.810271 31895 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:54:24.908272 31895 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:54:24.910059 31895 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:54:24.911003 31895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:54:24.914907 31895 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:54:24.920254 31895 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:54:24.920547 31895 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:24.920874 31895 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:54:24.921087 31895 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:25.110880 31895 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.130:38359
I20260805 19:54:25.111095 32024 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.130:38359 every 8 connection(s)
I20260805 19:54:25.113844 31895 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260805 19:54:25.124557 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 31895
I20260805 19:54:25.125113 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260805 19:54:25.131601 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.131:0
--local_ip_for_outbound_sockets=127.27.203.131
--webserver_interface=127.27.203.131
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37173
--builtin_ntp_servers=127.27.203.148:38385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:54:25.144189 32025 heartbeater.cc:344] Connected to a master server at 127.27.203.190:37173
I20260805 19:54:25.144793 32025 heartbeater.cc:461] Registering TS with master...
I20260805 19:54:25.146334 32025 heartbeater.cc:507] Master 127.27.203.190:37173 requested a full tablet report, sending...
I20260805 19:54:25.149508 31695 ts_manager.cc:194] Registered new tserver with Master: a227648e641f4a5f89a8313e2f842831 (127.27.203.130:38359)
I20260805 19:54:25.151340 31695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.130:37687
W20260805 19:54:25.491753 32029 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:25.492393 32029 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:54:25.492887 32029 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:25.528205 32029 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:54:25.529142 32029 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.131
I20260805 19:54:25.570358 32029 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:38385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.27.203.131
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:54:25.571883 32029 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:54:25.573943 32029 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:54:25.590822 32036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:54:26.156086 32025 heartbeater.cc:499] Master 127.27.203.190:37173 was elected leader, sending a full tablet report...
W20260805 19:54:26.994206 32035 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee20 after lost signal to thread 32029
W20260805 19:54:25.592523 32037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:27.419553 32038 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1825 milliseconds
W20260805 19:54:27.418761 32029 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.825s user 0.630s sys 1.157s
W20260805 19:54:27.420075 32039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:27.420578 32029 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.828s user 0.630s sys 1.158s
I20260805 19:54:27.420934 32029 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:54:27.425776 32029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:54:27.430817 32029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:54:27.432236 32029 hybrid_clock.cc:648] HybridClock initialized: now 1785959667432206 us; error 46 us; skew 500 ppm
I20260805 19:54:27.433126 32029 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:54:27.440759 32029 webserver.cc:533] Webserver started at http://127.27.203.131:35245/ using document root <none> and password file <none>
I20260805 19:54:27.441855 32029 fs_manager.cc:362] Metadata directory not provided
I20260805 19:54:27.442111 32029 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:54:27.442584 32029 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:54:27.446993 32029 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "75f042ed9ae841d08aa578d339fd53c3"
format_stamp: "Formatted at 2026-08-05 19:54:27 on dist-test-slave-27sr"
I20260805 19:54:27.448326 32029 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "75f042ed9ae841d08aa578d339fd53c3"
format_stamp: "Formatted at 2026-08-05 19:54:27 on dist-test-slave-27sr"
I20260805 19:54:27.456497 32029 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.005s sys 0.002s
I20260805 19:54:27.462507 32047 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:27.463711 32029 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.001s
I20260805 19:54:27.464119 32029 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "75f042ed9ae841d08aa578d339fd53c3"
format_stamp: "Formatted at 2026-08-05 19:54:27 on dist-test-slave-27sr"
I20260805 19:54:27.464447 32029 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:54:27.523375 32029 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:54:27.525296 32029 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:54:27.525727 32029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:54:27.528555 32029 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:54:27.532840 32029 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:54:27.533033 32029 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:27.533231 32029 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:54:27.533368 32029 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:27.686980 32029 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.131:45033
I20260805 19:54:27.687204 32163 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.131:45033 every 8 connection(s)
I20260805 19:54:27.689683 32029 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260805 19:54:27.698773 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 32029
I20260805 19:54:27.699470 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260805 19:54:27.714237 32164 heartbeater.cc:344] Connected to a master server at 127.27.203.190:37173
I20260805 19:54:27.714751 32164 heartbeater.cc:461] Registering TS with master...
I20260805 19:54:27.716012 32164 heartbeater.cc:507] Master 127.27.203.190:37173 requested a full tablet report, sending...
I20260805 19:54:27.718693 31695 ts_manager.cc:194] Registered new tserver with Master: 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033)
I20260805 19:54:27.720520 31695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.131:40823
I20260805 19:54:27.723215 28462 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
W20260805 19:54:28.600270 32172 sasl_common.cc:323] Time spent creating new SASL kudu client: real 0.849s user 0.002s sys 0.000s
I20260805 19:54:28.609797 31695 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43740:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20260805 19:54:28.634613 31695 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 19:54:28.695236 31824 tablet_service.cc:1511] Processing CreateTablet for tablet 9bcd2b028ee64f30a42676317b3d19d9 (DEFAULT_TABLE table=TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:54:28.704530 32095 tablet_service.cc:1511] Processing CreateTablet for tablet 9bcd2b028ee64f30a42676317b3d19d9 (DEFAULT_TABLE table=TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:54:28.705168 31960 tablet_service.cc:1511] Processing CreateTablet for tablet 9bcd2b028ee64f30a42676317b3d19d9 (DEFAULT_TABLE table=TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:54:28.706545 31824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bcd2b028ee64f30a42676317b3d19d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:54:28.706969 32095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bcd2b028ee64f30a42676317b3d19d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:54:28.707358 31960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bcd2b028ee64f30a42676317b3d19d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:54:28.724195 32164 heartbeater.cc:499] Master 127.27.203.190:37173 was elected leader, sending a full tablet report...
I20260805 19:54:28.741230 32183 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Bootstrap starting.
I20260805 19:54:28.749153 32184 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Bootstrap starting.
I20260805 19:54:28.753014 32185 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Bootstrap starting.
I20260805 19:54:28.750375 32183 tablet_bootstrap.cc:654] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Neither blocks nor log segments found. Creating new log.
I20260805 19:54:28.756098 32183 log.cc:826] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Log is configured to *not* fsync() on all Append() calls
I20260805 19:54:28.757895 32184 tablet_bootstrap.cc:654] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Neither blocks nor log segments found. Creating new log.
I20260805 19:54:28.760881 32185 tablet_bootstrap.cc:654] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Neither blocks nor log segments found. Creating new log.
I20260805 19:54:28.760885 32184 log.cc:826] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Log is configured to *not* fsync() on all Append() calls
I20260805 19:54:28.763018 32183 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: No bootstrap required, opened a new log
I20260805 19:54:28.763048 32185 log.cc:826] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Log is configured to *not* fsync() on all Append() calls
I20260805 19:54:28.763784 32183 ts_tablet_manager.cc:1403] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Time spent bootstrapping tablet: real 0.023s user 0.013s sys 0.004s
I20260805 19:54:28.767259 32184 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: No bootstrap required, opened a new log
I20260805 19:54:28.767812 32184 ts_tablet_manager.cc:1403] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Time spent bootstrapping tablet: real 0.019s user 0.015s sys 0.000s
I20260805 19:54:28.768965 32185 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: No bootstrap required, opened a new log
I20260805 19:54:28.769480 32185 ts_tablet_manager.cc:1403] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Time spent bootstrapping tablet: real 0.017s user 0.015s sys 0.000s
I20260805 19:54:28.790246 32185 raft_consensus.cc:359] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:28.791066 32185 raft_consensus.cc:385] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:54:28.791414 32185 raft_consensus.cc:740] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e86245270340738be339c3b6b6c60b, State: Initialized, Role: FOLLOWER
I20260805 19:54:28.792505 32185 consensus_queue.cc:260] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:28.794127 32183 raft_consensus.cc:359] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:28.795305 32183 raft_consensus.cc:385] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:54:28.795668 32183 raft_consensus.cc:740] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75f042ed9ae841d08aa578d339fd53c3, State: Initialized, Role: FOLLOWER
I20260805 19:54:28.796813 32183 consensus_queue.cc:260] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:28.798709 32185 ts_tablet_manager.cc:1434] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Time spent starting tablet: real 0.029s user 0.020s sys 0.007s
I20260805 19:54:28.800343 32184 raft_consensus.cc:359] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:28.801385 32184 raft_consensus.cc:385] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:54:28.801744 32184 raft_consensus.cc:740] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a227648e641f4a5f89a8313e2f842831, State: Initialized, Role: FOLLOWER
I20260805 19:54:28.802402 32183 ts_tablet_manager.cc:1434] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Time spent starting tablet: real 0.038s user 0.028s sys 0.008s
I20260805 19:54:28.803036 32184 consensus_queue.cc:260] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:28.807140 32184 ts_tablet_manager.cc:1434] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Time spent starting tablet: real 0.039s user 0.031s sys 0.004s
I20260805 19:54:28.850620 32189 raft_consensus.cc:493] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 19:54:28.851416 32189 raft_consensus.cc:515] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:28.855223 32189 leader_election.cc:290] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033), a227648e641f4a5f89a8313e2f842831 (127.27.203.130:38359)
I20260805 19:54:28.868197 31980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd2b028ee64f30a42676317b3d19d9" candidate_uuid: "99e86245270340738be339c3b6b6c60b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a227648e641f4a5f89a8313e2f842831" is_pre_election: true
I20260805 19:54:28.868326 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd2b028ee64f30a42676317b3d19d9" candidate_uuid: "99e86245270340738be339c3b6b6c60b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75f042ed9ae841d08aa578d339fd53c3" is_pre_election: true
I20260805 19:54:28.869036 31980 raft_consensus.cc:2468] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e86245270340738be339c3b6b6c60b in term 0.
I20260805 19:54:28.869189 32118 raft_consensus.cc:2468] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e86245270340738be339c3b6b6c60b in term 0.
I20260805 19:54:28.870554 31774 leader_election.cc:304] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e86245270340738be339c3b6b6c60b, a227648e641f4a5f89a8313e2f842831; no voters:
I20260805 19:54:28.871472 32189 raft_consensus.cc:2804] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 19:54:28.871753 32189 raft_consensus.cc:493] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 19:54:28.872005 32189 raft_consensus.cc:3060] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 0 FOLLOWER]: Advancing to term 1
W20260805 19:54:28.873649 32026 tablet.cc:2406] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 19:54:28.876811 32189 raft_consensus.cc:515] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:28.878609 32189 leader_election.cc:290] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [CANDIDATE]: Term 1 election: Requested vote from peers 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033), a227648e641f4a5f89a8313e2f842831 (127.27.203.130:38359)
I20260805 19:54:28.879544 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd2b028ee64f30a42676317b3d19d9" candidate_uuid: "99e86245270340738be339c3b6b6c60b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75f042ed9ae841d08aa578d339fd53c3"
I20260805 19:54:28.879801 31980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd2b028ee64f30a42676317b3d19d9" candidate_uuid: "99e86245270340738be339c3b6b6c60b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a227648e641f4a5f89a8313e2f842831"
I20260805 19:54:28.880129 32118 raft_consensus.cc:3060] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:54:28.880343 31980 raft_consensus.cc:3060] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:54:28.884918 31980 raft_consensus.cc:2468] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e86245270340738be339c3b6b6c60b in term 1.
I20260805 19:54:28.885574 32118 raft_consensus.cc:2468] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e86245270340738be339c3b6b6c60b in term 1.
I20260805 19:54:28.886111 31774 leader_election.cc:304] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e86245270340738be339c3b6b6c60b, a227648e641f4a5f89a8313e2f842831; no voters:
I20260805 19:54:28.886986 32189 raft_consensus.cc:2804] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:54:28.888711 32189 raft_consensus.cc:697] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 1 LEADER]: Becoming Leader. State: Replica: 99e86245270340738be339c3b6b6c60b, State: Running, Role: LEADER
I20260805 19:54:28.889660 32189 consensus_queue.cc:237] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:28.904021 31695 catalog_manager.cc:5697] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b reported cstate change: term changed from 0 to 1, leader changed from <none> to 99e86245270340738be339c3b6b6c60b (127.27.203.129). New cstate: current_term: 1 leader_uuid: "99e86245270340738be339c3b6b6c60b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } health_report { overall_health: UNKNOWN } } }
W20260805 19:54:28.945691 32165 tablet.cc:2406] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 19:54:28.955367 28462 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260805 19:54:28.959326 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 99e86245270340738be339c3b6b6c60b to finish bootstrapping
W20260805 19:54:28.971606 31892 tablet.cc:2406] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 19:54:28.974581 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver a227648e641f4a5f89a8313e2f842831 to finish bootstrapping
I20260805 19:54:28.987552 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 75f042ed9ae841d08aa578d339fd53c3 to finish bootstrapping
I20260805 19:54:29.003274 31695 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43740:
table { table_name: "TestTable" } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "old_column_0" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } modify_external_catalogs: true
I20260805 19:54:29.022770 31980 raft_consensus.cc:1275] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 1 FOLLOWER]: Refusing update from remote peer 99e86245270340738be339c3b6b6c60b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 19:54:29.022980 32118 raft_consensus.cc:1275] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 1 FOLLOWER]: Refusing update from remote peer 99e86245270340738be339c3b6b6c60b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 19:54:29.024528 32189 consensus_queue.cc:1048] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260805 19:54:29.025650 32195 consensus_queue.cc:1048] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [LEADER]: Connected to new peer: Peer: permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260805 19:54:29.046285 31695 catalog_manager.cc:5789] TS a227648e641f4a5f89a8313e2f842831 (127.27.203.130:38359) does not have the latest schema for tablet 9bcd2b028ee64f30a42676317b3d19d9 (table TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660]). Expected version 1 got 0
I20260805 19:54:29.049162 31693 catalog_manager.cc:5789] TS 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033) does not have the latest schema for tablet 9bcd2b028ee64f30a42676317b3d19d9 (table TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660]). Expected version 1 got 0
I20260805 19:54:29.058790 32205 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 1
I20260805 19:54:29.060091 31693 catalog_manager.cc:5789] TS 99e86245270340738be339c3b6b6c60b (127.27.203.129:39091) does not have the latest schema for tablet 9bcd2b028ee64f30a42676317b3d19d9 (table TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660]). Expected version 1 got 0
I20260805 19:54:29.061118 32199 mvcc.cc:204] Tried to move back new op lower bound from 7315290804299771904 to 7315290803782533120. Current Snapshot: MvccSnapshot[applied={T|T < 7315290804299771904}]
I20260805 19:54:29.061851 32205 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: MemRowSet was empty: no flush needed.
I20260805 19:54:29.054787 32204 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 1
I20260805 19:54:29.063946 31694 catalog_manager.cc:5789] TS 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033) does not have the latest schema for tablet 9bcd2b028ee64f30a42676317b3d19d9 (table TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660]). Expected version 1 got 0
I20260805 19:54:29.065392 32204 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: MemRowSet was empty: no flush needed.
I20260805 19:54:29.076359 31693 catalog_manager.cc:5789] TS a227648e641f4a5f89a8313e2f842831 (127.27.203.130:38359) does not have the latest schema for tablet 9bcd2b028ee64f30a42676317b3d19d9 (table TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660]). Expected version 1 got 0
I20260805 19:54:29.068946 32206 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 1
I20260805 19:54:29.079589 32206 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: MemRowSet was empty: no flush needed.
I20260805 19:54:29.088347 31692 catalog_manager.cc:6242] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437: TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660] alter complete (version 1)
I20260805 19:54:29.100745 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 31756
I20260805 19:54:29.137076 31693 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43740:
table { table_name: "TestTable" } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "old_column_1" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } modify_external_catalogs: true
W20260805 19:54:29.148550 31679 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.203.129:39091: connect: Connection refused (error 111)
W20260805 19:54:29.152570 31679 catalog_manager.cc:4755] TS 99e86245270340738be339c3b6b6c60b (127.27.203.129:39091): AlterTable RPC failed for tablet 9bcd2b028ee64f30a42676317b3d19d9: Network error: Client connection negotiation failed: client connection to 127.27.203.129:39091: connect: Connection refused (error 111)
W20260805 19:54:30.390944 31679 catalog_manager.cc:4755] TS 99e86245270340738be339c3b6b6c60b (127.27.203.129:39091): AlterTable RPC failed for tablet 9bcd2b028ee64f30a42676317b3d19d9: Network error: Client connection negotiation failed: client connection to 127.27.203.129:39091: connect: Connection refused (error 111)
I20260805 19:54:30.553960 32210 raft_consensus.cc:493] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99e86245270340738be339c3b6b6c60b)
I20260805 19:54:30.554450 32210 raft_consensus.cc:515] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:30.557090 32210 leader_election.cc:290] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99e86245270340738be339c3b6b6c60b (127.27.203.129:39091), a227648e641f4a5f89a8313e2f842831 (127.27.203.130:38359)
I20260805 19:54:30.561719 32214 raft_consensus.cc:493] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99e86245270340738be339c3b6b6c60b)
W20260805 19:54:30.562134 32048 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.203.129:39091: connect: Connection refused (error 111)
I20260805 19:54:30.562309 32214 raft_consensus.cc:515] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
W20260805 19:54:30.567637 32048 leader_election.cc:336] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 99e86245270340738be339c3b6b6c60b (127.27.203.129:39091): Network error: Client connection negotiation failed: client connection to 127.27.203.129:39091: connect: Connection refused (error 111)
I20260805 19:54:30.568972 32214 leader_election.cc:290] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99e86245270340738be339c3b6b6c60b (127.27.203.129:39091), 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033)
W20260805 19:54:30.573525 31912 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.203.129:39091: connect: Connection refused (error 111)
I20260805 19:54:30.575009 31980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd2b028ee64f30a42676317b3d19d9" candidate_uuid: "75f042ed9ae841d08aa578d339fd53c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a227648e641f4a5f89a8313e2f842831" is_pre_election: true
I20260805 19:54:30.576046 31980 raft_consensus.cc:2468] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75f042ed9ae841d08aa578d339fd53c3 in term 1.
I20260805 19:54:30.577723 32049 leader_election.cc:304] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 75f042ed9ae841d08aa578d339fd53c3, a227648e641f4a5f89a8313e2f842831; no voters: 99e86245270340738be339c3b6b6c60b
I20260805 19:54:30.579170 32210 raft_consensus.cc:2804] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260805 19:54:30.579568 32210 raft_consensus.cc:493] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 99e86245270340738be339c3b6b6c60b)
I20260805 19:54:30.580013 32210 raft_consensus.cc:3060] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 1 FOLLOWER]: Advancing to term 2
W20260805 19:54:30.579873 31912 leader_election.cc:336] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 99e86245270340738be339c3b6b6c60b (127.27.203.129:39091): Network error: Client connection negotiation failed: client connection to 127.27.203.129:39091: connect: Connection refused (error 111)
I20260805 19:54:30.584733 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd2b028ee64f30a42676317b3d19d9" candidate_uuid: "a227648e641f4a5f89a8313e2f842831" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "75f042ed9ae841d08aa578d339fd53c3" is_pre_election: true
I20260805 19:54:30.585834 32210 raft_consensus.cc:515] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:30.586900 32118 raft_consensus.cc:2393] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a227648e641f4a5f89a8313e2f842831 in current term 2: Already voted for candidate 75f042ed9ae841d08aa578d339fd53c3 in this term.
I20260805 19:54:30.588035 32210 leader_election.cc:290] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [CANDIDATE]: Term 2 election: Requested vote from peers 99e86245270340738be339c3b6b6c60b (127.27.203.129:39091), a227648e641f4a5f89a8313e2f842831 (127.27.203.130:38359)
I20260805 19:54:30.589694 31980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd2b028ee64f30a42676317b3d19d9" candidate_uuid: "75f042ed9ae841d08aa578d339fd53c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a227648e641f4a5f89a8313e2f842831"
I20260805 19:54:30.590384 31980 raft_consensus.cc:3060] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 1 FOLLOWER]: Advancing to term 2
I20260805 19:54:30.591243 31915 leader_election.cc:304] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a227648e641f4a5f89a8313e2f842831; no voters: 75f042ed9ae841d08aa578d339fd53c3, 99e86245270340738be339c3b6b6c60b
W20260805 19:54:30.592571 32048 leader_election.cc:336] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 99e86245270340738be339c3b6b6c60b (127.27.203.129:39091): Network error: Client connection negotiation failed: client connection to 127.27.203.129:39091: connect: Connection refused (error 111)
I20260805 19:54:30.596202 31980 raft_consensus.cc:2468] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75f042ed9ae841d08aa578d339fd53c3 in term 2.
I20260805 19:54:30.596854 32214 raft_consensus.cc:2749] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 19:54:30.597523 32049 leader_election.cc:304] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 75f042ed9ae841d08aa578d339fd53c3, a227648e641f4a5f89a8313e2f842831; no voters: 99e86245270340738be339c3b6b6c60b
I20260805 19:54:30.598452 32210 raft_consensus.cc:2804] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 19:54:30.600518 32210 raft_consensus.cc:697] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 2 LEADER]: Becoming Leader. State: Replica: 75f042ed9ae841d08aa578d339fd53c3, State: Running, Role: LEADER
I20260805 19:54:30.601630 32210 consensus_queue.cc:237] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:30.609258 31693 catalog_manager.cc:5697] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 reported cstate change: term changed from 1 to 2, leader changed from 99e86245270340738be339c3b6b6c60b (127.27.203.129) to 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131). New cstate: current_term: 2 leader_uuid: "75f042ed9ae841d08aa578d339fd53c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } health_report { overall_health: UNKNOWN } } }
I20260805 19:54:30.610544 31693 catalog_manager.cc:5789] TS 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033) does not have the latest schema for tablet 9bcd2b028ee64f30a42676317b3d19d9 (table TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660]). Expected version 2 got 1
W20260805 19:54:30.990948 32048 consensus_peers.cc:597] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 -> Peer 99e86245270340738be339c3b6b6c60b (127.27.203.129:39091): Couldn't send request to peer 99e86245270340738be339c3b6b6c60b. Status: Network error: Client connection negotiation failed: client connection to 127.27.203.129:39091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260805 19:54:31.087814 31980 raft_consensus.cc:1275] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 2 FOLLOWER]: Refusing update from remote peer 75f042ed9ae841d08aa578d339fd53c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260805 19:54:31.089768 32210 consensus_queue.cc:1048] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260805 19:54:31.099324 31693 catalog_manager.cc:5789] TS a227648e641f4a5f89a8313e2f842831 (127.27.203.130:38359) does not have the latest schema for tablet 9bcd2b028ee64f30a42676317b3d19d9 (table TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660]). Expected version 2 got 1
I20260805 19:54:31.103503 31692 catalog_manager.cc:5789] TS 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033) does not have the latest schema for tablet 9bcd2b028ee64f30a42676317b3d19d9 (table TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660]). Expected version 2 got 1
I20260805 19:54:31.105703 31693 catalog_manager.cc:5789] TS a227648e641f4a5f89a8313e2f842831 (127.27.203.130:38359) does not have the latest schema for tablet 9bcd2b028ee64f30a42676317b3d19d9 (table TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660]). Expected version 2 got 1
I20260805 19:54:31.470558 32229 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
14:old_column_1 INT32 NULLABLE,
PRIMARY KEY (key)
) version 2
I20260805 19:54:31.471170 32230 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
14:old_column_1 INT32 NULLABLE,
PRIMARY KEY (key)
) version 2
I20260805 19:54:31.472672 32229 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: MemRowSet was empty: no flush needed.
I20260805 19:54:31.473059 32230 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: MemRowSet was empty: no flush needed.
I20260805 19:54:31.492038 31693 catalog_manager.cc:6242] T 00000000000000000000000000000000 P e4a807e639c248f48e3c8620aef5d437: TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660] alter complete (version 2)
I20260805 19:54:31.817498 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 31662
I20260805 19:54:31.850870 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.129:39091
--local_ip_for_outbound_sockets=127.27.203.129
--tserver_master_addrs=127.27.203.190:37173
--webserver_port=34701
--webserver_interface=127.27.203.129
--builtin_ntp_servers=127.27.203.148:38385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20260805 19:54:32.188516 32234 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:32.189116 32234 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:54:32.189736 32234 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:32.224674 32234 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:54:32.225688 32234 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.129
I20260805 19:54:32.267971 32234 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:38385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.129:39091
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.27.203.129
--webserver_port=34701
--tserver_master_addrs=127.27.203.190:37173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:54:32.269482 32234 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:54:32.271340 32234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:54:32.285635 32242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:32.498966 32164 heartbeater.cc:646] Failed to heartbeat to 127.27.203.190:37173 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.203.190:37173: connect: Connection refused (error 111)
W20260805 19:54:32.503635 32025 heartbeater.cc:646] Failed to heartbeat to 127.27.203.190:37173 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.203.190:37173: connect: Connection refused (error 111)
W20260805 19:54:33.386623 32048 consensus_peers.cc:597] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 -> Peer 99e86245270340738be339c3b6b6c60b (127.27.203.129:39091): Couldn't send request to peer 99e86245270340738be339c3b6b6c60b. Status: Network error: Client connection negotiation failed: client connection to 127.27.203.129:39091: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260805 19:54:32.286489 32243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:33.532581 32244 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
W20260805 19:54:33.534755 32245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:33.537881 32234 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.253s user 0.434s sys 0.812s
W20260805 19:54:33.538224 32234 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.253s user 0.434s sys 0.812s
I20260805 19:54:33.538503 32234 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:54:33.539830 32234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:54:33.542392 32234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:54:33.543865 32234 hybrid_clock.cc:648] HybridClock initialized: now 1785959673543831 us; error 42 us; skew 500 ppm
I20260805 19:54:33.544839 32234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:54:33.553310 32234 webserver.cc:533] Webserver started at http://127.27.203.129:34701/ using document root <none> and password file <none>
I20260805 19:54:33.554477 32234 fs_manager.cc:362] Metadata directory not provided
I20260805 19:54:33.554780 32234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:54:33.564322 32234 fs_manager.cc:714] Time spent opening directory manager: real 0.006s user 0.005s sys 0.001s
I20260805 19:54:33.570305 32258 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:33.571717 32234 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.003s sys 0.003s
I20260805 19:54:33.572115 32234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "99e86245270340738be339c3b6b6c60b"
format_stamp: "Formatted at 2026-08-05 19:54:22 on dist-test-slave-27sr"
I20260805 19:54:33.574333 32234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:54:33.655107 32234 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:54:33.656934 32234 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:54:33.657445 32234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:54:33.660616 32234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:54:33.667089 32266 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260805 19:54:33.676972 32234 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 19:54:33.677341 32234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.012s user 0.001s sys 0.001s
I20260805 19:54:33.677654 32234 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260805 19:54:33.683000 32234 ts_tablet_manager.cc:616] Registered 1 tablets
I20260805 19:54:33.683239 32234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.006s user 0.000s sys 0.003s
I20260805 19:54:33.684075 32266 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Bootstrap starting.
I20260805 19:54:33.761101 32266 log.cc:826] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Log is configured to *not* fsync() on all Append() calls
I20260805 19:54:33.775472 32266 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 1
I20260805 19:54:33.778374 32266 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: MemRowSet was empty: no flush needed.
I20260805 19:54:33.778925 32266 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260805 19:54:33.781489 32266 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 19:54:33.782928 32266 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Bootstrap complete.
I20260805 19:54:33.808269 32266 ts_tablet_manager.cc:1403] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Time spent bootstrapping tablet: real 0.125s user 0.080s sys 0.040s
I20260805 19:54:33.849835 32266 raft_consensus.cc:359] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:33.855751 32266 raft_consensus.cc:740] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e86245270340738be339c3b6b6c60b, State: Initialized, Role: FOLLOWER
I20260805 19:54:33.857304 32266 consensus_queue.cc:260] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:33.863195 32266 ts_tablet_manager.cc:1434] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Time spent starting tablet: real 0.054s user 0.047s sys 0.004s
I20260805 19:54:33.872898 32234 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.129:39091
I20260805 19:54:33.873010 32376 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.129:39091 every 8 connection(s)
I20260805 19:54:33.875749 32234 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260805 19:54:33.879194 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 32234
W20260805 19:54:33.886255 32377 heartbeater.cc:646] Failed to heartbeat to 127.27.203.190:37173 (0 consecutive failures): Network error: Failed to ping master at 127.27.203.190:37173: Client connection negotiation failed: client connection to 127.27.203.190:37173: connect: Connection refused (error 111)
W20260805 19:54:33.891505 32377 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 19:54:34.212206 32330 raft_consensus.cc:3060] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 1 FOLLOWER]: Advancing to term 2
I20260805 19:54:34.227814 32388 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
14:old_column_1 INT32 NULLABLE,
PRIMARY KEY (key)
) version 2
I20260805 19:54:34.230156 32388 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: MemRowSet was empty: no flush needed.
W20260805 19:54:34.231468 32380 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:34.232070 32380 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:35.619880 32380 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.306s user 0.471s sys 0.831s
W20260805 19:54:35.620366 32380 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.307s user 0.471s sys 0.836s
I20260805 19:54:35.658167 32380 master_rebuilder.cc:266] Preserving original table_id 'c3e2d40b775c4fd5b5e4a98d95774660' for table 'TestTable'
I20260805 19:54:35.696012 32380 minidump.cc:252] Setting minidump size limit to 20M
I20260805 19:54:35.699060 32380 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:54:35.700875 32380 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:54:35.716840 32410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:35.718439 32411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:35.819520 32414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:54:35.820021 32380 server_base.cc:1061] running on GCE node
I20260805 19:54:35.821024 32380 hybrid_clock.cc:584] initializing the hybrid clock with 'system' time source
I20260805 19:54:35.821688 32380 hybrid_clock.cc:648] HybridClock initialized: now 1785959675821634 us; error 9922 us; skew 500 ppm
I20260805 19:54:35.822453 32380 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:54:35.828152 32380 webserver.cc:533] Webserver started at http://0.0.0.0:37377/ using document root <none> and password file <none>
I20260805 19:54:35.829041 32380 fs_manager.cc:362] Metadata directory not provided
I20260805 19:54:35.829262 32380 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:54:35.829700 32380 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:54:35.834185 32380 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "708d337a3d5049178aeb63fbce9ac814"
format_stamp: "Formatted at 2026-08-05 19:54:35 on dist-test-slave-27sr"
I20260805 19:54:35.835343 32380 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "708d337a3d5049178aeb63fbce9ac814"
format_stamp: "Formatted at 2026-08-05 19:54:35 on dist-test-slave-27sr"
I20260805 19:54:35.843209 32380 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260805 19:54:35.849116 32420 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:35.850152 32380 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260805 19:54:35.850481 32380 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
uuid: "708d337a3d5049178aeb63fbce9ac814"
format_stamp: "Formatted at 2026-08-05 19:54:35 on dist-test-slave-27sr"
I20260805 19:54:35.850844 32380 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:54:36.047143 32380 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:54:36.048862 32380 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:54:36.049315 32380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:54:36.054580 32380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:54:36.073906 32380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814: Bootstrap starting.
I20260805 19:54:36.079445 32380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814: Neither blocks nor log segments found. Creating new log.
I20260805 19:54:36.081367 32380 log.cc:826] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814: Log is configured to *not* fsync() on all Append() calls
I20260805 19:54:36.085834 32380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814: No bootstrap required, opened a new log
I20260805 19:54:36.105062 32380 raft_consensus.cc:359] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708d337a3d5049178aeb63fbce9ac814" member_type: VOTER }
I20260805 19:54:36.105585 32380 raft_consensus.cc:385] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:54:36.105782 32380 raft_consensus.cc:740] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 708d337a3d5049178aeb63fbce9ac814, State: Initialized, Role: FOLLOWER
I20260805 19:54:36.106456 32380 consensus_queue.cc:260] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708d337a3d5049178aeb63fbce9ac814" member_type: VOTER }
I20260805 19:54:36.106925 32380 raft_consensus.cc:399] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:54:36.107147 32380 raft_consensus.cc:493] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:54:36.107425 32380 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:54:36.112645 32380 raft_consensus.cc:515] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708d337a3d5049178aeb63fbce9ac814" member_type: VOTER }
I20260805 19:54:36.113547 32380 leader_election.cc:304] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 708d337a3d5049178aeb63fbce9ac814; no voters:
I20260805 19:54:36.115610 32380 leader_election.cc:290] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:54:36.115959 32428 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:54:36.120368 32428 raft_consensus.cc:697] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 1 LEADER]: Becoming Leader. State: Replica: 708d337a3d5049178aeb63fbce9ac814, State: Running, Role: LEADER
I20260805 19:54:36.121374 32428 consensus_queue.cc:237] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708d337a3d5049178aeb63fbce9ac814" member_type: VOTER }
I20260805 19:54:36.129945 32429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "708d337a3d5049178aeb63fbce9ac814" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708d337a3d5049178aeb63fbce9ac814" member_type: VOTER } }
I20260805 19:54:36.131091 32429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [sys.catalog]: This master's current role is: LEADER
I20260805 19:54:36.132043 32430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 708d337a3d5049178aeb63fbce9ac814. Latest consensus state: current_term: 1 leader_uuid: "708d337a3d5049178aeb63fbce9ac814" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708d337a3d5049178aeb63fbce9ac814" member_type: VOTER } }
I20260805 19:54:36.132519 32430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [sys.catalog]: This master's current role is: LEADER
I20260805 19:54:36.146199 32380 tablet_replica.cc:333] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814: stopping tablet replica
I20260805 19:54:36.146867 32380 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 1 LEADER]: Raft consensus shutting down.
I20260805 19:54:36.147326 32380 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 19:54:36.149704 32380 master.cc:562] Master@0.0.0.0:7051 shutting down...
W20260805 19:54:36.150172 32380 acceptor_pool.cc:196] Could not shut down acceptor socket on 0.0.0.0:7051: Network error: shutdown error: Transport endpoint is not connected (error 107)
I20260805 19:54:36.184070 32380 master.cc:584] Master@0.0.0.0:7051 shutdown complete.
I20260805 19:54:37.219455 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 32234
I20260805 19:54:37.252610 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 31895
I20260805 19:54:37.283290 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 32029
I20260805 19:54:37.316960 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:37173
--webserver_interface=127.27.203.190
--webserver_port=39877
--builtin_ntp_servers=127.27.203.148:38385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.203.190:37173 with env {}
W20260805 19:54:37.650862 32437 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:37.651523 32437 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:54:37.652189 32437 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:37.686497 32437 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 19:54:37.686872 32437 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:54:37.687211 32437 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 19:54:37.687495 32437 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260805 19:54:37.726285 32437 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:38385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.203.190:37173
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:37173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.27.203.190
--webserver_port=39877
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:54:37.727800 32437 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:54:37.729605 32437 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:54:37.742496 32443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:37.743011 32444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:39.030714 32445 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1285 milliseconds
W20260805 19:54:39.032647 32446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:39.036051 32437 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.294s user 0.005s sys 0.004s
W20260805 19:54:39.036475 32437 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.294s user 0.005s sys 0.004s
I20260805 19:54:39.036808 32437 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:54:39.038749 32437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:54:39.042309 32437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:54:39.043883 32437 hybrid_clock.cc:648] HybridClock initialized: now 1785959679043824 us; error 49 us; skew 500 ppm
I20260805 19:54:39.045229 32437 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:54:39.055768 32437 webserver.cc:533] Webserver started at http://127.27.203.190:39877/ using document root <none> and password file <none>
I20260805 19:54:39.057431 32437 fs_manager.cc:362] Metadata directory not provided
I20260805 19:54:39.057807 32437 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:54:39.070384 32437 fs_manager.cc:714] Time spent opening directory manager: real 0.008s user 0.004s sys 0.004s
I20260805 19:54:39.077411 32453 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:39.079118 32437 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.000s sys 0.004s
I20260805 19:54:39.079687 32437 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
uuid: "708d337a3d5049178aeb63fbce9ac814"
format_stamp: "Formatted at 2026-08-05 19:54:35 on dist-test-slave-27sr"
I20260805 19:54:39.083009 32437 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:54:39.186136 32437 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:54:39.188059 32437 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:54:39.188601 32437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:54:39.270159 32437 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.190:37173
I20260805 19:54:39.270269 32505 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.190:37173 every 8 connection(s)
I20260805 19:54:39.273514 32437 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260805 19:54:39.275228 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 32437
I20260805 19:54:39.278149 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.129:39091
--local_ip_for_outbound_sockets=127.27.203.129
--tserver_master_addrs=127.27.203.190:37173
--webserver_port=34701
--webserver_interface=127.27.203.129
--builtin_ntp_servers=127.27.203.148:38385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:54:39.286526 32506 sys_catalog.cc:263] Verifying existing consensus state
I20260805 19:54:39.299608 32506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814: Bootstrap starting.
I20260805 19:54:39.310781 32506 log.cc:826] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814: Log is configured to *not* fsync() on all Append() calls
I20260805 19:54:39.324193 32506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 19:54:39.325088 32506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814: Bootstrap complete.
I20260805 19:54:39.348035 32506 raft_consensus.cc:359] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708d337a3d5049178aeb63fbce9ac814" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37173 } }
I20260805 19:54:39.348821 32506 raft_consensus.cc:740] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 708d337a3d5049178aeb63fbce9ac814, State: Initialized, Role: FOLLOWER
I20260805 19:54:39.349809 32506 consensus_queue.cc:260] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708d337a3d5049178aeb63fbce9ac814" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37173 } }
I20260805 19:54:39.350383 32506 raft_consensus.cc:399] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:54:39.350693 32506 raft_consensus.cc:493] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:54:39.351024 32506 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 1 FOLLOWER]: Advancing to term 2
I20260805 19:54:39.355693 32506 raft_consensus.cc:515] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708d337a3d5049178aeb63fbce9ac814" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37173 } }
I20260805 19:54:39.356585 32506 leader_election.cc:304] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 708d337a3d5049178aeb63fbce9ac814; no voters:
I20260805 19:54:39.358999 32506 leader_election.cc:290] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 19:54:39.359320 32510 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 19:54:39.363303 32510 raft_consensus.cc:697] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [term 2 LEADER]: Becoming Leader. State: Replica: 708d337a3d5049178aeb63fbce9ac814, State: Running, Role: LEADER
I20260805 19:54:39.364318 32510 consensus_queue.cc:237] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708d337a3d5049178aeb63fbce9ac814" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37173 } }
I20260805 19:54:39.365101 32506 sys_catalog.cc:565] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 19:54:39.372721 32512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 708d337a3d5049178aeb63fbce9ac814. Latest consensus state: current_term: 2 leader_uuid: "708d337a3d5049178aeb63fbce9ac814" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708d337a3d5049178aeb63fbce9ac814" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37173 } } }
I20260805 19:54:39.373497 32512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [sys.catalog]: This master's current role is: LEADER
I20260805 19:54:39.374985 32511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "708d337a3d5049178aeb63fbce9ac814" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708d337a3d5049178aeb63fbce9ac814" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37173 } } }
I20260805 19:54:39.375785 32511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814 [sys.catalog]: This master's current role is: LEADER
I20260805 19:54:39.389221 32517 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260805 19:54:39.402324 32517 catalog_manager.cc:679] Loaded metadata for table TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660]
I20260805 19:54:39.410126 32517 tablet_loader.cc:96] loaded metadata for tablet 9bcd2b028ee64f30a42676317b3d19d9 (table TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660])
I20260805 19:54:39.412261 32517 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260805 19:54:39.437466 32517 catalog_manager.cc:1383] Generated new cluster ID: a36df2ab15b44b248b2245c2c75a2287
I20260805 19:54:39.437826 32517 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260805 19:54:39.457367 32529 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 19:54:39.489923 32517 catalog_manager.cc:1406] Generated new certificate authority record
I20260805 19:54:39.492568 32517 catalog_manager.cc:1540] Loading token signing keys...
I20260805 19:54:39.516649 32517 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814: Generated new TSK 0
I20260805 19:54:39.517974 32517 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260805 19:54:39.685210 32508 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:39.685864 32508 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:54:39.686506 32508 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:39.724736 32508 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:54:39.725780 32508 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.129
I20260805 19:54:39.765880 32508 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:38385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.129:39091
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.27.203.129
--webserver_port=34701
--tserver_master_addrs=127.27.203.190:37173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:54:39.767393 32508 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:54:39.769569 32508 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:54:39.784278 32535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:39.789922 32536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:39.792819 32539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:41.014151 32538 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260805 19:54:41.014776 32508 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:54:41.018414 32508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:54:41.021369 32508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:54:41.022924 32508 hybrid_clock.cc:648] HybridClock initialized: now 1785959681022882 us; error 58 us; skew 500 ppm
I20260805 19:54:41.024045 32508 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:54:41.031755 32508 webserver.cc:533] Webserver started at http://127.27.203.129:34701/ using document root <none> and password file <none>
I20260805 19:54:41.032835 32508 fs_manager.cc:362] Metadata directory not provided
I20260805 19:54:41.033090 32508 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:54:41.042660 32508 fs_manager.cc:714] Time spent opening directory manager: real 0.006s user 0.001s sys 0.004s
I20260805 19:54:41.048389 32546 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:41.049943 32508 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.002s sys 0.002s
I20260805 19:54:41.050364 32508 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "99e86245270340738be339c3b6b6c60b"
format_stamp: "Formatted at 2026-08-05 19:54:22 on dist-test-slave-27sr"
I20260805 19:54:41.053308 32508 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:54:41.120847 32508 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:54:41.123015 32508 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:54:41.123616 32508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:54:41.127288 32508 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:54:41.135419 32553 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260805 19:54:41.145117 32508 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 19:54:41.145480 32508 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.012s user 0.000s sys 0.002s
I20260805 19:54:41.145813 32508 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260805 19:54:41.153658 32508 ts_tablet_manager.cc:616] Registered 1 tablets
I20260805 19:54:41.153957 32508 ts_tablet_manager.cc:595] Time spent register tablets: real 0.008s user 0.007s sys 0.000s
I20260805 19:54:41.154501 32553 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Bootstrap starting.
I20260805 19:54:41.221294 32553 log.cc:826] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Log is configured to *not* fsync() on all Append() calls
I20260805 19:54:41.234688 32553 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 1
I20260805 19:54:41.237123 32553 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: MemRowSet was empty: no flush needed.
I20260805 19:54:41.237524 32553 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260805 19:54:41.243288 32553 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
14:old_column_1 INT32 NULLABLE,
PRIMARY KEY (key)
) version 2
I20260805 19:54:41.245628 32553 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: MemRowSet was empty: no flush needed.
I20260805 19:54:41.245997 32553 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260805 19:54:41.248150 32553 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 19:54:41.249413 32553 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Bootstrap complete.
I20260805 19:54:41.276446 32553 ts_tablet_manager.cc:1403] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Time spent bootstrapping tablet: real 0.123s user 0.084s sys 0.032s
I20260805 19:54:41.315630 32553 raft_consensus.cc:359] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:41.319262 32553 raft_consensus.cc:740] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e86245270340738be339c3b6b6c60b, State: Initialized, Role: FOLLOWER
I20260805 19:54:41.320990 32553 consensus_queue.cc:260] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:41.327709 32553 ts_tablet_manager.cc:1434] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Time spent starting tablet: real 0.051s user 0.039s sys 0.004s
I20260805 19:54:41.404363 32508 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.129:39091
I20260805 19:54:41.404520 32664 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.129:39091 every 8 connection(s)
I20260805 19:54:41.407037 32508 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260805 19:54:41.415424 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 32508
I20260805 19:54:41.417358 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.130:38359
--local_ip_for_outbound_sockets=127.27.203.130
--tserver_master_addrs=127.27.203.190:37173
--webserver_port=37193
--webserver_interface=127.27.203.130
--builtin_ntp_servers=127.27.203.148:38385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:54:41.446125 32665 heartbeater.cc:344] Connected to a master server at 127.27.203.190:37173
I20260805 19:54:41.446600 32665 heartbeater.cc:461] Registering TS with master...
I20260805 19:54:41.447844 32665 heartbeater.cc:507] Master 127.27.203.190:37173 requested a full tablet report, sending...
I20260805 19:54:41.452535 32471 ts_manager.cc:194] Registered new tserver with Master: 99e86245270340738be339c3b6b6c60b (127.27.203.129:39091)
I20260805 19:54:41.457922 32471 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.129:41211
W20260805 19:54:41.763064 32669 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:41.763669 32669 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:54:41.764276 32669 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:41.799471 32669 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:54:41.800582 32669 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.130
I20260805 19:54:41.841077 32669 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:38385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.130:38359
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.27.203.130
--webserver_port=37193
--tserver_master_addrs=127.27.203.190:37173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:54:41.842543 32669 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:54:41.844417 32669 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:54:41.858327 32675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:54:42.462350 32665 heartbeater.cc:499] Master 127.27.203.190:37173 was elected leader, sending a full tablet report...
I20260805 19:54:42.522617 32681 raft_consensus.cc:493] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 19:54:42.523612 32681 raft_consensus.cc:515] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:42.535055 32681 leader_election.cc:290] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033), a227648e641f4a5f89a8313e2f842831 (127.27.203.130:38359)
W20260805 19:54:42.543655 32550 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.203.131:45033: connect: Connection refused (error 111)
W20260805 19:54:42.550472 32548 leader_election.cc:336] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a227648e641f4a5f89a8313e2f842831 (127.27.203.130:38359): Network error: Client connection negotiation failed: client connection to 127.27.203.130:38359: connect: Connection refused (error 111)
W20260805 19:54:42.551457 32550 leader_election.cc:336] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033): Network error: Client connection negotiation failed: client connection to 127.27.203.131:45033: connect: Connection refused (error 111)
I20260805 19:54:42.552150 32550 leader_election.cc:304] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99e86245270340738be339c3b6b6c60b; no voters: 75f042ed9ae841d08aa578d339fd53c3, a227648e641f4a5f89a8313e2f842831
I20260805 19:54:42.553400 32681 raft_consensus.cc:2749] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260805 19:54:41.859326 32676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:43.146277 32678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:43.149155 32677 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1284 milliseconds
I20260805 19:54:43.149255 32669 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:54:43.150624 32669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:54:43.153079 32669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:54:43.154462 32669 hybrid_clock.cc:648] HybridClock initialized: now 1785959683154405 us; error 79 us; skew 500 ppm
I20260805 19:54:43.155326 32669 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:54:43.162632 32669 webserver.cc:533] Webserver started at http://127.27.203.130:37193/ using document root <none> and password file <none>
I20260805 19:54:43.163750 32669 fs_manager.cc:362] Metadata directory not provided
I20260805 19:54:43.164063 32669 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:54:43.172962 32669 fs_manager.cc:714] Time spent opening directory manager: real 0.006s user 0.004s sys 0.004s
I20260805 19:54:43.178201 32689 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:43.179539 32669 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260805 19:54:43.179949 32669 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "a227648e641f4a5f89a8313e2f842831"
format_stamp: "Formatted at 2026-08-05 19:54:24 on dist-test-slave-27sr"
I20260805 19:54:43.181929 32669 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:54:43.250963 32669 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:54:43.252756 32669 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:54:43.253276 32669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:54:43.256160 32669 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:54:43.262545 32696 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260805 19:54:43.272807 32669 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 19:54:43.273157 32669 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.012s user 0.002s sys 0.001s
I20260805 19:54:43.273496 32669 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260805 19:54:43.281418 32669 ts_tablet_manager.cc:616] Registered 1 tablets
I20260805 19:54:43.281723 32669 ts_tablet_manager.cc:595] Time spent register tablets: real 0.008s user 0.007s sys 0.000s
I20260805 19:54:43.282333 32696 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Bootstrap starting.
I20260805 19:54:43.340659 32696 log.cc:826] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Log is configured to *not* fsync() on all Append() calls
I20260805 19:54:43.355405 32696 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 1
I20260805 19:54:43.358383 32696 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: MemRowSet was empty: no flush needed.
I20260805 19:54:43.359052 32696 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260805 19:54:43.366345 32696 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
14:old_column_1 INT32 NULLABLE,
PRIMARY KEY (key)
) version 2
I20260805 19:54:43.369169 32696 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: MemRowSet was empty: no flush needed.
I20260805 19:54:43.369587 32696 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260805 19:54:43.371729 32696 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 19:54:43.373136 32696 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Bootstrap complete.
I20260805 19:54:43.391204 32696 ts_tablet_manager.cc:1403] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Time spent bootstrapping tablet: real 0.109s user 0.068s sys 0.034s
I20260805 19:54:43.423501 32696 raft_consensus.cc:359] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:43.426956 32696 raft_consensus.cc:740] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a227648e641f4a5f89a8313e2f842831, State: Initialized, Role: FOLLOWER
I20260805 19:54:43.428079 32696 consensus_queue.cc:260] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:43.433064 32696 ts_tablet_manager.cc:1434] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Time spent starting tablet: real 0.041s user 0.038s sys 0.004s
I20260805 19:54:43.477207 32669 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.130:38359
I20260805 19:54:43.477299 341 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.130:38359 every 8 connection(s)
I20260805 19:54:43.479830 32669 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260805 19:54:43.481401 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 32669
I20260805 19:54:43.483758 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.131:45033
--local_ip_for_outbound_sockets=127.27.203.131
--tserver_master_addrs=127.27.203.190:37173
--webserver_port=35245
--webserver_interface=127.27.203.131
--builtin_ntp_servers=127.27.203.148:38385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:54:43.504076 342 heartbeater.cc:344] Connected to a master server at 127.27.203.190:37173
I20260805 19:54:43.504536 342 heartbeater.cc:461] Registering TS with master...
I20260805 19:54:43.505575 342 heartbeater.cc:507] Master 127.27.203.190:37173 requested a full tablet report, sending...
I20260805 19:54:43.509091 32471 ts_manager.cc:194] Registered new tserver with Master: a227648e641f4a5f89a8313e2f842831 (127.27.203.130:38359)
I20260805 19:54:43.511257 32471 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.130:45767
W20260805 19:54:43.818068 346 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:43.818629 346 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:54:43.819181 346 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:43.857164 346 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:54:43.858136 346 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.131
I20260805 19:54:43.899300 346 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:38385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.131:45033
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.27.203.131
--webserver_port=35245
--tserver_master_addrs=127.27.203.190:37173
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:54:43.900832 346 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:54:43.902717 346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:54:43.915722 352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:54:44.383549 358 raft_consensus.cc:493] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 19:54:44.384311 358 raft_consensus.cc:515] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:44.387184 358 leader_election.cc:290] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033), a227648e641f4a5f89a8313e2f842831 (127.27.203.130:38359)
I20260805 19:54:44.420193 32762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd2b028ee64f30a42676317b3d19d9" candidate_uuid: "99e86245270340738be339c3b6b6c60b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a227648e641f4a5f89a8313e2f842831" is_pre_election: true
I20260805 19:54:44.421460 32762 raft_consensus.cc:2468] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99e86245270340738be339c3b6b6c60b in term 2.
I20260805 19:54:44.424331 32548 leader_election.cc:304] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99e86245270340738be339c3b6b6c60b, a227648e641f4a5f89a8313e2f842831; no voters:
I20260805 19:54:44.425902 358 raft_consensus.cc:2804] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260805 19:54:44.426411 358 raft_consensus.cc:493] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 19:54:44.426877 358 raft_consensus.cc:3060] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 2 FOLLOWER]: Advancing to term 3
W20260805 19:54:44.427796 32550 leader_election.cc:336] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033): Network error: Client connection negotiation failed: client connection to 127.27.203.131:45033: connect: Connection refused (error 111)
I20260805 19:54:44.438812 358 raft_consensus.cc:515] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:44.444293 32762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd2b028ee64f30a42676317b3d19d9" candidate_uuid: "99e86245270340738be339c3b6b6c60b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a227648e641f4a5f89a8313e2f842831"
I20260805 19:54:44.445413 32762 raft_consensus.cc:3060] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 2 FOLLOWER]: Advancing to term 3
W20260805 19:54:44.449437 32550 leader_election.cc:336] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033): Network error: Client connection negotiation failed: client connection to 127.27.203.131:45033: connect: Connection refused (error 111)
I20260805 19:54:44.452077 358 leader_election.cc:290] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [CANDIDATE]: Term 3 election: Requested vote from peers 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033), a227648e641f4a5f89a8313e2f842831 (127.27.203.130:38359)
I20260805 19:54:44.460706 32762 raft_consensus.cc:2468] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99e86245270340738be339c3b6b6c60b in term 3.
I20260805 19:54:44.462898 32548 leader_election.cc:304] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99e86245270340738be339c3b6b6c60b, a227648e641f4a5f89a8313e2f842831; no voters: 75f042ed9ae841d08aa578d339fd53c3
I20260805 19:54:44.464424 358 raft_consensus.cc:2804] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 3 FOLLOWER]: Leader election won for term 3
I20260805 19:54:44.467376 358 raft_consensus.cc:697] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [term 3 LEADER]: Becoming Leader. State: Replica: 99e86245270340738be339c3b6b6c60b, State: Running, Role: LEADER
I20260805 19:54:44.470121 358 consensus_queue.cc:237] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:44.498610 32471 catalog_manager.cc:5697] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b reported cstate change: term changed from 0 to 3, leader changed from <none> to 99e86245270340738be339c3b6b6c60b (127.27.203.129), VOTER 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131) added, VOTER 99e86245270340738be339c3b6b6c60b (127.27.203.129) added, VOTER a227648e641f4a5f89a8313e2f842831 (127.27.203.130) added. New cstate: current_term: 3 leader_uuid: "99e86245270340738be339c3b6b6c60b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } health_report { overall_health: UNKNOWN } } }
I20260805 19:54:44.515010 342 heartbeater.cc:499] Master 127.27.203.190:37173 was elected leader, sending a full tablet report...
W20260805 19:54:44.980708 32550 consensus_peers.cc:597] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b -> Peer 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033): Couldn't send request to peer 75f042ed9ae841d08aa578d339fd53c3. Status: Network error: Client connection negotiation failed: client connection to 127.27.203.131:45033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260805 19:54:45.053741 32762 raft_consensus.cc:1275] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831 [term 3 FOLLOWER]: Refusing update from remote peer 99e86245270340738be339c3b6b6c60b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260805 19:54:45.056501 358 consensus_queue.cc:1048] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260805 19:54:43.918329 353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:43.922793 355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:54:45.218732 354 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1296 milliseconds
I20260805 19:54:45.218808 346 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:54:45.220346 346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:54:45.222712 346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:54:45.224107 346 hybrid_clock.cc:648] HybridClock initialized: now 1785959685224067 us; error 41 us; skew 500 ppm
I20260805 19:54:45.224965 346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:54:45.231405 346 webserver.cc:533] Webserver started at http://127.27.203.131:35245/ using document root <none> and password file <none>
I20260805 19:54:45.232491 346 fs_manager.cc:362] Metadata directory not provided
I20260805 19:54:45.232767 346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:54:45.241628 346 fs_manager.cc:714] Time spent opening directory manager: real 0.006s user 0.007s sys 0.001s
I20260805 19:54:45.247056 381 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:54:45.248446 346 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 19:54:45.248847 346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "75f042ed9ae841d08aa578d339fd53c3"
format_stamp: "Formatted at 2026-08-05 19:54:27 on dist-test-slave-27sr"
I20260805 19:54:45.250906 346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:54:45.327834 346 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:54:45.329550 346 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:54:45.330073 346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:54:45.333014 346 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:54:45.339390 388 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260805 19:54:45.349588 346 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 19:54:45.350042 346 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.012s user 0.002s sys 0.001s
I20260805 19:54:45.350488 346 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260805 19:54:45.357326 346 ts_tablet_manager.cc:616] Registered 1 tablets
I20260805 19:54:45.357602 346 ts_tablet_manager.cc:595] Time spent register tablets: real 0.007s user 0.000s sys 0.006s
I20260805 19:54:45.358144 388 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Bootstrap starting.
I20260805 19:54:45.420135 388 log.cc:826] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Log is configured to *not* fsync() on all Append() calls
I20260805 19:54:45.433861 388 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 1
I20260805 19:54:45.436435 388 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: MemRowSet was empty: no flush needed.
I20260805 19:54:45.436877 388 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260805 19:54:45.442763 388 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
14:old_column_1 INT32 NULLABLE,
PRIMARY KEY (key)
) version 2
I20260805 19:54:45.444316 388 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: MemRowSet was empty: no flush needed.
I20260805 19:54:45.444592 388 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260805 19:54:45.446206 388 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 19:54:45.447474 388 tablet_bootstrap.cc:492] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Bootstrap complete.
I20260805 19:54:45.467094 388 ts_tablet_manager.cc:1403] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Time spent bootstrapping tablet: real 0.109s user 0.077s sys 0.025s
I20260805 19:54:45.506096 388 raft_consensus.cc:359] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:45.510263 388 raft_consensus.cc:740] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75f042ed9ae841d08aa578d339fd53c3, State: Initialized, Role: FOLLOWER
I20260805 19:54:45.511981 388 consensus_queue.cc:260] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99e86245270340738be339c3b6b6c60b" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 39091 } } peers { permanent_uuid: "75f042ed9ae841d08aa578d339fd53c3" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 45033 } } peers { permanent_uuid: "a227648e641f4a5f89a8313e2f842831" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 38359 } }
I20260805 19:54:45.521502 388 ts_tablet_manager.cc:1434] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Time spent starting tablet: real 0.054s user 0.034s sys 0.015s
I20260805 19:54:45.567060 346 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.131:45033
I20260805 19:54:45.567222 500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.131:45033 every 8 connection(s)
I20260805 19:54:45.569815 346 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260805 19:54:45.574019 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 346
I20260805 19:54:45.591725 501 heartbeater.cc:344] Connected to a master server at 127.27.203.190:37173
I20260805 19:54:45.592247 501 heartbeater.cc:461] Registering TS with master...
I20260805 19:54:45.593472 501 heartbeater.cc:507] Master 127.27.203.190:37173 requested a full tablet report, sending...
I20260805 19:54:45.597033 32470 ts_manager.cc:194] Registered new tserver with Master: 75f042ed9ae841d08aa578d339fd53c3 (127.27.203.131:45033)
I20260805 19:54:45.599445 32470 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.131:50657
I20260805 19:54:45.610399 28462 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260805 19:54:45.615790 28462 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260805 19:54:45.620741 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 99e86245270340738be339c3b6b6c60b to finish bootstrapping
I20260805 19:54:45.637219 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver a227648e641f4a5f89a8313e2f842831 to finish bootstrapping
I20260805 19:54:45.652524 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 75f042ed9ae841d08aa578d339fd53c3 to finish bootstrapping
I20260805 19:54:45.827780 454 raft_consensus.cc:3060] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3 [term 2 FOLLOWER]: Advancing to term 3
I20260805 19:54:45.836724 501 heartbeater.cc:499] Master 127.27.203.190:37173 was elected leader, sending a full tablet report...
W20260805 19:54:46.014642 510 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:46.015269 510 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:47.378396 510 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.285s user 0.004s sys 0.000s
W20260805 19:54:47.378823 510 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.286s user 0.004s sys 0.000s
I20260805 19:54:47.748978 434 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260805 19:54:47.754251 32741 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260805 19:54:47.754392 32599 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
708d337a3d5049178aeb63fbce9ac814 | 127.27.203.190:37173 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.27.203.148:38385 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
75f042ed9ae841d08aa578d339fd53c3 | 127.27.203.131:45033 | HEALTHY | <none> | 0 | 0
99e86245270340738be339c3b6b6c60b | 127.27.203.129:39091 | HEALTHY | <none> | 1 | 0
a227648e641f4a5f89a8313e2f842831 | 127.27.203.130:38359 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.27.203.129 | experimental | 127.27.203.129:39091
local_ip_for_outbound_sockets | 127.27.203.130 | experimental | 127.27.203.130:38359
local_ip_for_outbound_sockets | 127.27.203.131 | experimental | 127.27.203.131:45033
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.27.203.129:39091
server_dump_info_path | /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.27.203.130:38359
server_dump_info_path | /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.AdminCliTest.TestAddColumnsAndRebuildMaster.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.27.203.131:45033
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.27.203.148:38385 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260805 19:54:49.033217 32471 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59574:
table { table_name: "TestTable" } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "new_column_0" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } modify_external_catalogs: true
I20260805 19:54:49.085911 572 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
14:old_column_1 INT32 NULLABLE,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
14:old_column_1 INT32 NULLABLE,
15:new_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 3
I20260805 19:54:49.087636 573 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
14:old_column_1 INT32 NULLABLE,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
14:old_column_1 INT32 NULLABLE,
15:new_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 3
I20260805 19:54:49.088896 572 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P 99e86245270340738be339c3b6b6c60b: MemRowSet was empty: no flush needed.
I20260805 19:54:49.090464 573 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P a227648e641f4a5f89a8313e2f842831: MemRowSet was empty: no flush needed.
I20260805 19:54:49.090373 574 tablet.cc:1724] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
14:old_column_1 INT32 NULLABLE,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:old_column_0 INT32 NULLABLE,
14:old_column_1 INT32 NULLABLE,
15:new_column_0 INT32 NULLABLE,
PRIMARY KEY (key)
) version 3
I20260805 19:54:49.093313 574 tablet.cc:1622] T 9bcd2b028ee64f30a42676317b3d19d9 P 75f042ed9ae841d08aa578d339fd53c3: MemRowSet was empty: no flush needed.
I20260805 19:54:49.113878 32471 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 708d337a3d5049178aeb63fbce9ac814: TestTable [id=c3e2d40b775c4fd5b5e4a98d95774660] alter complete (version 3)
W20260805 19:54:49.445941 575 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:49.446566 575 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:49.664075 497 debug-util.cc:398] Leaking SignalData structure 0x7b08000c22e0 after lost signal to thread 347
W20260805 19:54:49.665827 497 debug-util.cc:398] Leaking SignalData structure 0x7b08000cbf20 after lost signal to thread 500
W20260805 19:54:50.941442 580 debug-util.cc:398] Leaking SignalData structure 0x7b08000376a0 after lost signal to thread 575
W20260805 19:54:50.942049 580 kernel_stack_watchdog.cc:198] Thread 575 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 405ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260805 19:54:51.156373 575 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.624s user 0.588s sys 1.018s
W20260805 19:54:51.280076 575 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.747s user 0.594s sys 1.028s
W20260805 19:54:52.143705 580 debug-util.cc:398] Leaking SignalData structure 0x7b0800029040 after lost signal to thread 575
W20260805 19:54:52.735652 591 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:52.736248 591 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:54.095592 591 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.282s user 0.494s sys 0.784s
W20260805 19:54:54.095986 591 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.282s user 0.498s sys 0.784s
W20260805 19:54:55.524658 606 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:55.525348 606 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:56.894656 606 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.291s user 0.486s sys 0.798s
W20260805 19:54:56.895080 606 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.291s user 0.486s sys 0.798s
W20260805 19:54:58.315668 624 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:54:58.316445 624 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:54:59.691684 624 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.292s user 0.486s sys 0.801s
W20260805 19:54:59.692066 624 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.293s user 0.490s sys 0.801s
W20260805 19:55:00.589825 638 sasl_common.cc:323] Time spent creating new SASL kudu client: real 0.871s user 0.000s sys 0.004s
I20260805 19:55:01.680943 28462 test_workload.cc:405] TestWorkload: Skipping table creation because table TestTable already exists
I20260805 19:55:03.293128 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 32508
I20260805 19:55:03.338212 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 32669
I20260805 19:55:03.376535 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 346
I20260805 19:55:03.415709 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 32437
2026-08-05T19:55:03Z chronyd exiting
[ OK ] AdminCliTest.TestAddColumnsAndRebuildMaster (46227 ms)
[----------] 6 tests from AdminCliTest (147706 ms total)
[----------] 1 test from TestLeaderStepDown
[ RUN ] TestLeaderStepDown.TestLeaderStepDownWhenNotPresent/0
I20260805 19:55:03.490768 28462 ts_itest-base.cc:115] Starting cluster with:
I20260805 19:55:03.490938 28462 ts_itest-base.cc:116] --------------
I20260805 19:55:03.491142 28462 ts_itest-base.cc:117] 3 tablet servers
I20260805 19:55:03.491284 28462 ts_itest-base.cc:118] 3 replicas per TS
I20260805 19:55:03.491478 28462 ts_itest-base.cc:119] --------------
2026-08-05T19:55:03Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-05T19:55:03Z Disabled control of system clock
I20260805 19:55:03.537199 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:37679
--webserver_interface=127.27.203.190
--webserver_port=0
--builtin_ntp_servers=127.27.203.148:45899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.203.190:37679
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260805 19:55:03.872635 673 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:03.873332 673 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:03.873744 673 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:03.909142 673 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 19:55:03.909444 673 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:03.909907 673 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 19:55:03.910213 673 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260805 19:55:03.949424 673 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:45899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.27.203.190:37679
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:37679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.27.203.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:03.950738 673 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:03.952389 673 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:03.963310 679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:03.965044 680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:05.183245 682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:05.185727 681 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1216 milliseconds
I20260805 19:55:05.185834 673 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:55:05.187182 673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:05.190706 673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:05.192232 673 hybrid_clock.cc:648] HybridClock initialized: now 1785959705192181 us; error 65 us; skew 500 ppm
I20260805 19:55:05.193210 673 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:05.200071 673 webserver.cc:533] Webserver started at http://127.27.203.190:34325/ using document root <none> and password file <none>
I20260805 19:55:05.201131 673 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:05.201395 673 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:05.201989 673 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:05.206713 673 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "ccc0e3feafc54270895bd3822f4e69bd"
format_stamp: "Formatted at 2026-08-05 19:55:05 on dist-test-slave-27sr"
I20260805 19:55:05.208102 673 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "ccc0e3feafc54270895bd3822f4e69bd"
format_stamp: "Formatted at 2026-08-05 19:55:05 on dist-test-slave-27sr"
I20260805 19:55:05.216495 673 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260805 19:55:05.223397 689 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:05.224738 673 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260805 19:55:05.225171 673 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
uuid: "ccc0e3feafc54270895bd3822f4e69bd"
format_stamp: "Formatted at 2026-08-05 19:55:05 on dist-test-slave-27sr"
I20260805 19:55:05.225591 673 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:05.277105 673 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:05.278812 673 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:05.279358 673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:05.356546 673 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.190:37679
I20260805 19:55:05.356602 740 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.190:37679 every 8 connection(s)
I20260805 19:55:05.359529 673 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260805 19:55:05.366075 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:05.369354 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 673
I20260805 19:55:05.369931 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260805 19:55:05.390607 741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd: Bootstrap starting.
I20260805 19:55:05.397707 741 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:05.399595 741 log.cc:826] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:05.405362 741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd: No bootstrap required, opened a new log
I20260805 19:55:05.425375 741 raft_consensus.cc:359] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccc0e3feafc54270895bd3822f4e69bd" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37679 } }
I20260805 19:55:05.426357 741 raft_consensus.cc:385] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:05.426653 741 raft_consensus.cc:740] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccc0e3feafc54270895bd3822f4e69bd, State: Initialized, Role: FOLLOWER
I20260805 19:55:05.427616 741 consensus_queue.cc:260] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccc0e3feafc54270895bd3822f4e69bd" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37679 } }
I20260805 19:55:05.428256 741 raft_consensus.cc:399] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:05.428604 741 raft_consensus.cc:493] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:05.428946 741 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:05.433466 741 raft_consensus.cc:515] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccc0e3feafc54270895bd3822f4e69bd" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37679 } }
I20260805 19:55:05.434315 741 leader_election.cc:304] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ccc0e3feafc54270895bd3822f4e69bd; no voters:
I20260805 19:55:05.436275 741 leader_election.cc:290] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:05.437261 746 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:05.439932 746 raft_consensus.cc:697] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [term 1 LEADER]: Becoming Leader. State: Replica: ccc0e3feafc54270895bd3822f4e69bd, State: Running, Role: LEADER
I20260805 19:55:05.441104 741 sys_catalog.cc:565] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [sys.catalog]: configured and running, proceeding with master startup.
I20260805 19:55:05.440912 746 consensus_queue.cc:237] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccc0e3feafc54270895bd3822f4e69bd" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37679 } }
I20260805 19:55:05.453714 747 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ccc0e3feafc54270895bd3822f4e69bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccc0e3feafc54270895bd3822f4e69bd" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37679 } } }
I20260805 19:55:05.454124 748 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader ccc0e3feafc54270895bd3822f4e69bd. Latest consensus state: current_term: 1 leader_uuid: "ccc0e3feafc54270895bd3822f4e69bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccc0e3feafc54270895bd3822f4e69bd" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37679 } } }
I20260805 19:55:05.455260 748 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [sys.catalog]: This master's current role is: LEADER
I20260805 19:55:05.454833 747 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd [sys.catalog]: This master's current role is: LEADER
I20260805 19:55:05.459256 756 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260805 19:55:05.470878 756 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260805 19:55:05.491588 756 catalog_manager.cc:1383] Generated new cluster ID: 0a328720405844fcb2682318725a92bf
I20260805 19:55:05.491904 756 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260805 19:55:05.517198 756 catalog_manager.cc:1406] Generated new certificate authority record
I20260805 19:55:05.518997 756 catalog_manager.cc:1540] Loading token signing keys...
I20260805 19:55:05.533545 756 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ccc0e3feafc54270895bd3822f4e69bd: Generated new TSK 0
I20260805 19:55:05.534721 756 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260805 19:55:05.562996 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.129:0
--local_ip_for_outbound_sockets=127.27.203.129
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37679
--builtin_ntp_servers=127.27.203.148:45899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260805 19:55:05.899879 766 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 19:55:05.900616 766 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:05.900913 766 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:05.901444 766 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:05.936964 766 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:05.937906 766 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.129
I20260805 19:55:05.977839 766 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:45899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37679
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:05.979350 766 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:05.981400 766 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:05.996712 772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:06.000770 775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:05.999718 773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:07.238229 774 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260805 19:55:07.238657 766 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:55:07.242733 766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:07.245922 766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:07.247452 766 hybrid_clock.cc:648] HybridClock initialized: now 1785959707247403 us; error 67 us; skew 500 ppm
I20260805 19:55:07.248406 766 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:07.256184 766 webserver.cc:533] Webserver started at http://127.27.203.129:46267/ using document root <none> and password file <none>
I20260805 19:55:07.257238 766 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:07.257505 766 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:07.258025 766 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:07.262701 766 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "0602c6ef64804718acdccb47d6ba6292"
format_stamp: "Formatted at 2026-08-05 19:55:07 on dist-test-slave-27sr"
I20260805 19:55:07.264267 766 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "0602c6ef64804718acdccb47d6ba6292"
format_stamp: "Formatted at 2026-08-05 19:55:07 on dist-test-slave-27sr"
I20260805 19:55:07.273130 766 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.002s sys 0.005s
I20260805 19:55:07.280094 783 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:07.281509 766 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260805 19:55:07.281895 766 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "0602c6ef64804718acdccb47d6ba6292"
format_stamp: "Formatted at 2026-08-05 19:55:07 on dist-test-slave-27sr"
I20260805 19:55:07.282249 766 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:07.339707 766 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:07.341449 766 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:07.341939 766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:07.345407 766 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:55:07.350163 766 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:55:07.350381 766 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:07.350735 766 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:55:07.350893 766 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:07.505842 766 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.129:33213
I20260805 19:55:07.505982 896 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.129:33213 every 8 connection(s)
I20260805 19:55:07.508637 766 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260805 19:55:07.513481 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 766
I20260805 19:55:07.514283 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260805 19:55:07.523658 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.130:0
--local_ip_for_outbound_sockets=127.27.203.130
--webserver_interface=127.27.203.130
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37679
--builtin_ntp_servers=127.27.203.148:45899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260805 19:55:07.533959 897 heartbeater.cc:344] Connected to a master server at 127.27.203.190:37679
I20260805 19:55:07.534452 897 heartbeater.cc:461] Registering TS with master...
I20260805 19:55:07.535655 897 heartbeater.cc:507] Master 127.27.203.190:37679 requested a full tablet report, sending...
I20260805 19:55:07.538923 706 ts_manager.cc:194] Registered new tserver with Master: 0602c6ef64804718acdccb47d6ba6292 (127.27.203.129:33213)
I20260805 19:55:07.542171 706 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.129:59917
W20260805 19:55:07.858104 902 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 19:55:07.858729 902 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:07.858958 902 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:07.859382 902 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:07.893875 902 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:07.894907 902 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.130
I20260805 19:55:07.933125 902 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:45899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.27.203.130
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37679
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:07.934679 902 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:07.936723 902 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:07.950467 910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:55:08.546691 897 heartbeater.cc:499] Master 127.27.203.190:37679 was elected leader, sending a full tablet report...
W20260805 19:55:07.951179 911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:09.315971 913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:09.320104 902 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.369s user 0.470s sys 0.875s
W20260805 19:55:09.320533 902 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.369s user 0.470s sys 0.875s
W20260805 19:55:09.321384 912 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1369 milliseconds
I20260805 19:55:09.321384 902 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:55:09.322940 902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:09.325502 902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:09.326946 902 hybrid_clock.cc:648] HybridClock initialized: now 1785959709326901 us; error 56 us; skew 500 ppm
I20260805 19:55:09.327872 902 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:09.336155 902 webserver.cc:533] Webserver started at http://127.27.203.130:36767/ using document root <none> and password file <none>
I20260805 19:55:09.337356 902 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:09.337647 902 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:09.338188 902 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:09.343160 902 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "145446eb8159437b9815bc425ee32170"
format_stamp: "Formatted at 2026-08-05 19:55:09 on dist-test-slave-27sr"
I20260805 19:55:09.344518 902 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "145446eb8159437b9815bc425ee32170"
format_stamp: "Formatted at 2026-08-05 19:55:09 on dist-test-slave-27sr"
I20260805 19:55:09.354187 902 fs_manager.cc:696] Time spent creating directory manager: real 0.009s user 0.006s sys 0.002s
I20260805 19:55:09.362715 920 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:09.364586 902 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.004s sys 0.002s
I20260805 19:55:09.365134 902 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "145446eb8159437b9815bc425ee32170"
format_stamp: "Formatted at 2026-08-05 19:55:09 on dist-test-slave-27sr"
I20260805 19:55:09.365672 902 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:09.450268 902 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:09.452232 902 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:09.452788 902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:09.455933 902 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:55:09.460956 902 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:55:09.461187 902 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:09.461544 902 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:55:09.461745 902 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:09.619442 902 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.130:44413
I20260805 19:55:09.619567 1035 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.130:44413 every 8 connection(s)
I20260805 19:55:09.622187 902 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260805 19:55:09.623756 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 902
I20260805 19:55:09.624291 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260805 19:55:09.633764 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.131:0
--local_ip_for_outbound_sockets=127.27.203.131
--webserver_interface=127.27.203.131
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37679
--builtin_ntp_servers=127.27.203.148:45899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260805 19:55:09.649638 1036 heartbeater.cc:344] Connected to a master server at 127.27.203.190:37679
I20260805 19:55:09.650189 1036 heartbeater.cc:461] Registering TS with master...
I20260805 19:55:09.651657 1036 heartbeater.cc:507] Master 127.27.203.190:37679 requested a full tablet report, sending...
I20260805 19:55:09.654506 706 ts_manager.cc:194] Registered new tserver with Master: 145446eb8159437b9815bc425ee32170 (127.27.203.130:44413)
I20260805 19:55:09.656452 706 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.130:37923
W20260805 19:55:09.978333 1040 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 19:55:09.978967 1040 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:09.979188 1040 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:09.979604 1040 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:10.015664 1040 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:10.016603 1040 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.131
I20260805 19:55:10.055123 1040 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:45899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.27.203.131
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37679
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:10.056643 1040 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:10.058420 1040 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:10.071823 1046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:55:10.661181 1036 heartbeater.cc:499] Master 127.27.203.190:37679 was elected leader, sending a full tablet report...
W20260805 19:55:10.074251 1047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:11.322206 1048 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1248 milliseconds
I20260805 19:55:11.322899 1040 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
W20260805 19:55:11.322887 1049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:55:11.326870 1040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:11.329480 1040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:11.330873 1040 hybrid_clock.cc:648] HybridClock initialized: now 1785959711330827 us; error 56 us; skew 500 ppm
I20260805 19:55:11.331737 1040 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:11.338547 1040 webserver.cc:533] Webserver started at http://127.27.203.131:37369/ using document root <none> and password file <none>
I20260805 19:55:11.339669 1040 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:11.339936 1040 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:11.340474 1040 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:11.345228 1040 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "3f4784fe8def492e888abc581ac75e49"
format_stamp: "Formatted at 2026-08-05 19:55:11 on dist-test-slave-27sr"
I20260805 19:55:11.346470 1040 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "3f4784fe8def492e888abc581ac75e49"
format_stamp: "Formatted at 2026-08-05 19:55:11 on dist-test-slave-27sr"
I20260805 19:55:11.357299 1040 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.011s sys 0.001s
I20260805 19:55:11.367304 1057 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:11.368944 1040 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260805 19:55:11.369387 1040 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "3f4784fe8def492e888abc581ac75e49"
format_stamp: "Formatted at 2026-08-05 19:55:11 on dist-test-slave-27sr"
I20260805 19:55:11.369799 1040 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:11.429840 1040 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:11.431633 1040 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:11.432230 1040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:11.435286 1040 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:55:11.440696 1040 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:55:11.440951 1040 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:11.441354 1040 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:55:11.441530 1040 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:11.608121 1040 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.131:36869
I20260805 19:55:11.608217 1170 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.131:36869 every 8 connection(s)
I20260805 19:55:11.611215 1040 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260805 19:55:11.619585 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 1040
I20260805 19:55:11.620342 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.TestLeaderStepDown.TestLeaderStepDownWhenNotPresent_0.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260805 19:55:11.643469 1171 heartbeater.cc:344] Connected to a master server at 127.27.203.190:37679
I20260805 19:55:11.644044 1171 heartbeater.cc:461] Registering TS with master...
I20260805 19:55:11.645548 1171 heartbeater.cc:507] Master 127.27.203.190:37679 requested a full tablet report, sending...
I20260805 19:55:11.648561 705 ts_manager.cc:194] Registered new tserver with Master: 3f4784fe8def492e888abc581ac75e49 (127.27.203.131:36869)
I20260805 19:55:11.650245 705 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.131:49003
I20260805 19:55:11.663815 28462 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260805 19:55:11.710642 705 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36234:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20260805 19:55:11.732661 705 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 19:55:11.798171 832 tablet_service.cc:1511] Processing CreateTablet for tablet 72c675d7f1704b6e85fda743c33db02f (DEFAULT_TABLE table=TestTable [id=4e5c2d2da62f4341b7531624b90cd83b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:55:11.800578 832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c675d7f1704b6e85fda743c33db02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:11.801918 969 tablet_service.cc:1511] Processing CreateTablet for tablet 72c675d7f1704b6e85fda743c33db02f (DEFAULT_TABLE table=TestTable [id=4e5c2d2da62f4341b7531624b90cd83b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:55:11.803522 969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c675d7f1704b6e85fda743c33db02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:11.805655 1105 tablet_service.cc:1511] Processing CreateTablet for tablet 72c675d7f1704b6e85fda743c33db02f (DEFAULT_TABLE table=TestTable [id=4e5c2d2da62f4341b7531624b90cd83b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:55:11.807789 1105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c675d7f1704b6e85fda743c33db02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:11.829175 1190 tablet_bootstrap.cc:492] T 72c675d7f1704b6e85fda743c33db02f P 145446eb8159437b9815bc425ee32170: Bootstrap starting.
I20260805 19:55:11.834408 1191 tablet_bootstrap.cc:492] T 72c675d7f1704b6e85fda743c33db02f P 0602c6ef64804718acdccb47d6ba6292: Bootstrap starting.
I20260805 19:55:11.839037 1190 tablet_bootstrap.cc:654] T 72c675d7f1704b6e85fda743c33db02f P 145446eb8159437b9815bc425ee32170: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:11.839939 1192 tablet_bootstrap.cc:492] T 72c675d7f1704b6e85fda743c33db02f P 3f4784fe8def492e888abc581ac75e49: Bootstrap starting.
I20260805 19:55:11.841498 1190 log.cc:826] T 72c675d7f1704b6e85fda743c33db02f P 145446eb8159437b9815bc425ee32170: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:11.843506 1191 tablet_bootstrap.cc:654] T 72c675d7f1704b6e85fda743c33db02f P 0602c6ef64804718acdccb47d6ba6292: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:11.846287 1191 log.cc:826] T 72c675d7f1704b6e85fda743c33db02f P 0602c6ef64804718acdccb47d6ba6292: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:11.846903 1190 tablet_bootstrap.cc:492] T 72c675d7f1704b6e85fda743c33db02f P 145446eb8159437b9815bc425ee32170: No bootstrap required, opened a new log
I20260805 19:55:11.847419 1190 ts_tablet_manager.cc:1403] T 72c675d7f1704b6e85fda743c33db02f P 145446eb8159437b9815bc425ee32170: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.003s
I20260805 19:55:11.852306 1192 tablet_bootstrap.cc:654] T 72c675d7f1704b6e85fda743c33db02f P 3f4784fe8def492e888abc581ac75e49: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:11.855226 1192 log.cc:826] T 72c675d7f1704b6e85fda743c33db02f P 3f4784fe8def492e888abc581ac75e49: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:11.859602 1191 tablet_bootstrap.cc:492] T 72c675d7f1704b6e85fda743c33db02f P 0602c6ef64804718acdccb47d6ba6292: No bootstrap required, opened a new log
I20260805 19:55:11.860276 1191 ts_tablet_manager.cc:1403] T 72c675d7f1704b6e85fda743c33db02f P 0602c6ef64804718acdccb47d6ba6292: Time spent bootstrapping tablet: real 0.026s user 0.019s sys 0.004s
I20260805 19:55:11.862258 1192 tablet_bootstrap.cc:492] T 72c675d7f1704b6e85fda743c33db02f P 3f4784fe8def492e888abc581ac75e49: No bootstrap required, opened a new log
I20260805 19:55:11.862823 1192 ts_tablet_manager.cc:1403] T 72c675d7f1704b6e85fda743c33db02f P 3f4784fe8def492e888abc581ac75e49: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.014s
I20260805 19:55:11.872898 1190 raft_consensus.cc:359] T 72c675d7f1704b6e85fda743c33db02f P 145446eb8159437b9815bc425ee32170 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0602c6ef64804718acdccb47d6ba6292" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 33213 } } peers { permanent_uuid: "145446eb8159437b9815bc425ee32170" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 44413 } } peers { permanent_uuid: "3f4784fe8def492e888abc581ac75e49" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 36869 } }
I20260805 19:55:11.873704 1190 raft_consensus.cc:740] T 72c675d7f1704b6e85fda743c33db02f P 145446eb8159437b9815bc425ee32170 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 145446eb8159437b9815bc425ee32170, State: Initialized, Role: FOLLOWER
I20260805 19:55:11.874403 1190 consensus_queue.cc:260] T 72c675d7f1704b6e85fda743c33db02f P 145446eb8159437b9815bc425ee32170 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0602c6ef64804718acdccb47d6ba6292" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 33213 } } peers { permanent_uuid: "145446eb8159437b9815bc425ee32170" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 44413 } } peers { permanent_uuid: "3f4784fe8def492e888abc581ac75e49" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 36869 } }
I20260805 19:55:11.878786 1190 ts_tablet_manager.cc:1434] T 72c675d7f1704b6e85fda743c33db02f P 145446eb8159437b9815bc425ee32170: Time spent starting tablet: real 0.031s user 0.014s sys 0.014s
W20260805 19:55:11.881129 1037 tablet.cc:2406] T 72c675d7f1704b6e85fda743c33db02f P 145446eb8159437b9815bc425ee32170: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 19:55:11.890417 1191 raft_consensus.cc:359] T 72c675d7f1704b6e85fda743c33db02f P 0602c6ef64804718acdccb47d6ba6292 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0602c6ef64804718acdccb47d6ba6292" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 33213 } } peers { permanent_uuid: "145446eb8159437b9815bc425ee32170" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 44413 } } peers { permanent_uuid: "3f4784fe8def492e888abc581ac75e49" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 36869 } }
I20260805 19:55:11.891453 1191 raft_consensus.cc:740] T 72c675d7f1704b6e85fda743c33db02f P 0602c6ef64804718acdccb47d6ba6292 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0602c6ef64804718acdccb47d6ba6292, State: Initialized, Role: FOLLOWER
I20260805 19:55:11.892274 1191 consensus_queue.cc:260] T 72c675d7f1704b6e85fda743c33db02f P 0602c6ef64804718acdccb47d6ba6292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0602c6ef64804718acdccb47d6ba6292" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 33213 } } peers { permanent_uuid: "145446eb8159437b9815bc425ee32170" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 44413 } } peers { permanent_uuid: "3f4784fe8def492e888abc581ac75e49" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 36869 } }
I20260805 19:55:11.894717 1192 raft_consensus.cc:359] T 72c675d7f1704b6e85fda743c33db02f P 3f4784fe8def492e888abc581ac75e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0602c6ef64804718acdccb47d6ba6292" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 33213 } } peers { permanent_uuid: "145446eb8159437b9815bc425ee32170" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 44413 } } peers { permanent_uuid: "3f4784fe8def492e888abc581ac75e49" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 36869 } }
I20260805 19:55:11.895876 1192 raft_consensus.cc:740] T 72c675d7f1704b6e85fda743c33db02f P 3f4784fe8def492e888abc581ac75e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f4784fe8def492e888abc581ac75e49, State: Initialized, Role: FOLLOWER
I20260805 19:55:11.896955 1191 ts_tablet_manager.cc:1434] T 72c675d7f1704b6e85fda743c33db02f P 0602c6ef64804718acdccb47d6ba6292: Time spent starting tablet: real 0.036s user 0.022s sys 0.013s
I20260805 19:55:11.896697 1192 consensus_queue.cc:260] T 72c675d7f1704b6e85fda743c33db02f P 3f4784fe8def492e888abc581ac75e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0602c6ef64804718acdccb47d6ba6292" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 33213 } } peers { permanent_uuid: "145446eb8159437b9815bc425ee32170" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 44413 } } peers { permanent_uuid: "3f4784fe8def492e888abc581ac75e49" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 36869 } }
I20260805 19:55:11.900739 1171 heartbeater.cc:499] Master 127.27.203.190:37679 was elected leader, sending a full tablet report...
I20260805 19:55:11.901543 1192 ts_tablet_manager.cc:1434] T 72c675d7f1704b6e85fda743c33db02f P 3f4784fe8def492e888abc581ac75e49: Time spent starting tablet: real 0.038s user 0.034s sys 0.001s
I20260805 19:55:11.918440 28462 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260805 19:55:11.922389 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 0602c6ef64804718acdccb47d6ba6292 to finish bootstrapping
I20260805 19:55:11.936735 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 145446eb8159437b9815bc425ee32170 to finish bootstrapping
I20260805 19:55:11.949644 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 3f4784fe8def492e888abc581ac75e49 to finish bootstrapping
W20260805 19:55:12.020279 898 tablet.cc:2406] T 72c675d7f1704b6e85fda743c33db02f P 0602c6ef64804718acdccb47d6ba6292: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 19:55:12.118743 1172 tablet.cc:2406] T 72c675d7f1704b6e85fda743c33db02f P 3f4784fe8def492e888abc581ac75e49: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 19:55:12.335765 1202 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:12.336462 1202 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:13.717582 1202 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.301s user 0.488s sys 0.810s
W20260805 19:55:13.717881 1202 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.302s user 0.488s sys 0.810s
I20260805 19:55:14.789676 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 766
I20260805 19:55:14.821079 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 902
I20260805 19:55:14.851972 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 1040
I20260805 19:55:14.881762 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 673
2026-08-05T19:55:14Z chronyd exiting
[ OK ] TestLeaderStepDown.TestLeaderStepDownWhenNotPresent/0 (11456 ms)
[----------] 1 test from TestLeaderStepDown (11456 ms total)
[----------] 1 test from ListTableCliDetailParamTest
[ RUN ] ListTableCliDetailParamTest.TestListTablesDetail/1
I20260805 19:55:14.948418 28462 ts_itest-base.cc:115] Starting cluster with:
I20260805 19:55:14.948596 28462 ts_itest-base.cc:116] --------------
I20260805 19:55:14.948880 28462 ts_itest-base.cc:117] 3 tablet servers
I20260805 19:55:14.949035 28462 ts_itest-base.cc:118] 3 replicas per TS
I20260805 19:55:14.949206 28462 ts_itest-base.cc:119] --------------
2026-08-05T19:55:14Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-05T19:55:14Z Disabled control of system clock
I20260805 19:55:14.995985 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:37475
--webserver_interface=127.27.203.190
--webserver_port=0
--builtin_ntp_servers=127.27.203.148:38501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.203.190:37475 with env {}
W20260805 19:55:15.344214 1223 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:15.344944 1223 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:15.345518 1223 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:15.382014 1223 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 19:55:15.382400 1223 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:15.382710 1223 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 19:55:15.382980 1223 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260805 19:55:15.422631 1223 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:38501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.203.190:37475
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:37475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.27.203.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:15.424191 1223 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:15.426249 1223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:15.438820 1229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:16.843534 1228 debug-util.cc:398] Leaking SignalData structure 0x7b08000290e0 after lost signal to thread 1223
W20260805 19:55:17.362632 1223 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.924s user 0.832s sys 1.092s
W20260805 19:55:15.439453 1230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:17.363055 1223 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.924s user 0.832s sys 1.092s
W20260805 19:55:17.365943 1232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:17.371170 1231 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1931 milliseconds
I20260805 19:55:17.371176 1223 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:55:17.372699 1223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:17.375337 1223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:17.376720 1223 hybrid_clock.cc:648] HybridClock initialized: now 1785959717376675 us; error 69 us; skew 500 ppm
I20260805 19:55:17.377600 1223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:17.384331 1223 webserver.cc:533] Webserver started at http://127.27.203.190:44691/ using document root <none> and password file <none>
I20260805 19:55:17.385347 1223 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:17.385591 1223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:17.386138 1223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:17.390776 1223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "3ac8872ec52544e9bd9aeb8a759546a0"
format_stamp: "Formatted at 2026-08-05 19:55:17 on dist-test-slave-27sr"
I20260805 19:55:17.392153 1223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "3ac8872ec52544e9bd9aeb8a759546a0"
format_stamp: "Formatted at 2026-08-05 19:55:17 on dist-test-slave-27sr"
I20260805 19:55:17.400192 1223 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260805 19:55:17.406843 1240 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:17.408241 1223 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.005s sys 0.001s
I20260805 19:55:17.408666 1223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
uuid: "3ac8872ec52544e9bd9aeb8a759546a0"
format_stamp: "Formatted at 2026-08-05 19:55:17 on dist-test-slave-27sr"
I20260805 19:55:17.409093 1223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:17.468281 1223 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:17.470000 1223 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:17.470543 1223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:17.548053 1223 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.190:37475
I20260805 19:55:17.548094 1292 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.190:37475 every 8 connection(s)
I20260805 19:55:17.551155 1223 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260805 19:55:17.558131 1293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:17.560518 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 1223
I20260805 19:55:17.561201 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260805 19:55:17.582441 1293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0: Bootstrap starting.
I20260805 19:55:17.590086 1293 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:17.591943 1293 log.cc:826] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:17.599797 1293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0: No bootstrap required, opened a new log
I20260805 19:55:17.621934 1293 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac8872ec52544e9bd9aeb8a759546a0" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37475 } }
I20260805 19:55:17.622673 1293 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:17.622902 1293 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ac8872ec52544e9bd9aeb8a759546a0, State: Initialized, Role: FOLLOWER
I20260805 19:55:17.623998 1293 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac8872ec52544e9bd9aeb8a759546a0" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37475 } }
I20260805 19:55:17.624683 1293 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:17.625051 1293 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:17.625511 1293 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:17.630075 1293 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac8872ec52544e9bd9aeb8a759546a0" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37475 } }
I20260805 19:55:17.630987 1293 leader_election.cc:304] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ac8872ec52544e9bd9aeb8a759546a0; no voters:
I20260805 19:55:17.632916 1293 leader_election.cc:290] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:17.634011 1298 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:17.636626 1298 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [term 1 LEADER]: Becoming Leader. State: Replica: 3ac8872ec52544e9bd9aeb8a759546a0, State: Running, Role: LEADER
I20260805 19:55:17.637404 1293 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 19:55:17.637521 1298 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac8872ec52544e9bd9aeb8a759546a0" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37475 } }
I20260805 19:55:17.648424 1299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ac8872ec52544e9bd9aeb8a759546a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac8872ec52544e9bd9aeb8a759546a0" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37475 } } }
I20260805 19:55:17.650763 1299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [sys.catalog]: This master's current role is: LEADER
I20260805 19:55:17.650048 1300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ac8872ec52544e9bd9aeb8a759546a0. Latest consensus state: current_term: 1 leader_uuid: "3ac8872ec52544e9bd9aeb8a759546a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac8872ec52544e9bd9aeb8a759546a0" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 37475 } } }
I20260805 19:55:17.651830 1300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0 [sys.catalog]: This master's current role is: LEADER
I20260805 19:55:17.654728 1306 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260805 19:55:17.669309 1306 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260805 19:55:17.687369 1306 catalog_manager.cc:1383] Generated new cluster ID: e5d563fc7cc74bffb73e818ee77aeb91
I20260805 19:55:17.687762 1306 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260805 19:55:17.711393 1306 catalog_manager.cc:1406] Generated new certificate authority record
I20260805 19:55:17.713897 1306 catalog_manager.cc:1540] Loading token signing keys...
I20260805 19:55:17.732836 1306 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3ac8872ec52544e9bd9aeb8a759546a0: Generated new TSK 0
I20260805 19:55:17.733975 1306 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260805 19:55:17.754761 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.129:0
--local_ip_for_outbound_sockets=127.27.203.129
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37475
--builtin_ntp_servers=127.27.203.148:38501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20260805 19:55:18.117175 1317 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:18.117772 1317 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:18.118285 1317 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:18.155028 1317 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:18.155992 1317 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.129
I20260805 19:55:18.194747 1317 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:38501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37475
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:18.196264 1317 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:18.198002 1317 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:18.212141 1323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:18.213615 1324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:19.616393 1322 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee20 after lost signal to thread 1317
W20260805 19:55:20.151437 1317 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.938s user 0.673s sys 1.238s
W20260805 19:55:20.153614 1317 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.941s user 0.673s sys 1.239s
W20260805 19:55:20.154549 1326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:20.157763 1325 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1939 milliseconds
I20260805 19:55:20.158414 1317 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:55:20.160144 1317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:20.163291 1317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:20.164937 1317 hybrid_clock.cc:648] HybridClock initialized: now 1785959720164883 us; error 48 us; skew 500 ppm
I20260805 19:55:20.166214 1317 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:20.175278 1317 webserver.cc:533] Webserver started at http://127.27.203.129:43995/ using document root <none> and password file <none>
I20260805 19:55:20.176826 1317 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:20.178260 1317 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:20.179059 1317 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:20.186522 1317 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "7fab4a2e1466423ea5f493540cd114a6"
format_stamp: "Formatted at 2026-08-05 19:55:20 on dist-test-slave-27sr"
I20260805 19:55:20.188318 1317 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "7fab4a2e1466423ea5f493540cd114a6"
format_stamp: "Formatted at 2026-08-05 19:55:20 on dist-test-slave-27sr"
I20260805 19:55:20.199491 1317 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.009s sys 0.001s
I20260805 19:55:20.206251 1333 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:20.207692 1317 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.004s sys 0.001s
I20260805 19:55:20.208243 1317 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "7fab4a2e1466423ea5f493540cd114a6"
format_stamp: "Formatted at 2026-08-05 19:55:20 on dist-test-slave-27sr"
I20260805 19:55:20.208667 1317 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:20.275261 1317 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:20.277092 1317 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:20.277624 1317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:20.280597 1317 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:55:20.285245 1317 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:55:20.285588 1317 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:20.285873 1317 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:55:20.286056 1317 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:20.467654 1317 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.129:35767
I20260805 19:55:20.467876 1446 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.129:35767 every 8 connection(s)
I20260805 19:55:20.470496 1317 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260805 19:55:20.476877 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 1317
I20260805 19:55:20.477365 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260805 19:55:20.487035 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.130:0
--local_ip_for_outbound_sockets=127.27.203.130
--webserver_interface=127.27.203.130
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37475
--builtin_ntp_servers=127.27.203.148:38501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:55:20.509449 1447 heartbeater.cc:344] Connected to a master server at 127.27.203.190:37475
I20260805 19:55:20.509977 1447 heartbeater.cc:461] Registering TS with master...
I20260805 19:55:20.511440 1447 heartbeater.cc:507] Master 127.27.203.190:37475 requested a full tablet report, sending...
I20260805 19:55:20.514853 1257 ts_manager.cc:194] Registered new tserver with Master: 7fab4a2e1466423ea5f493540cd114a6 (127.27.203.129:35767)
I20260805 19:55:20.516999 1257 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.129:50813
W20260805 19:55:20.860149 1451 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:20.860646 1451 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:20.861095 1451 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:20.894858 1451 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:20.895687 1451 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.130
I20260805 19:55:20.934921 1451 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:38501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.27.203.130
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37475
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:20.936781 1451 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:20.939082 1451 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:20.954104 1457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:55:21.521071 1447 heartbeater.cc:499] Master 127.27.203.190:37475 was elected leader, sending a full tablet report...
W20260805 19:55:22.359046 1456 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee20 after lost signal to thread 1451
W20260805 19:55:20.955850 1458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:22.389736 1456 kernel_stack_watchdog.cc:198] Thread 1451 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 400ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260805 19:55:22.394013 1451 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.439s user 0.565s sys 0.861s
W20260805 19:55:22.394536 1451 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.440s user 0.565s sys 0.861s
W20260805 19:55:22.394766 1459 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1435 milliseconds
W20260805 19:55:22.396607 1460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:55:22.396704 1451 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:55:22.398025 1451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:22.400306 1451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:22.401707 1451 hybrid_clock.cc:648] HybridClock initialized: now 1785959722401665 us; error 48 us; skew 500 ppm
I20260805 19:55:22.402627 1451 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:22.409226 1451 webserver.cc:533] Webserver started at http://127.27.203.130:45621/ using document root <none> and password file <none>
I20260805 19:55:22.410248 1451 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:22.410516 1451 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:22.411023 1451 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:22.416335 1451 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb"
format_stamp: "Formatted at 2026-08-05 19:55:22 on dist-test-slave-27sr"
I20260805 19:55:22.417672 1451 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb"
format_stamp: "Formatted at 2026-08-05 19:55:22 on dist-test-slave-27sr"
I20260805 19:55:22.426345 1451 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.004s sys 0.004s
I20260805 19:55:22.433072 1467 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:22.434554 1451 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260805 19:55:22.435009 1451 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb"
format_stamp: "Formatted at 2026-08-05 19:55:22 on dist-test-slave-27sr"
I20260805 19:55:22.435413 1451 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:22.492040 1451 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:22.493876 1451 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:22.494431 1451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:22.497495 1451 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:55:22.502408 1451 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:55:22.502642 1451 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:22.502966 1451 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:55:22.503124 1451 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:22.657126 1451 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.130:34297
I20260805 19:55:22.657325 1580 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.130:34297 every 8 connection(s)
I20260805 19:55:22.660036 1451 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260805 19:55:22.668205 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 1451
I20260805 19:55:22.668677 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260805 19:55:22.676172 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.131:0
--local_ip_for_outbound_sockets=127.27.203.131
--webserver_interface=127.27.203.131
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37475
--builtin_ntp_servers=127.27.203.148:38501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
I20260805 19:55:22.690625 1581 heartbeater.cc:344] Connected to a master server at 127.27.203.190:37475
I20260805 19:55:22.691262 1581 heartbeater.cc:461] Registering TS with master...
I20260805 19:55:22.692950 1581 heartbeater.cc:507] Master 127.27.203.190:37475 requested a full tablet report, sending...
I20260805 19:55:22.696281 1257 ts_manager.cc:194] Registered new tserver with Master: c09bd4f99d7a4cb28dd32b47ba9fd9fb (127.27.203.130:34297)
I20260805 19:55:22.697943 1257 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.130:47413
W20260805 19:55:23.019461 1585 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:23.020068 1585 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:23.020588 1585 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:23.055403 1585 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:23.056366 1585 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.131
I20260805 19:55:23.095067 1585 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:38501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.27.203.131
--webserver_port=0
--tserver_master_addrs=127.27.203.190:37475
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:23.096573 1585 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:23.098379 1585 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:23.110863 1591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:55:23.702715 1581 heartbeater.cc:499] Master 127.27.203.190:37475 was elected leader, sending a full tablet report...
W20260805 19:55:24.516201 1590 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee20 after lost signal to thread 1585
W20260805 19:55:24.999629 1590 kernel_stack_watchdog.cc:198] Thread 1585 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 401ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260805 19:55:23.112445 1592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:25.001607 1593 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1888 milliseconds
W20260805 19:55:25.001542 1585 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.890s user 0.000s sys 0.002s
W20260805 19:55:25.002017 1585 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.891s user 0.000s sys 0.003s
W20260805 19:55:25.007606 1594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:55:25.007735 1585 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:55:25.009301 1585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:25.011634 1585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:25.013041 1585 hybrid_clock.cc:648] HybridClock initialized: now 1785959725012996 us; error 77 us; skew 500 ppm
I20260805 19:55:25.013983 1585 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:25.020491 1585 webserver.cc:533] Webserver started at http://127.27.203.131:44633/ using document root <none> and password file <none>
I20260805 19:55:25.021622 1585 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:25.021837 1585 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:25.022279 1585 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:25.026685 1585 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "8e23d2bb33e94898b870fcde00f0e65a"
format_stamp: "Formatted at 2026-08-05 19:55:25 on dist-test-slave-27sr"
I20260805 19:55:25.027789 1585 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "8e23d2bb33e94898b870fcde00f0e65a"
format_stamp: "Formatted at 2026-08-05 19:55:25 on dist-test-slave-27sr"
I20260805 19:55:25.036121 1585 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.007s sys 0.000s
I20260805 19:55:25.042097 1601 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:25.043305 1585 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260805 19:55:25.043632 1585 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "8e23d2bb33e94898b870fcde00f0e65a"
format_stamp: "Formatted at 2026-08-05 19:55:25 on dist-test-slave-27sr"
I20260805 19:55:25.044075 1585 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:25.110167 1585 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:25.111778 1585 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:25.112298 1585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:25.114961 1585 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:55:25.119468 1585 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:55:25.119678 1585 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:25.119884 1585 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:55:25.120127 1585 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260805 19:55:25.261924 1585 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.131:44193
I20260805 19:55:25.262061 1716 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.131:44193 every 8 connection(s)
I20260805 19:55:25.264675 1585 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260805 19:55:25.267614 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 1585
I20260805 19:55:25.268199 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliDetailParamTest.TestListTablesDetail_1.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260805 19:55:25.286989 1717 heartbeater.cc:344] Connected to a master server at 127.27.203.190:37475
I20260805 19:55:25.287546 1717 heartbeater.cc:461] Registering TS with master...
I20260805 19:55:25.288841 1717 heartbeater.cc:507] Master 127.27.203.190:37475 requested a full tablet report, sending...
I20260805 19:55:25.291232 1257 ts_manager.cc:194] Registered new tserver with Master: 8e23d2bb33e94898b870fcde00f0e65a (127.27.203.131:44193)
I20260805 19:55:25.292544 1257 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.131:49567
I20260805 19:55:25.304174 28462 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260805 19:55:25.353461 1257 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57488:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20260805 19:55:25.378062 1257 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 19:55:25.449229 1651 tablet_service.cc:1511] Processing CreateTablet for tablet 2c73cae13fdc4c9d8ddc2527a7fee94a (DEFAULT_TABLE table=TestTable [id=91c8cdb1a36e4b869f721769e1a71279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:55:25.451447 1651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c73cae13fdc4c9d8ddc2527a7fee94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:25.451817 1515 tablet_service.cc:1511] Processing CreateTablet for tablet 2c73cae13fdc4c9d8ddc2527a7fee94a (DEFAULT_TABLE table=TestTable [id=91c8cdb1a36e4b869f721769e1a71279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:55:25.454016 1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c73cae13fdc4c9d8ddc2527a7fee94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:25.456537 1382 tablet_service.cc:1511] Processing CreateTablet for tablet 2c73cae13fdc4c9d8ddc2527a7fee94a (DEFAULT_TABLE table=TestTable [id=91c8cdb1a36e4b869f721769e1a71279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:55:25.458911 1382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c73cae13fdc4c9d8ddc2527a7fee94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:25.492862 1739 tablet_bootstrap.cc:492] T 2c73cae13fdc4c9d8ddc2527a7fee94a P c09bd4f99d7a4cb28dd32b47ba9fd9fb: Bootstrap starting.
I20260805 19:55:25.493364 1740 tablet_bootstrap.cc:492] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 7fab4a2e1466423ea5f493540cd114a6: Bootstrap starting.
I20260805 19:55:25.491441 1738 tablet_bootstrap.cc:492] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a: Bootstrap starting.
I20260805 19:55:25.501711 1740 tablet_bootstrap.cc:654] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 7fab4a2e1466423ea5f493540cd114a6: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:25.501711 1739 tablet_bootstrap.cc:654] T 2c73cae13fdc4c9d8ddc2527a7fee94a P c09bd4f99d7a4cb28dd32b47ba9fd9fb: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:25.504510 1740 log.cc:826] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 7fab4a2e1466423ea5f493540cd114a6: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:25.504510 1739 log.cc:826] T 2c73cae13fdc4c9d8ddc2527a7fee94a P c09bd4f99d7a4cb28dd32b47ba9fd9fb: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:25.504909 1738 tablet_bootstrap.cc:654] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:25.508898 1738 log.cc:826] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:25.515442 1740 tablet_bootstrap.cc:492] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 7fab4a2e1466423ea5f493540cd114a6: No bootstrap required, opened a new log
I20260805 19:55:25.515992 1738 tablet_bootstrap.cc:492] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a: No bootstrap required, opened a new log
I20260805 19:55:25.516069 1740 ts_tablet_manager.cc:1403] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 7fab4a2e1466423ea5f493540cd114a6: Time spent bootstrapping tablet: real 0.025s user 0.017s sys 0.005s
I20260805 19:55:25.516490 1739 tablet_bootstrap.cc:492] T 2c73cae13fdc4c9d8ddc2527a7fee94a P c09bd4f99d7a4cb28dd32b47ba9fd9fb: No bootstrap required, opened a new log
I20260805 19:55:25.516553 1738 ts_tablet_manager.cc:1403] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a: Time spent bootstrapping tablet: real 0.028s user 0.013s sys 0.006s
I20260805 19:55:25.517023 1739 ts_tablet_manager.cc:1403] T 2c73cae13fdc4c9d8ddc2527a7fee94a P c09bd4f99d7a4cb28dd32b47ba9fd9fb: Time spent bootstrapping tablet: real 0.025s user 0.016s sys 0.007s
I20260805 19:55:25.539125 1740 raft_consensus.cc:359] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 7fab4a2e1466423ea5f493540cd114a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } } peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } }
I20260805 19:55:25.540170 1740 raft_consensus.cc:385] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 7fab4a2e1466423ea5f493540cd114a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:25.540504 1740 raft_consensus.cc:740] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 7fab4a2e1466423ea5f493540cd114a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fab4a2e1466423ea5f493540cd114a6, State: Initialized, Role: FOLLOWER
I20260805 19:55:25.542115 1740 consensus_queue.cc:260] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 7fab4a2e1466423ea5f493540cd114a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } } peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } }
I20260805 19:55:25.546559 1738 raft_consensus.cc:359] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } } peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } }
I20260805 19:55:25.547698 1738 raft_consensus.cc:385] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:25.548106 1738 raft_consensus.cc:740] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e23d2bb33e94898b870fcde00f0e65a, State: Initialized, Role: FOLLOWER
I20260805 19:55:25.549392 1738 consensus_queue.cc:260] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } } peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } }
I20260805 19:55:25.557725 1717 heartbeater.cc:499] Master 127.27.203.190:37475 was elected leader, sending a full tablet report...
I20260805 19:55:25.557819 1740 ts_tablet_manager.cc:1434] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 7fab4a2e1466423ea5f493540cd114a6: Time spent starting tablet: real 0.041s user 0.027s sys 0.012s
I20260805 19:55:25.559686 1739 raft_consensus.cc:359] T 2c73cae13fdc4c9d8ddc2527a7fee94a P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } } peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } }
I20260805 19:55:25.560899 1739 raft_consensus.cc:385] T 2c73cae13fdc4c9d8ddc2527a7fee94a P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:25.561306 1739 raft_consensus.cc:740] T 2c73cae13fdc4c9d8ddc2527a7fee94a P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c09bd4f99d7a4cb28dd32b47ba9fd9fb, State: Initialized, Role: FOLLOWER
I20260805 19:55:25.562458 1739 consensus_queue.cc:260] T 2c73cae13fdc4c9d8ddc2527a7fee94a P c09bd4f99d7a4cb28dd32b47ba9fd9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } } peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } }
I20260805 19:55:25.564174 1738 ts_tablet_manager.cc:1434] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a: Time spent starting tablet: real 0.047s user 0.025s sys 0.017s
I20260805 19:55:25.567796 1739 ts_tablet_manager.cc:1434] T 2c73cae13fdc4c9d8ddc2527a7fee94a P c09bd4f99d7a4cb28dd32b47ba9fd9fb: Time spent starting tablet: real 0.050s user 0.022s sys 0.014s
W20260805 19:55:25.668797 1582 tablet.cc:2406] T 2c73cae13fdc4c9d8ddc2527a7fee94a P c09bd4f99d7a4cb28dd32b47ba9fd9fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 19:55:25.734346 1448 tablet.cc:2406] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 7fab4a2e1466423ea5f493540cd114a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 19:55:25.769941 1718 tablet.cc:2406] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 19:55:25.787055 1745 raft_consensus.cc:493] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 19:55:25.787551 1745 raft_consensus.cc:515] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } } peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } }
I20260805 19:55:25.790266 1745 leader_election.cc:290] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c09bd4f99d7a4cb28dd32b47ba9fd9fb (127.27.203.130:34297), 7fab4a2e1466423ea5f493540cd114a6 (127.27.203.129:35767)
I20260805 19:55:25.801842 1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c73cae13fdc4c9d8ddc2527a7fee94a" candidate_uuid: "8e23d2bb33e94898b870fcde00f0e65a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" is_pre_election: true
I20260805 19:55:25.802959 1535 raft_consensus.cc:2468] T 2c73cae13fdc4c9d8ddc2527a7fee94a P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e23d2bb33e94898b870fcde00f0e65a in term 0.
I20260805 19:55:25.803383 1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c73cae13fdc4c9d8ddc2527a7fee94a" candidate_uuid: "8e23d2bb33e94898b870fcde00f0e65a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fab4a2e1466423ea5f493540cd114a6" is_pre_election: true
I20260805 19:55:25.804227 1402 raft_consensus.cc:2468] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 7fab4a2e1466423ea5f493540cd114a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e23d2bb33e94898b870fcde00f0e65a in term 0.
I20260805 19:55:25.804570 1606 leader_election.cc:304] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e23d2bb33e94898b870fcde00f0e65a, c09bd4f99d7a4cb28dd32b47ba9fd9fb; no voters:
I20260805 19:55:25.805460 1745 raft_consensus.cc:2804] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 19:55:25.805804 1745 raft_consensus.cc:493] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 19:55:25.806026 1745 raft_consensus.cc:3060] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:25.810726 1745 raft_consensus.cc:515] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } } peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } }
I20260805 19:55:25.812484 1745 leader_election.cc:290] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [CANDIDATE]: Term 1 election: Requested vote from peers c09bd4f99d7a4cb28dd32b47ba9fd9fb (127.27.203.130:34297), 7fab4a2e1466423ea5f493540cd114a6 (127.27.203.129:35767)
I20260805 19:55:25.813656 1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c73cae13fdc4c9d8ddc2527a7fee94a" candidate_uuid: "8e23d2bb33e94898b870fcde00f0e65a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb"
I20260805 19:55:25.813740 1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c73cae13fdc4c9d8ddc2527a7fee94a" candidate_uuid: "8e23d2bb33e94898b870fcde00f0e65a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fab4a2e1466423ea5f493540cd114a6"
I20260805 19:55:25.814277 1535 raft_consensus.cc:3060] T 2c73cae13fdc4c9d8ddc2527a7fee94a P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:25.814278 1402 raft_consensus.cc:3060] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 7fab4a2e1466423ea5f493540cd114a6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:25.821900 1402 raft_consensus.cc:2468] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 7fab4a2e1466423ea5f493540cd114a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e23d2bb33e94898b870fcde00f0e65a in term 1.
I20260805 19:55:25.821906 1535 raft_consensus.cc:2468] T 2c73cae13fdc4c9d8ddc2527a7fee94a P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e23d2bb33e94898b870fcde00f0e65a in term 1.
I20260805 19:55:25.823279 1606 leader_election.cc:304] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e23d2bb33e94898b870fcde00f0e65a, c09bd4f99d7a4cb28dd32b47ba9fd9fb; no voters:
I20260805 19:55:25.824204 1745 raft_consensus.cc:2804] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:25.826004 1745 raft_consensus.cc:697] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [term 1 LEADER]: Becoming Leader. State: Replica: 8e23d2bb33e94898b870fcde00f0e65a, State: Running, Role: LEADER
I20260805 19:55:25.826803 1745 consensus_queue.cc:237] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } } peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } }
I20260805 19:55:25.838958 1254 catalog_manager.cc:5697] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e23d2bb33e94898b870fcde00f0e65a (127.27.203.131). New cstate: current_term: 1 leader_uuid: "8e23d2bb33e94898b870fcde00f0e65a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } health_report { overall_health: UNKNOWN } } }
I20260805 19:55:25.861179 28462 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260805 19:55:25.865617 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 7fab4a2e1466423ea5f493540cd114a6 to finish bootstrapping
I20260805 19:55:25.880189 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver c09bd4f99d7a4cb28dd32b47ba9fd9fb to finish bootstrapping
I20260805 19:55:25.894300 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 8e23d2bb33e94898b870fcde00f0e65a to finish bootstrapping
I20260805 19:55:25.909410 1255 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57488:
name: "TestAnotherTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 19:55:25.911092 1255 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestAnotherTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 19:55:25.931293 1382 tablet_service.cc:1511] Processing CreateTablet for tablet 665e95a6ae13412da20024bafda1c83b (DEFAULT_TABLE table=TestAnotherTable [id=a77537de7912450d851f5554ad1d7998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:55:25.932574 1382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 665e95a6ae13412da20024bafda1c83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:25.932428 1515 tablet_service.cc:1511] Processing CreateTablet for tablet 665e95a6ae13412da20024bafda1c83b (DEFAULT_TABLE table=TestAnotherTable [id=a77537de7912450d851f5554ad1d7998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:55:25.933526 1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 665e95a6ae13412da20024bafda1c83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:25.933897 1651 tablet_service.cc:1511] Processing CreateTablet for tablet 665e95a6ae13412da20024bafda1c83b (DEFAULT_TABLE table=TestAnotherTable [id=a77537de7912450d851f5554ad1d7998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:55:25.934991 1651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 665e95a6ae13412da20024bafda1c83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:25.947607 1739 tablet_bootstrap.cc:492] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb: Bootstrap starting.
I20260805 19:55:25.949872 1740 tablet_bootstrap.cc:492] T 665e95a6ae13412da20024bafda1c83b P 7fab4a2e1466423ea5f493540cd114a6: Bootstrap starting.
I20260805 19:55:25.950863 1738 tablet_bootstrap.cc:492] T 665e95a6ae13412da20024bafda1c83b P 8e23d2bb33e94898b870fcde00f0e65a: Bootstrap starting.
I20260805 19:55:25.954541 1739 tablet_bootstrap.cc:654] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:25.956135 1740 tablet_bootstrap.cc:654] T 665e95a6ae13412da20024bafda1c83b P 7fab4a2e1466423ea5f493540cd114a6: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:25.958807 1738 tablet_bootstrap.cc:654] T 665e95a6ae13412da20024bafda1c83b P 8e23d2bb33e94898b870fcde00f0e65a: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:25.961591 1739 tablet_bootstrap.cc:492] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb: No bootstrap required, opened a new log
I20260805 19:55:25.962059 1739 ts_tablet_manager.cc:1403] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.001s
I20260805 19:55:25.962816 1740 tablet_bootstrap.cc:492] T 665e95a6ae13412da20024bafda1c83b P 7fab4a2e1466423ea5f493540cd114a6: No bootstrap required, opened a new log
I20260805 19:55:25.963240 1740 ts_tablet_manager.cc:1403] T 665e95a6ae13412da20024bafda1c83b P 7fab4a2e1466423ea5f493540cd114a6: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.004s
I20260805 19:55:25.965036 1739 raft_consensus.cc:359] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } } peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } }
I20260805 19:55:25.965731 1739 raft_consensus.cc:385] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:25.966034 1739 raft_consensus.cc:740] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c09bd4f99d7a4cb28dd32b47ba9fd9fb, State: Initialized, Role: FOLLOWER
I20260805 19:55:25.966063 1740 raft_consensus.cc:359] T 665e95a6ae13412da20024bafda1c83b P 7fab4a2e1466423ea5f493540cd114a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } } peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } }
I20260805 19:55:25.966805 1740 raft_consensus.cc:385] T 665e95a6ae13412da20024bafda1c83b P 7fab4a2e1466423ea5f493540cd114a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:25.967095 1740 raft_consensus.cc:740] T 665e95a6ae13412da20024bafda1c83b P 7fab4a2e1466423ea5f493540cd114a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fab4a2e1466423ea5f493540cd114a6, State: Initialized, Role: FOLLOWER
I20260805 19:55:25.967146 1739 consensus_queue.cc:260] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } } peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } }
I20260805 19:55:25.967829 1740 consensus_queue.cc:260] T 665e95a6ae13412da20024bafda1c83b P 7fab4a2e1466423ea5f493540cd114a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } } peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } }
I20260805 19:55:25.969344 1739 ts_tablet_manager.cc:1434] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260805 19:55:25.969916 1740 ts_tablet_manager.cc:1434] T 665e95a6ae13412da20024bafda1c83b P 7fab4a2e1466423ea5f493540cd114a6: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260805 19:55:25.970898 1738 tablet_bootstrap.cc:492] T 665e95a6ae13412da20024bafda1c83b P 8e23d2bb33e94898b870fcde00f0e65a: No bootstrap required, opened a new log
I20260805 19:55:25.971276 1738 ts_tablet_manager.cc:1403] T 665e95a6ae13412da20024bafda1c83b P 8e23d2bb33e94898b870fcde00f0e65a: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.005s
I20260805 19:55:25.974072 1738 raft_consensus.cc:359] T 665e95a6ae13412da20024bafda1c83b P 8e23d2bb33e94898b870fcde00f0e65a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } } peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } }
I20260805 19:55:25.974843 1738 raft_consensus.cc:385] T 665e95a6ae13412da20024bafda1c83b P 8e23d2bb33e94898b870fcde00f0e65a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:25.975132 1738 raft_consensus.cc:740] T 665e95a6ae13412da20024bafda1c83b P 8e23d2bb33e94898b870fcde00f0e65a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e23d2bb33e94898b870fcde00f0e65a, State: Initialized, Role: FOLLOWER
I20260805 19:55:25.975754 1738 consensus_queue.cc:260] T 665e95a6ae13412da20024bafda1c83b P 8e23d2bb33e94898b870fcde00f0e65a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } } peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } }
I20260805 19:55:25.977615 1738 ts_tablet_manager.cc:1434] T 665e95a6ae13412da20024bafda1c83b P 8e23d2bb33e94898b870fcde00f0e65a: Time spent starting tablet: real 0.006s user 0.004s sys 0.002s
I20260805 19:55:26.182855 1746 raft_consensus.cc:493] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 19:55:26.183339 1746 raft_consensus.cc:515] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } } peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } }
I20260805 19:55:26.186299 1746 leader_election.cc:290] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fab4a2e1466423ea5f493540cd114a6 (127.27.203.129:35767), 8e23d2bb33e94898b870fcde00f0e65a (127.27.203.131:44193)
I20260805 19:55:26.199812 1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665e95a6ae13412da20024bafda1c83b" candidate_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fab4a2e1466423ea5f493540cd114a6" is_pre_election: true
I20260805 19:55:26.200552 1402 raft_consensus.cc:2468] T 665e95a6ae13412da20024bafda1c83b P 7fab4a2e1466423ea5f493540cd114a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c09bd4f99d7a4cb28dd32b47ba9fd9fb in term 0.
I20260805 19:55:26.200601 1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665e95a6ae13412da20024bafda1c83b" candidate_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e23d2bb33e94898b870fcde00f0e65a" is_pre_election: true
I20260805 19:55:26.201431 1672 raft_consensus.cc:2468] T 665e95a6ae13412da20024bafda1c83b P 8e23d2bb33e94898b870fcde00f0e65a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c09bd4f99d7a4cb28dd32b47ba9fd9fb in term 0.
I20260805 19:55:26.201984 1468 leader_election.cc:304] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fab4a2e1466423ea5f493540cd114a6, c09bd4f99d7a4cb28dd32b47ba9fd9fb; no voters:
I20260805 19:55:26.202970 1746 raft_consensus.cc:2804] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 19:55:26.203351 1746 raft_consensus.cc:493] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 19:55:26.203663 1746 raft_consensus.cc:3060] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:26.208905 1746 raft_consensus.cc:515] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } } peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } }
I20260805 19:55:26.211674 1746 leader_election.cc:290] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [CANDIDATE]: Term 1 election: Requested vote from peers 7fab4a2e1466423ea5f493540cd114a6 (127.27.203.129:35767), 8e23d2bb33e94898b870fcde00f0e65a (127.27.203.131:44193)
I20260805 19:55:26.211958 1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665e95a6ae13412da20024bafda1c83b" candidate_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fab4a2e1466423ea5f493540cd114a6"
I20260805 19:55:26.212536 1402 raft_consensus.cc:3060] T 665e95a6ae13412da20024bafda1c83b P 7fab4a2e1466423ea5f493540cd114a6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:26.213236 1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665e95a6ae13412da20024bafda1c83b" candidate_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e23d2bb33e94898b870fcde00f0e65a"
I20260805 19:55:26.213827 1672 raft_consensus.cc:3060] T 665e95a6ae13412da20024bafda1c83b P 8e23d2bb33e94898b870fcde00f0e65a [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:26.218453 1672 raft_consensus.cc:2468] T 665e95a6ae13412da20024bafda1c83b P 8e23d2bb33e94898b870fcde00f0e65a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c09bd4f99d7a4cb28dd32b47ba9fd9fb in term 1.
I20260805 19:55:26.219731 1471 leader_election.cc:304] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e23d2bb33e94898b870fcde00f0e65a, c09bd4f99d7a4cb28dd32b47ba9fd9fb; no voters:
I20260805 19:55:26.220643 1746 raft_consensus.cc:2804] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:26.220660 1402 raft_consensus.cc:2468] T 665e95a6ae13412da20024bafda1c83b P 7fab4a2e1466423ea5f493540cd114a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c09bd4f99d7a4cb28dd32b47ba9fd9fb in term 1.
I20260805 19:55:26.222698 1746 raft_consensus.cc:697] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [term 1 LEADER]: Becoming Leader. State: Replica: c09bd4f99d7a4cb28dd32b47ba9fd9fb, State: Running, Role: LEADER
I20260805 19:55:26.223613 1746 consensus_queue.cc:237] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } } peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } }
I20260805 19:55:26.235078 1257 catalog_manager.cc:5697] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to c09bd4f99d7a4cb28dd32b47ba9fd9fb (127.27.203.130). New cstate: current_term: 1 leader_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 } health_report { overall_health: UNKNOWN } } }
I20260805 19:55:26.267426 1745 consensus_queue.cc:1048] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 19:55:26.290361 1749 consensus_queue.cc:1048] T 2c73cae13fdc4c9d8ddc2527a7fee94a P 8e23d2bb33e94898b870fcde00f0e65a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c09bd4f99d7a4cb28dd32b47ba9fd9fb" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 34297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260805 19:55:26.774267 1746 consensus_queue.cc:1048] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e23d2bb33e94898b870fcde00f0e65a" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 44193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260805 19:55:26.801117 1746 consensus_queue.cc:1048] T 665e95a6ae13412da20024bafda1c83b P c09bd4f99d7a4cb28dd32b47ba9fd9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fab4a2e1466423ea5f493540cd114a6" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260805 19:55:29.173951 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 1317
I20260805 19:55:29.205590 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 1451
I20260805 19:55:29.238780 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 1585
I20260805 19:55:29.272164 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 1223
2026-08-05T19:55:29Z chronyd exiting
[ OK ] ListTableCliDetailParamTest.TestListTablesDetail/1 (14397 ms)
[----------] 1 test from ListTableCliDetailParamTest (14397 ms total)
[----------] 1 test from ListTableCliParamTest
[ RUN ] ListTableCliParamTest.ListTabletWithPartitionInfo/6
I20260805 19:55:29.345956 28462 ts_itest-base.cc:115] Starting cluster with:
I20260805 19:55:29.346158 28462 ts_itest-base.cc:116] --------------
I20260805 19:55:29.346410 28462 ts_itest-base.cc:117] 1 tablet servers
I20260805 19:55:29.346553 28462 ts_itest-base.cc:118] 1 replicas per TS
I20260805 19:55:29.346745 28462 ts_itest-base.cc:119] --------------
2026-08-05T19:55:29Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-05T19:55:29Z Disabled control of system clock
I20260805 19:55:29.396764 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:38341
--webserver_interface=127.27.203.190
--webserver_port=0
--builtin_ntp_servers=127.27.203.148:36043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.203.190:38341 with env {}
W20260805 19:55:29.735489 1797 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:29.736204 1797 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:29.736690 1797 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:29.772158 1797 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 19:55:29.772568 1797 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:29.772907 1797 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 19:55:29.773190 1797 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260805 19:55:29.813380 1797 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:36043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.203.190:38341
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:38341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.27.203.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:29.814980 1797 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:29.816951 1797 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:29.830014 1803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:31.234892 1802 debug-util.cc:398] Leaking SignalData structure 0x7b08000290e0 after lost signal to thread 1797
W20260805 19:55:29.830633 1804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:31.740793 1802 kernel_stack_watchdog.cc:198] Thread 1797 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 401ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260805 19:55:31.746802 1797 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.917s user 0.005s sys 0.004s
W20260805 19:55:31.747298 1797 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.917s user 0.005s sys 0.004s
W20260805 19:55:31.747366 1805 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1916 milliseconds
W20260805 19:55:31.749366 1806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:55:31.749334 1797 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:55:31.751979 1797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:31.754621 1797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:31.756059 1797 hybrid_clock.cc:648] HybridClock initialized: now 1785959731756001 us; error 62 us; skew 500 ppm
I20260805 19:55:31.757095 1797 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:31.763873 1797 webserver.cc:533] Webserver started at http://127.27.203.190:36129/ using document root <none> and password file <none>
I20260805 19:55:31.765074 1797 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:31.765341 1797 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:31.765890 1797 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:31.770705 1797 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "e3d2cb25ab964359a118b19a2571d4fb"
format_stamp: "Formatted at 2026-08-05 19:55:31 on dist-test-slave-27sr"
I20260805 19:55:31.772032 1797 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "e3d2cb25ab964359a118b19a2571d4fb"
format_stamp: "Formatted at 2026-08-05 19:55:31 on dist-test-slave-27sr"
I20260805 19:55:31.780401 1797 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260805 19:55:31.786870 1813 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:31.788303 1797 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.007s sys 0.000s
I20260805 19:55:31.788690 1797 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
uuid: "e3d2cb25ab964359a118b19a2571d4fb"
format_stamp: "Formatted at 2026-08-05 19:55:31 on dist-test-slave-27sr"
I20260805 19:55:31.789067 1797 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:31.857685 1797 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:31.859524 1797 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:31.860069 1797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:31.938300 1797 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.190:38341
I20260805 19:55:31.938390 1868 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.190:38341 every 8 connection(s)
I20260805 19:55:31.941169 1797 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260805 19:55:31.947320 1869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:31.951718 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 1797
I20260805 19:55:31.952345 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260805 19:55:31.973032 1869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb: Bootstrap starting.
I20260805 19:55:31.980386 1869 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:31.982577 1869 log.cc:826] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:31.987844 1869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb: No bootstrap required, opened a new log
I20260805 19:55:32.007473 1869 raft_consensus.cc:359] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3d2cb25ab964359a118b19a2571d4fb" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 38341 } }
I20260805 19:55:32.008482 1869 raft_consensus.cc:385] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:32.008738 1869 raft_consensus.cc:740] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3d2cb25ab964359a118b19a2571d4fb, State: Initialized, Role: FOLLOWER
I20260805 19:55:32.009764 1869 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3d2cb25ab964359a118b19a2571d4fb" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 38341 } }
I20260805 19:55:32.010481 1869 raft_consensus.cc:399] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:32.010776 1869 raft_consensus.cc:493] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:32.011063 1869 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:32.015312 1869 raft_consensus.cc:515] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3d2cb25ab964359a118b19a2571d4fb" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 38341 } }
I20260805 19:55:32.016113 1869 leader_election.cc:304] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3d2cb25ab964359a118b19a2571d4fb; no voters:
I20260805 19:55:32.018252 1869 leader_election.cc:290] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:32.019094 1874 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:32.021543 1874 raft_consensus.cc:697] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [term 1 LEADER]: Becoming Leader. State: Replica: e3d2cb25ab964359a118b19a2571d4fb, State: Running, Role: LEADER
I20260805 19:55:32.022375 1874 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3d2cb25ab964359a118b19a2571d4fb" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 38341 } }
I20260805 19:55:32.022830 1869 sys_catalog.cc:565] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [sys.catalog]: configured and running, proceeding with master startup.
I20260805 19:55:32.033164 1876 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3d2cb25ab964359a118b19a2571d4fb. Latest consensus state: current_term: 1 leader_uuid: "e3d2cb25ab964359a118b19a2571d4fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3d2cb25ab964359a118b19a2571d4fb" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 38341 } } }
I20260805 19:55:32.033515 1875 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3d2cb25ab964359a118b19a2571d4fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3d2cb25ab964359a118b19a2571d4fb" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 38341 } } }
I20260805 19:55:32.034255 1876 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [sys.catalog]: This master's current role is: LEADER
I20260805 19:55:32.034457 1875 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb [sys.catalog]: This master's current role is: LEADER
I20260805 19:55:32.043090 1882 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260805 19:55:32.054807 1882 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260805 19:55:32.074640 1882 catalog_manager.cc:1383] Generated new cluster ID: f008267539ef4c559a2d5a461da94c26
I20260805 19:55:32.075093 1882 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260805 19:55:32.108712 1882 catalog_manager.cc:1406] Generated new certificate authority record
I20260805 19:55:32.110618 1882 catalog_manager.cc:1540] Loading token signing keys...
I20260805 19:55:32.127866 1882 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e3d2cb25ab964359a118b19a2571d4fb: Generated new TSK 0
I20260805 19:55:32.128973 1882 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260805 19:55:32.144172 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.129:0
--local_ip_for_outbound_sockets=127.27.203.129
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:38341
--builtin_ntp_servers=127.27.203.148:36043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=30000 with env {}
W20260805 19:55:32.484472 1893 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:32.485103 1893 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:32.485646 1893 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:32.520943 1893 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:32.521863 1893 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.129
I20260805 19:55:32.562081 1893 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:36043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:38341
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:32.563553 1893 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:32.565376 1893 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:32.578799 1899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:32.583576 1903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:32.581073 1901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:33.975327 1902 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1390 milliseconds
I20260805 19:55:33.975464 1893 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:55:33.977159 1893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:33.980448 1893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:33.982048 1893 hybrid_clock.cc:648] HybridClock initialized: now 1785959733981994 us; error 74 us; skew 500 ppm
I20260805 19:55:33.983188 1893 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:33.991454 1893 webserver.cc:533] Webserver started at http://127.27.203.129:39009/ using document root <none> and password file <none>
I20260805 19:55:33.992636 1893 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:33.992933 1893 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:33.993491 1893 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:33.998682 1893 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "a95a6c699755403883b9ad8435c0ca1f"
format_stamp: "Formatted at 2026-08-05 19:55:33 on dist-test-slave-27sr"
I20260805 19:55:34.000128 1893 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "a95a6c699755403883b9ad8435c0ca1f"
format_stamp: "Formatted at 2026-08-05 19:55:33 on dist-test-slave-27sr"
I20260805 19:55:34.009750 1893 fs_manager.cc:696] Time spent creating directory manager: real 0.009s user 0.004s sys 0.004s
I20260805 19:55:34.017043 1910 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:34.018631 1893 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.001s sys 0.004s
I20260805 19:55:34.019137 1893 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "a95a6c699755403883b9ad8435c0ca1f"
format_stamp: "Formatted at 2026-08-05 19:55:33 on dist-test-slave-27sr"
I20260805 19:55:34.019603 1893 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:34.084714 1893 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:34.086412 1893 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:34.086918 1893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:34.090484 1893 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:55:34.095184 1893 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:55:34.095443 1893 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:34.095726 1893 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:55:34.095942 1893 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:34.280721 1893 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.129:34895
I20260805 19:55:34.280843 2024 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.129:34895 every 8 connection(s)
I20260805 19:55:34.283551 1893 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260805 19:55:34.294418 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 1893
I20260805 19:55:34.294971 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.ListTableCliParamTest.ListTabletWithPartitionInfo_6.1785959555696825-28462-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260805 19:55:34.314764 2025 heartbeater.cc:344] Connected to a master server at 127.27.203.190:38341
I20260805 19:55:34.315366 2025 heartbeater.cc:461] Registering TS with master...
I20260805 19:55:34.316951 2025 heartbeater.cc:507] Master 127.27.203.190:38341 requested a full tablet report, sending...
I20260805 19:55:34.319837 1831 ts_manager.cc:194] Registered new tserver with Master: a95a6c699755403883b9ad8435c0ca1f (127.27.203.129:34895)
I20260805 19:55:34.322192 1831 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.129:34009
I20260805 19:55:34.332278 28462 external_mini_cluster.cc:955] 1 TS(s) registered with all masters
I20260805 19:55:34.370487 1831 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36116:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20260805 19:55:34.438766 1958 tablet_service.cc:1511] Processing CreateTablet for tablet 9f0e02aec8b04140b320677abdd70c46 (DEFAULT_TABLE table=TestTable [id=6c924d263ed04665bfcd6e4c2b957a89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:55:34.440512 1958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0e02aec8b04140b320677abdd70c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:34.466137 2040 tablet_bootstrap.cc:492] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f: Bootstrap starting.
I20260805 19:55:34.472997 2040 tablet_bootstrap.cc:654] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:34.474993 2040 log.cc:826] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:34.480310 2040 tablet_bootstrap.cc:492] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f: No bootstrap required, opened a new log
I20260805 19:55:34.480880 2040 ts_tablet_manager.cc:1403] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.009s
I20260805 19:55:34.500789 2040 raft_consensus.cc:359] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.501446 2040 raft_consensus.cc:385] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:34.501715 2040 raft_consensus.cc:740] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Initialized, Role: FOLLOWER
I20260805 19:55:34.502493 2040 consensus_queue.cc:260] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.503091 2040 raft_consensus.cc:399] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:34.503401 2040 raft_consensus.cc:493] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:34.503736 2040 raft_consensus.cc:3060] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:34.508168 2040 raft_consensus.cc:515] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.508983 2040 leader_election.cc:304] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a95a6c699755403883b9ad8435c0ca1f; no voters:
I20260805 19:55:34.510751 2040 leader_election.cc:290] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:34.511197 2042 raft_consensus.cc:2804] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:34.513929 2042 raft_consensus.cc:697] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f [term 1 LEADER]: Becoming Leader. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Running, Role: LEADER
I20260805 19:55:34.514526 2025 heartbeater.cc:499] Master 127.27.203.190:38341 was elected leader, sending a full tablet report...
I20260805 19:55:34.514868 2042 consensus_queue.cc:237] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.515455 2040 ts_tablet_manager.cc:1434] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f: Time spent starting tablet: real 0.034s user 0.023s sys 0.011s
I20260805 19:55:34.528385 1831 catalog_manager.cc:5697] T 9f0e02aec8b04140b320677abdd70c46 P a95a6c699755403883b9ad8435c0ca1f reported cstate change: term changed from 0 to 1, leader changed from <none> to a95a6c699755403883b9ad8435c0ca1f (127.27.203.129). New cstate: current_term: 1 leader_uuid: "a95a6c699755403883b9ad8435c0ca1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260805 19:55:34.548898 28462 external_mini_cluster.cc:955] 1 TS(s) registered with all masters
I20260805 19:55:34.552441 28462 ts_itest-base.cc:246] Waiting for 1 tablets on tserver a95a6c699755403883b9ad8435c0ca1f to finish bootstrapping
I20260805 19:55:34.582875 1832 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36116:
name: "TestTableListPartition"
schema {
columns {
name: "key_hash0"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "key_hash1"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "key_hash2"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "key_range"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "<redacted>""\006\010\000\000\000\000\007\010\001\000\000\000\006\010\002\000\000\000\007\010\003\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
hash_schema {
columns {
name: "key_hash0"
}
num_buckets: 2
seed: 0
}
hash_schema {
columns {
name: "key_hash1"
}
columns {
name: "key_hash2"
}
num_buckets: 3
seed: 0
}
range_schema {
columns {
name: "key_range"
}
}
}
I20260805 19:55:34.622895 1958 tablet_service.cc:1511] Processing CreateTablet for tablet 4493cf806b3044a1a580aaf169b14915 (DEFAULT_TABLE table=TestTableListPartition [id=068566bf00ba4878925aaa0c35644f6e]), partition=HASH (key_hash0) PARTITION 0, HASH (key_hash1, key_hash2) PARTITION 0, RANGE (key_range) PARTITION 0 <= VALUES < 1
I20260805 19:55:34.623951 1957 tablet_service.cc:1511] Processing CreateTablet for tablet cf639b2f13b549549e44a6aa5d435cab (DEFAULT_TABLE table=TestTableListPartition [id=068566bf00ba4878925aaa0c35644f6e]), partition=HASH (key_hash0) PARTITION 0, HASH (key_hash1, key_hash2) PARTITION 0, RANGE (key_range) PARTITION 2 <= VALUES < 3
I20260805 19:55:34.624975 1958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4493cf806b3044a1a580aaf169b14915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:34.625572 1957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf639b2f13b549549e44a6aa5d435cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:34.625589 1956 tablet_service.cc:1511] Processing CreateTablet for tablet 32d15d36ebb54cc7b17dd8eb426e8e63 (DEFAULT_TABLE table=TestTableListPartition [id=068566bf00ba4878925aaa0c35644f6e]), partition=HASH (key_hash0) PARTITION 0, HASH (key_hash1, key_hash2) PARTITION 1, RANGE (key_range) PARTITION 0 <= VALUES < 1
I20260805 19:55:34.627139 1956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32d15d36ebb54cc7b17dd8eb426e8e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:34.633139 1953 tablet_service.cc:1511] Processing CreateTablet for tablet 406974fd373c44928e1a2315cddd349c (DEFAULT_TABLE table=TestTableListPartition [id=068566bf00ba4878925aaa0c35644f6e]), partition=HASH (key_hash0) PARTITION 0, HASH (key_hash1, key_hash2) PARTITION 2, RANGE (key_range) PARTITION 2 <= VALUES < 3
I20260805 19:55:34.629365 1955 tablet_service.cc:1511] Processing CreateTablet for tablet a4ce9727713944f2b877b4216cad1ec4 (DEFAULT_TABLE table=TestTableListPartition [id=068566bf00ba4878925aaa0c35644f6e]), partition=HASH (key_hash0) PARTITION 0, HASH (key_hash1, key_hash2) PARTITION 1, RANGE (key_range) PARTITION 2 <= VALUES < 3
I20260805 19:55:34.631261 1954 tablet_service.cc:1511] Processing CreateTablet for tablet eefe9753c3a44c08b8a678402cbd7634 (DEFAULT_TABLE table=TestTableListPartition [id=068566bf00ba4878925aaa0c35644f6e]), partition=HASH (key_hash0) PARTITION 0, HASH (key_hash1, key_hash2) PARTITION 2, RANGE (key_range) PARTITION 0 <= VALUES < 1
I20260805 19:55:34.634711 1953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406974fd373c44928e1a2315cddd349c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:34.635432 1954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eefe9753c3a44c08b8a678402cbd7634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:34.640337 1955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ce9727713944f2b877b4216cad1ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:34.641083 2040 tablet_bootstrap.cc:492] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f: Bootstrap starting.
I20260805 19:55:34.645790 1952 tablet_service.cc:1511] Processing CreateTablet for tablet ae69e8ee92274282bf912357d2eb03c4 (DEFAULT_TABLE table=TestTableListPartition [id=068566bf00ba4878925aaa0c35644f6e]), partition=HASH (key_hash0) PARTITION 1, HASH (key_hash1, key_hash2) PARTITION 0, RANGE (key_range) PARTITION 0 <= VALUES < 1
I20260805 19:55:34.648547 1952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae69e8ee92274282bf912357d2eb03c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:34.657261 1950 tablet_service.cc:1511] Processing CreateTablet for tablet 3f58ea38c4d74f088372ba36ca0ae6d5 (DEFAULT_TABLE table=TestTableListPartition [id=068566bf00ba4878925aaa0c35644f6e]), partition=HASH (key_hash0) PARTITION 1, HASH (key_hash1, key_hash2) PARTITION 2, RANGE (key_range) PARTITION 0 <= VALUES < 1
I20260805 19:55:34.657933 1957 tablet_service.cc:1511] Processing CreateTablet for tablet 65f0ddb3fb32490aa4d43a8de8b8d2bf (DEFAULT_TABLE table=TestTableListPartition [id=068566bf00ba4878925aaa0c35644f6e]), partition=HASH (key_hash0) PARTITION 1, HASH (key_hash1, key_hash2) PARTITION 0, RANGE (key_range) PARTITION 2 <= VALUES < 3
I20260805 19:55:34.660707 1950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f58ea38c4d74f088372ba36ca0ae6d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:34.661803 1958 tablet_service.cc:1511] Processing CreateTablet for tablet a289daf187c549c0b61123022f6422d7 (DEFAULT_TABLE table=TestTableListPartition [id=068566bf00ba4878925aaa0c35644f6e]), partition=HASH (key_hash0) PARTITION 1, HASH (key_hash1, key_hash2) PARTITION 1, RANGE (key_range) PARTITION 0 <= VALUES < 1
I20260805 19:55:34.662230 1951 tablet_service.cc:1511] Processing CreateTablet for tablet d1e0cb27f19e40b7a9657040eff9dccc (DEFAULT_TABLE table=TestTableListPartition [id=068566bf00ba4878925aaa0c35644f6e]), partition=HASH (key_hash0) PARTITION 1, HASH (key_hash1, key_hash2) PARTITION 1, RANGE (key_range) PARTITION 2 <= VALUES < 3
I20260805 19:55:34.663791 1957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f0ddb3fb32490aa4d43a8de8b8d2bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:34.662119 1949 tablet_service.cc:1511] Processing CreateTablet for tablet 326bc1a15eed461f84ff08c2c3e8f487 (DEFAULT_TABLE table=TestTableListPartition [id=068566bf00ba4878925aaa0c35644f6e]), partition=HASH (key_hash0) PARTITION 1, HASH (key_hash1, key_hash2) PARTITION 2, RANGE (key_range) PARTITION 2 <= VALUES < 3
I20260805 19:55:34.665187 1951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e0cb27f19e40b7a9657040eff9dccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:34.666986 1949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326bc1a15eed461f84ff08c2c3e8f487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:34.673882 2040 tablet_bootstrap.cc:654] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:34.680534 1958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a289daf187c549c0b61123022f6422d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:34.706164 2040 tablet_bootstrap.cc:492] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f: No bootstrap required, opened a new log
I20260805 19:55:34.706602 2040 ts_tablet_manager.cc:1403] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f: Time spent bootstrapping tablet: real 0.066s user 0.017s sys 0.002s
I20260805 19:55:34.710031 2040 raft_consensus.cc:359] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.710800 2040 raft_consensus.cc:385] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:34.711107 2040 raft_consensus.cc:740] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Initialized, Role: FOLLOWER
I20260805 19:55:34.711805 2040 consensus_queue.cc:260] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.712568 2040 raft_consensus.cc:399] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:34.712880 2040 raft_consensus.cc:493] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:34.713181 2040 raft_consensus.cc:3060] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:34.727519 2040 raft_consensus.cc:515] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.728123 2040 leader_election.cc:304] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a95a6c699755403883b9ad8435c0ca1f; no voters:
I20260805 19:55:34.728698 2040 leader_election.cc:290] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:34.728865 2042 raft_consensus.cc:2804] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:34.729427 2042 raft_consensus.cc:697] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f [term 1 LEADER]: Becoming Leader. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Running, Role: LEADER
I20260805 19:55:34.730470 2040 ts_tablet_manager.cc:1434] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f: Time spent starting tablet: real 0.024s user 0.014s sys 0.000s
I20260805 19:55:34.730204 2042 consensus_queue.cc:237] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.731271 2040 tablet_bootstrap.cc:492] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f: Bootstrap starting.
I20260805 19:55:34.737391 2040 tablet_bootstrap.cc:654] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:34.739095 1832 catalog_manager.cc:5697] T 4493cf806b3044a1a580aaf169b14915 P a95a6c699755403883b9ad8435c0ca1f reported cstate change: term changed from 0 to 1, leader changed from <none> to a95a6c699755403883b9ad8435c0ca1f (127.27.203.129). New cstate: current_term: 1 leader_uuid: "a95a6c699755403883b9ad8435c0ca1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260805 19:55:34.743822 2040 tablet_bootstrap.cc:492] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f: No bootstrap required, opened a new log
I20260805 19:55:34.744294 2040 ts_tablet_manager.cc:1403] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.007s
I20260805 19:55:34.747128 2040 raft_consensus.cc:359] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.747658 2040 raft_consensus.cc:385] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:34.747927 2040 raft_consensus.cc:740] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Initialized, Role: FOLLOWER
I20260805 19:55:34.748539 2040 consensus_queue.cc:260] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.749154 2040 raft_consensus.cc:399] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:34.749420 2040 raft_consensus.cc:493] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:34.749703 2040 raft_consensus.cc:3060] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:34.754233 2040 raft_consensus.cc:515] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.754863 2040 leader_election.cc:304] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a95a6c699755403883b9ad8435c0ca1f; no voters:
I20260805 19:55:34.755386 2040 leader_election.cc:290] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:34.755561 2042 raft_consensus.cc:2804] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:34.756234 2042 raft_consensus.cc:697] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f [term 1 LEADER]: Becoming Leader. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Running, Role: LEADER
I20260805 19:55:34.756880 2040 ts_tablet_manager.cc:1434] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f: Time spent starting tablet: real 0.012s user 0.004s sys 0.007s
I20260805 19:55:34.756939 2042 consensus_queue.cc:237] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.757570 2040 tablet_bootstrap.cc:492] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f: Bootstrap starting.
I20260805 19:55:34.763157 2040 tablet_bootstrap.cc:654] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:34.765125 1832 catalog_manager.cc:5697] T cf639b2f13b549549e44a6aa5d435cab P a95a6c699755403883b9ad8435c0ca1f reported cstate change: term changed from 0 to 1, leader changed from <none> to a95a6c699755403883b9ad8435c0ca1f (127.27.203.129). New cstate: current_term: 1 leader_uuid: "a95a6c699755403883b9ad8435c0ca1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260805 19:55:34.768582 2040 tablet_bootstrap.cc:492] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f: No bootstrap required, opened a new log
I20260805 19:55:34.769001 2040 ts_tablet_manager.cc:1403] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20260805 19:55:34.771595 2040 raft_consensus.cc:359] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.772166 2040 raft_consensus.cc:385] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:34.772504 2040 raft_consensus.cc:740] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Initialized, Role: FOLLOWER
I20260805 19:55:34.773217 2040 consensus_queue.cc:260] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.773730 2040 raft_consensus.cc:399] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:34.773973 2040 raft_consensus.cc:493] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:34.774300 2040 raft_consensus.cc:3060] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:34.778784 2040 raft_consensus.cc:515] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.779503 2040 leader_election.cc:304] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a95a6c699755403883b9ad8435c0ca1f; no voters:
I20260805 19:55:34.780076 2040 leader_election.cc:290] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:34.780341 2042 raft_consensus.cc:2804] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:34.780814 2042 raft_consensus.cc:697] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f [term 1 LEADER]: Becoming Leader. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Running, Role: LEADER
I20260805 19:55:34.781601 2040 ts_tablet_manager.cc:1434] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260805 19:55:34.781538 2042 consensus_queue.cc:237] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.782308 2040 tablet_bootstrap.cc:492] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f: Bootstrap starting.
I20260805 19:55:34.788275 2040 tablet_bootstrap.cc:654] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:34.789520 1832 catalog_manager.cc:5697] T 406974fd373c44928e1a2315cddd349c P a95a6c699755403883b9ad8435c0ca1f reported cstate change: term changed from 0 to 1, leader changed from <none> to a95a6c699755403883b9ad8435c0ca1f (127.27.203.129). New cstate: current_term: 1 leader_uuid: "a95a6c699755403883b9ad8435c0ca1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260805 19:55:34.794481 2040 tablet_bootstrap.cc:492] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f: No bootstrap required, opened a new log
I20260805 19:55:34.794899 2040 ts_tablet_manager.cc:1403] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f: Time spent bootstrapping tablet: real 0.013s user 0.011s sys 0.000s
I20260805 19:55:34.796901 2040 raft_consensus.cc:359] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.797328 2040 raft_consensus.cc:385] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:34.797566 2040 raft_consensus.cc:740] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Initialized, Role: FOLLOWER
I20260805 19:55:34.798156 2040 consensus_queue.cc:260] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.798576 2040 raft_consensus.cc:399] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:34.798789 2040 raft_consensus.cc:493] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:34.799043 2040 raft_consensus.cc:3060] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:34.803099 2040 raft_consensus.cc:515] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.803666 2040 leader_election.cc:304] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a95a6c699755403883b9ad8435c0ca1f; no voters:
I20260805 19:55:34.804100 2040 leader_election.cc:290] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:34.804294 2042 raft_consensus.cc:2804] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:34.804838 2042 raft_consensus.cc:697] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f [term 1 LEADER]: Becoming Leader. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Running, Role: LEADER
I20260805 19:55:34.805540 2040 ts_tablet_manager.cc:1434] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260805 19:55:34.805555 2042 consensus_queue.cc:237] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.806313 2040 tablet_bootstrap.cc:492] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f: Bootstrap starting.
I20260805 19:55:34.811218 2040 tablet_bootstrap.cc:654] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:34.813148 1832 catalog_manager.cc:5697] T a289daf187c549c0b61123022f6422d7 P a95a6c699755403883b9ad8435c0ca1f reported cstate change: term changed from 0 to 1, leader changed from <none> to a95a6c699755403883b9ad8435c0ca1f (127.27.203.129). New cstate: current_term: 1 leader_uuid: "a95a6c699755403883b9ad8435c0ca1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260805 19:55:34.816177 2040 tablet_bootstrap.cc:492] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f: No bootstrap required, opened a new log
I20260805 19:55:34.816565 2040 ts_tablet_manager.cc:1403] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.003s
I20260805 19:55:34.818553 2040 raft_consensus.cc:359] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.818919 2040 raft_consensus.cc:385] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:34.819173 2040 raft_consensus.cc:740] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Initialized, Role: FOLLOWER
I20260805 19:55:34.819666 2040 consensus_queue.cc:260] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.820171 2040 raft_consensus.cc:399] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:34.820506 2040 raft_consensus.cc:493] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:34.820734 2040 raft_consensus.cc:3060] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:34.825812 2040 raft_consensus.cc:515] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.826462 2040 leader_election.cc:304] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a95a6c699755403883b9ad8435c0ca1f; no voters:
I20260805 19:55:34.826984 2040 leader_election.cc:290] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:34.827178 2042 raft_consensus.cc:2804] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:34.828068 2042 raft_consensus.cc:697] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f [term 1 LEADER]: Becoming Leader. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Running, Role: LEADER
I20260805 19:55:34.828459 2040 ts_tablet_manager.cc:1434] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260805 19:55:34.829160 2040 tablet_bootstrap.cc:492] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f: Bootstrap starting.
I20260805 19:55:34.828886 2042 consensus_queue.cc:237] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.833662 2040 tablet_bootstrap.cc:654] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:34.836767 1832 catalog_manager.cc:5697] T d1e0cb27f19e40b7a9657040eff9dccc P a95a6c699755403883b9ad8435c0ca1f reported cstate change: term changed from 0 to 1, leader changed from <none> to a95a6c699755403883b9ad8435c0ca1f (127.27.203.129). New cstate: current_term: 1 leader_uuid: "a95a6c699755403883b9ad8435c0ca1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260805 19:55:34.838742 2040 tablet_bootstrap.cc:492] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f: No bootstrap required, opened a new log
I20260805 19:55:34.839066 2040 ts_tablet_manager.cc:1403] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260805 19:55:34.840884 2040 raft_consensus.cc:359] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.841500 2040 raft_consensus.cc:385] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:34.841771 2040 raft_consensus.cc:740] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Initialized, Role: FOLLOWER
I20260805 19:55:34.842404 2040 consensus_queue.cc:260] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.842991 2040 raft_consensus.cc:399] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:34.843310 2040 raft_consensus.cc:493] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:34.843604 2040 raft_consensus.cc:3060] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:34.847786 2040 raft_consensus.cc:515] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.848351 2040 leader_election.cc:304] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a95a6c699755403883b9ad8435c0ca1f; no voters:
I20260805 19:55:34.848779 2040 leader_election.cc:290] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:34.848961 2042 raft_consensus.cc:2804] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:34.849502 2042 raft_consensus.cc:697] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f [term 1 LEADER]: Becoming Leader. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Running, Role: LEADER
I20260805 19:55:34.850133 2040 ts_tablet_manager.cc:1434] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260805 19:55:34.850270 2042 consensus_queue.cc:237] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.850787 2040 tablet_bootstrap.cc:492] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f: Bootstrap starting.
I20260805 19:55:34.856557 2040 tablet_bootstrap.cc:654] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:34.858223 1832 catalog_manager.cc:5697] T ae69e8ee92274282bf912357d2eb03c4 P a95a6c699755403883b9ad8435c0ca1f reported cstate change: term changed from 0 to 1, leader changed from <none> to a95a6c699755403883b9ad8435c0ca1f (127.27.203.129). New cstate: current_term: 1 leader_uuid: "a95a6c699755403883b9ad8435c0ca1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260805 19:55:34.861784 2040 tablet_bootstrap.cc:492] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f: No bootstrap required, opened a new log
I20260805 19:55:34.862139 2040 ts_tablet_manager.cc:1403] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20260805 19:55:34.864671 2040 raft_consensus.cc:359] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.865073 2040 raft_consensus.cc:385] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:34.865303 2040 raft_consensus.cc:740] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Initialized, Role: FOLLOWER
I20260805 19:55:34.865895 2040 consensus_queue.cc:260] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.866407 2040 raft_consensus.cc:399] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:34.866683 2040 raft_consensus.cc:493] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:34.866972 2040 raft_consensus.cc:3060] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:34.870697 2040 raft_consensus.cc:515] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.871258 2040 leader_election.cc:304] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a95a6c699755403883b9ad8435c0ca1f; no voters:
I20260805 19:55:34.871637 2040 leader_election.cc:290] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:34.871978 2042 raft_consensus.cc:2804] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:34.872488 2042 raft_consensus.cc:697] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f [term 1 LEADER]: Becoming Leader. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Running, Role: LEADER
I20260805 19:55:34.872903 2040 ts_tablet_manager.cc:1434] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f: Time spent starting tablet: real 0.010s user 0.007s sys 0.004s
I20260805 19:55:34.873435 2040 tablet_bootstrap.cc:492] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f: Bootstrap starting.
I20260805 19:55:34.873207 2042 consensus_queue.cc:237] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.878353 2040 tablet_bootstrap.cc:654] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:34.880898 1832 catalog_manager.cc:5697] T 326bc1a15eed461f84ff08c2c3e8f487 P a95a6c699755403883b9ad8435c0ca1f reported cstate change: term changed from 0 to 1, leader changed from <none> to a95a6c699755403883b9ad8435c0ca1f (127.27.203.129). New cstate: current_term: 1 leader_uuid: "a95a6c699755403883b9ad8435c0ca1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260805 19:55:34.883249 2040 tablet_bootstrap.cc:492] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f: No bootstrap required, opened a new log
I20260805 19:55:34.883591 2040 ts_tablet_manager.cc:1403] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260805 19:55:34.885349 2040 raft_consensus.cc:359] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.885749 2040 raft_consensus.cc:385] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:34.885960 2040 raft_consensus.cc:740] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Initialized, Role: FOLLOWER
I20260805 19:55:34.886720 2040 consensus_queue.cc:260] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.887285 2040 raft_consensus.cc:399] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:34.887545 2040 raft_consensus.cc:493] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:34.887841 2040 raft_consensus.cc:3060] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:34.893064 2040 raft_consensus.cc:515] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.893576 2040 leader_election.cc:304] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a95a6c699755403883b9ad8435c0ca1f; no voters:
I20260805 19:55:34.894114 2040 leader_election.cc:290] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:34.894279 2042 raft_consensus.cc:2804] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:34.894888 2042 raft_consensus.cc:697] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f [term 1 LEADER]: Becoming Leader. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Running, Role: LEADER
I20260805 19:55:34.895509 2040 ts_tablet_manager.cc:1434] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f: Time spent starting tablet: real 0.012s user 0.006s sys 0.003s
I20260805 19:55:34.895588 2042 consensus_queue.cc:237] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.896220 2040 tablet_bootstrap.cc:492] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f: Bootstrap starting.
I20260805 19:55:34.902420 2040 tablet_bootstrap.cc:654] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:34.902431 1832 catalog_manager.cc:5697] T eefe9753c3a44c08b8a678402cbd7634 P a95a6c699755403883b9ad8435c0ca1f reported cstate change: term changed from 0 to 1, leader changed from <none> to a95a6c699755403883b9ad8435c0ca1f (127.27.203.129). New cstate: current_term: 1 leader_uuid: "a95a6c699755403883b9ad8435c0ca1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260805 19:55:34.907325 2040 tablet_bootstrap.cc:492] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f: No bootstrap required, opened a new log
I20260805 19:55:34.907739 2040 ts_tablet_manager.cc:1403] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260805 19:55:34.909869 2040 raft_consensus.cc:359] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.910338 2040 raft_consensus.cc:385] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:34.910583 2040 raft_consensus.cc:740] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Initialized, Role: FOLLOWER
I20260805 19:55:34.911144 2040 consensus_queue.cc:260] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.911528 2040 raft_consensus.cc:399] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:34.911695 2040 raft_consensus.cc:493] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:34.911877 2040 raft_consensus.cc:3060] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:34.915318 2040 raft_consensus.cc:515] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.915736 2040 leader_election.cc:304] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a95a6c699755403883b9ad8435c0ca1f; no voters:
I20260805 19:55:34.916189 2040 leader_election.cc:290] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:34.916386 2042 raft_consensus.cc:2804] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:34.916814 2042 raft_consensus.cc:697] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f [term 1 LEADER]: Becoming Leader. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Running, Role: LEADER
I20260805 19:55:34.917511 2040 ts_tablet_manager.cc:1434] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f: Time spent starting tablet: real 0.009s user 0.005s sys 0.003s
I20260805 19:55:34.917510 2042 consensus_queue.cc:237] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.918223 2040 tablet_bootstrap.cc:492] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f: Bootstrap starting.
I20260805 19:55:34.922945 2040 tablet_bootstrap.cc:654] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:34.925590 1832 catalog_manager.cc:5697] T 32d15d36ebb54cc7b17dd8eb426e8e63 P a95a6c699755403883b9ad8435c0ca1f reported cstate change: term changed from 0 to 1, leader changed from <none> to a95a6c699755403883b9ad8435c0ca1f (127.27.203.129). New cstate: current_term: 1 leader_uuid: "a95a6c699755403883b9ad8435c0ca1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260805 19:55:34.928395 2040 tablet_bootstrap.cc:492] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f: No bootstrap required, opened a new log
I20260805 19:55:34.928701 2040 ts_tablet_manager.cc:1403] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260805 19:55:34.930456 2040 raft_consensus.cc:359] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.930941 2040 raft_consensus.cc:385] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:34.931205 2040 raft_consensus.cc:740] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Initialized, Role: FOLLOWER
I20260805 19:55:34.931842 2040 consensus_queue.cc:260] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.932432 2040 raft_consensus.cc:399] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:34.932708 2040 raft_consensus.cc:493] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:34.933017 2040 raft_consensus.cc:3060] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:34.938928 2040 raft_consensus.cc:515] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.939540 2040 leader_election.cc:304] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a95a6c699755403883b9ad8435c0ca1f; no voters:
I20260805 19:55:34.940150 2040 leader_election.cc:290] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:34.940804 2043 raft_consensus.cc:2804] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:34.941263 2043 raft_consensus.cc:697] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f [term 1 LEADER]: Becoming Leader. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Running, Role: LEADER
I20260805 19:55:34.942011 2043 consensus_queue.cc:237] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.946305 2040 ts_tablet_manager.cc:1434] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f: Time spent starting tablet: real 0.017s user 0.013s sys 0.000s
I20260805 19:55:34.947057 2040 tablet_bootstrap.cc:492] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f: Bootstrap starting.
I20260805 19:55:34.949568 1832 catalog_manager.cc:5697] T a4ce9727713944f2b877b4216cad1ec4 P a95a6c699755403883b9ad8435c0ca1f reported cstate change: term changed from 0 to 1, leader changed from <none> to a95a6c699755403883b9ad8435c0ca1f (127.27.203.129). New cstate: current_term: 1 leader_uuid: "a95a6c699755403883b9ad8435c0ca1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260805 19:55:34.952543 2040 tablet_bootstrap.cc:654] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:34.957796 2040 tablet_bootstrap.cc:492] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f: No bootstrap required, opened a new log
I20260805 19:55:34.958181 2040 ts_tablet_manager.cc:1403] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260805 19:55:34.960366 2040 raft_consensus.cc:359] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.960873 2040 raft_consensus.cc:385] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:34.961122 2040 raft_consensus.cc:740] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Initialized, Role: FOLLOWER
I20260805 19:55:34.961706 2040 consensus_queue.cc:260] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.962271 2040 raft_consensus.cc:399] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:34.962523 2040 raft_consensus.cc:493] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:34.962783 2040 raft_consensus.cc:3060] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:34.967670 2040 raft_consensus.cc:515] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.968355 2040 leader_election.cc:304] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a95a6c699755403883b9ad8435c0ca1f; no voters:
I20260805 19:55:34.968868 2040 leader_election.cc:290] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:34.968997 2042 raft_consensus.cc:2804] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:34.969419 2042 raft_consensus.cc:697] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f [term 1 LEADER]: Becoming Leader. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Running, Role: LEADER
I20260805 19:55:34.970093 2042 consensus_queue.cc:237] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.970748 2040 ts_tablet_manager.cc:1434] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260805 19:55:34.972085 2040 tablet_bootstrap.cc:492] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f: Bootstrap starting.
I20260805 19:55:34.977957 2040 tablet_bootstrap.cc:654] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:34.978816 1832 catalog_manager.cc:5697] T 3f58ea38c4d74f088372ba36ca0ae6d5 P a95a6c699755403883b9ad8435c0ca1f reported cstate change: term changed from 0 to 1, leader changed from <none> to a95a6c699755403883b9ad8435c0ca1f (127.27.203.129). New cstate: current_term: 1 leader_uuid: "a95a6c699755403883b9ad8435c0ca1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260805 19:55:34.983556 2040 tablet_bootstrap.cc:492] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f: No bootstrap required, opened a new log
I20260805 19:55:34.983958 2040 ts_tablet_manager.cc:1403] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f: Time spent bootstrapping tablet: real 0.012s user 0.012s sys 0.000s
I20260805 19:55:34.985947 2040 raft_consensus.cc:359] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.986456 2040 raft_consensus.cc:385] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:34.986686 2040 raft_consensus.cc:740] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Initialized, Role: FOLLOWER
I20260805 19:55:34.987308 2040 consensus_queue.cc:260] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.987859 2040 raft_consensus.cc:399] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:34.988169 2040 raft_consensus.cc:493] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:34.988427 2040 raft_consensus.cc:3060] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:34.992527 2040 raft_consensus.cc:515] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.993187 2040 leader_election.cc:304] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a95a6c699755403883b9ad8435c0ca1f; no voters:
I20260805 19:55:34.993706 2040 leader_election.cc:290] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:34.993837 2042 raft_consensus.cc:2804] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:34.994231 2042 raft_consensus.cc:697] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f [term 1 LEADER]: Becoming Leader. State: Replica: a95a6c699755403883b9ad8435c0ca1f, State: Running, Role: LEADER
I20260805 19:55:34.994891 2042 consensus_queue.cc:237] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } }
I20260805 19:55:34.995201 2040 ts_tablet_manager.cc:1434] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20260805 19:55:35.002666 1832 catalog_manager.cc:5697] T 65f0ddb3fb32490aa4d43a8de8b8d2bf P a95a6c699755403883b9ad8435c0ca1f reported cstate change: term changed from 0 to 1, leader changed from <none> to a95a6c699755403883b9ad8435c0ca1f (127.27.203.129). New cstate: current_term: 1 leader_uuid: "a95a6c699755403883b9ad8435c0ca1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a95a6c699755403883b9ad8435c0ca1f" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260805 19:55:37.867017 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 1893
I20260805 19:55:37.909448 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 1797
2026-08-05T19:55:37Z chronyd exiting
[ OK ] ListTableCliParamTest.ListTabletWithPartitionInfo/6 (8643 ms)
[----------] 1 test from ListTableCliParamTest (8643 ms total)
[----------] 1 test from IsSecure/SecureClusterAdminCliParamTest
[ RUN ] IsSecure/SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns/0
2026-08-05T19:55:38Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-05T19:55:38Z Disabled control of system clock
I20260805 19:55:38.035080 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:42149
--webserver_interface=127.27.203.190
--webserver_port=0
--builtin_ntp_servers=127.27.203.148:43627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.203.190:42149 with env {}
W20260805 19:55:38.371297 2091 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:38.372027 2091 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:38.372515 2091 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:38.407455 2091 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 19:55:38.407771 2091 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:38.408077 2091 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 19:55:38.408305 2091 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260805 19:55:38.448262 2091 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:43627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.203.190:42149
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:42149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.203.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:38.449882 2091 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:38.451699 2091 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:38.464504 2098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:38.466048 2099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:39.735293 2101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:39.737668 2100 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1267 milliseconds
I20260805 19:55:39.737783 2091 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:55:39.739161 2091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:39.741950 2091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:39.743355 2091 hybrid_clock.cc:648] HybridClock initialized: now 1785959739743319 us; error 38 us; skew 500 ppm
I20260805 19:55:39.744354 2091 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:39.751372 2091 webserver.cc:533] Webserver started at http://127.27.203.190:36165/ using document root <none> and password file <none>
I20260805 19:55:39.752526 2091 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:39.752790 2091 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:39.753295 2091 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:39.757853 2091 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data/instance:
uuid: "aec23b04cba34379b6f8d75b4e4e49e3"
format_stamp: "Formatted at 2026-08-05 19:55:39 on dist-test-slave-27sr"
I20260805 19:55:39.759078 2091 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal/instance:
uuid: "aec23b04cba34379b6f8d75b4e4e49e3"
format_stamp: "Formatted at 2026-08-05 19:55:39 on dist-test-slave-27sr"
I20260805 19:55:39.767041 2091 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s
I20260805 19:55:39.773469 2108 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:39.774858 2091 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260805 19:55:39.775321 2091 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal
uuid: "aec23b04cba34379b6f8d75b4e4e49e3"
format_stamp: "Formatted at 2026-08-05 19:55:39 on dist-test-slave-27sr"
I20260805 19:55:39.775727 2091 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:39.834192 2091 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:39.836005 2091 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:39.836513 2091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:39.914557 2091 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.190:42149
I20260805 19:55:39.914687 2159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.190:42149 every 8 connection(s)
I20260805 19:55:39.917611 2091 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data/info.pb
I20260805 19:55:39.918900 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 2091
I20260805 19:55:39.919557 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal/instance
I20260805 19:55:39.925802 2160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:39.951659 2160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3: Bootstrap starting.
I20260805 19:55:39.957837 2160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:39.959666 2160 log.cc:826] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:39.964869 2160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3: No bootstrap required, opened a new log
I20260805 19:55:39.984952 2160 raft_consensus.cc:359] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec23b04cba34379b6f8d75b4e4e49e3" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42149 } }
I20260805 19:55:39.985862 2160 raft_consensus.cc:385] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:39.986207 2160 raft_consensus.cc:740] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec23b04cba34379b6f8d75b4e4e49e3, State: Initialized, Role: FOLLOWER
I20260805 19:55:39.987149 2160 consensus_queue.cc:260] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec23b04cba34379b6f8d75b4e4e49e3" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42149 } }
I20260805 19:55:39.987682 2160 raft_consensus.cc:399] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:39.988013 2160 raft_consensus.cc:493] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:39.988313 2160 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:39.992863 2160 raft_consensus.cc:515] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec23b04cba34379b6f8d75b4e4e49e3" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42149 } }
I20260805 19:55:39.993888 2160 leader_election.cc:304] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aec23b04cba34379b6f8d75b4e4e49e3; no voters:
I20260805 19:55:39.996033 2160 leader_election.cc:290] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:39.996743 2166 raft_consensus.cc:2804] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:39.999226 2166 raft_consensus.cc:697] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [term 1 LEADER]: Becoming Leader. State: Replica: aec23b04cba34379b6f8d75b4e4e49e3, State: Running, Role: LEADER
I20260805 19:55:40.000169 2166 consensus_queue.cc:237] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec23b04cba34379b6f8d75b4e4e49e3" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42149 } }
I20260805 19:55:40.001166 2160 sys_catalog.cc:565] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 19:55:40.010921 2168 sys_catalog.cc:455] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aec23b04cba34379b6f8d75b4e4e49e3. Latest consensus state: current_term: 1 leader_uuid: "aec23b04cba34379b6f8d75b4e4e49e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec23b04cba34379b6f8d75b4e4e49e3" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42149 } } }
I20260805 19:55:40.012138 2168 sys_catalog.cc:458] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [sys.catalog]: This master's current role is: LEADER
I20260805 19:55:40.011634 2167 sys_catalog.cc:455] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aec23b04cba34379b6f8d75b4e4e49e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec23b04cba34379b6f8d75b4e4e49e3" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42149 } } }
I20260805 19:55:40.014048 2167 sys_catalog.cc:458] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3 [sys.catalog]: This master's current role is: LEADER
I20260805 19:55:40.015565 2175 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260805 19:55:40.029443 2175 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260805 19:55:40.048987 2175 catalog_manager.cc:1383] Generated new cluster ID: ee757ce557e449de877b49003d12f1a1
I20260805 19:55:40.049352 2175 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260805 19:55:40.074602 2175 catalog_manager.cc:1406] Generated new certificate authority record
I20260805 19:55:40.076414 2175 catalog_manager.cc:1540] Loading token signing keys...
I20260805 19:55:40.106843 2175 catalog_manager.cc:6070] T 00000000000000000000000000000000 P aec23b04cba34379b6f8d75b4e4e49e3: Generated new TSK 0
I20260805 19:55:40.108031 2175 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260805 19:55:40.124117 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.129:0
--local_ip_for_outbound_sockets=127.27.203.129
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42149
--builtin_ntp_servers=127.27.203.148:43627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20260805 19:55:40.488154 2186 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:40.488777 2186 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:40.489279 2186 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:40.524507 2186 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:40.525382 2186 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.129
I20260805 19:55:40.565454 2186 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:43627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.203.129
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42149
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:40.566921 2186 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:40.568804 2186 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:40.582679 2192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:41.988247 2191 debug-util.cc:398] Leaking SignalData structure 0x7b080002ede0 after lost signal to thread 2186
W20260805 19:55:42.182901 2191 kernel_stack_watchdog.cc:198] Thread 2186 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 402ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260805 19:55:42.188206 2195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:40.584162 2193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:42.183350 2186 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.601s user 0.498s sys 0.920s
W20260805 19:55:42.192118 2186 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.610s user 0.500s sys 0.923s
I20260805 19:55:42.192428 2186 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
W20260805 19:55:42.191331 2194 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1604 milliseconds
I20260805 19:55:42.196866 2186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:42.199123 2186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:42.200611 2186 hybrid_clock.cc:648] HybridClock initialized: now 1785959742200569 us; error 49 us; skew 500 ppm
I20260805 19:55:42.201548 2186 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:42.208313 2186 webserver.cc:533] Webserver started at http://127.27.203.129:45683/ using document root <none> and password file <none>
I20260805 19:55:42.209362 2186 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:42.209621 2186 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:42.210112 2186 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:42.214781 2186 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data/instance:
uuid: "218c5471fd9e462cbff7b5031215ff28"
format_stamp: "Formatted at 2026-08-05 19:55:42 on dist-test-slave-27sr"
I20260805 19:55:42.216012 2186 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/wal/instance:
uuid: "218c5471fd9e462cbff7b5031215ff28"
format_stamp: "Formatted at 2026-08-05 19:55:42 on dist-test-slave-27sr"
I20260805 19:55:42.224177 2186 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.005s sys 0.002s
I20260805 19:55:42.230288 2203 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:42.231663 2186 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.001s
I20260805 19:55:42.232120 2186 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/wal
uuid: "218c5471fd9e462cbff7b5031215ff28"
format_stamp: "Formatted at 2026-08-05 19:55:42 on dist-test-slave-27sr"
I20260805 19:55:42.232514 2186 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:42.301139 2186 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:42.302990 2186 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:42.303473 2186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:42.306432 2186 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:55:42.311761 2186 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:55:42.312119 2186 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260805 19:55:42.312556 2186 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:55:42.312783 2186 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260805 19:55:42.484469 2186 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.129:45341
I20260805 19:55:42.484539 2321 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.129:45341 every 8 connection(s)
I20260805 19:55:42.489034 2186 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data/info.pb
I20260805 19:55:42.497956 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 2186
I20260805 19:55:42.498540 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/wal/instance
I20260805 19:55:42.505141 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.130:0
--local_ip_for_outbound_sockets=127.27.203.130
--webserver_interface=127.27.203.130
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42149
--builtin_ntp_servers=127.27.203.148:43627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260805 19:55:42.519855 2322 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42149
I20260805 19:55:42.520498 2322 heartbeater.cc:461] Registering TS with master...
I20260805 19:55:42.522199 2322 heartbeater.cc:507] Master 127.27.203.190:42149 requested a full tablet report, sending...
I20260805 19:55:42.526031 2125 ts_manager.cc:194] Registered new tserver with Master: 218c5471fd9e462cbff7b5031215ff28 (127.27.203.129:45341)
I20260805 19:55:42.529178 2125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.129:49713
W20260805 19:55:42.846180 2326 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:42.846879 2326 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:42.847532 2326 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:42.883471 2326 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:42.884433 2326 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.130
I20260805 19:55:42.925076 2326 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:43627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.203.130
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42149
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:42.926599 2326 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:42.928541 2326 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:42.944931 2332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:55:43.534642 2322 heartbeater.cc:499] Master 127.27.203.190:42149 was elected leader, sending a full tablet report...
W20260805 19:55:44.349326 2331 debug-util.cc:398] Leaking SignalData structure 0x7b080002ede0 after lost signal to thread 2326
W20260805 19:55:44.794075 2331 kernel_stack_watchdog.cc:198] Thread 2326 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 401ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260805 19:55:42.945863 2333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:44.795030 2326 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.850s user 0.687s sys 1.162s
W20260805 19:55:44.795548 2326 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.851s user 0.688s sys 1.162s
W20260805 19:55:44.795861 2334 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1849 milliseconds
W20260805 19:55:44.797453 2335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:55:44.797359 2326 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:55:44.800380 2326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:44.802656 2326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:44.804041 2326 hybrid_clock.cc:648] HybridClock initialized: now 1785959744803997 us; error 58 us; skew 500 ppm
I20260805 19:55:44.804982 2326 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:44.812188 2326 webserver.cc:533] Webserver started at http://127.27.203.130:33423/ using document root <none> and password file <none>
I20260805 19:55:44.813300 2326 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:44.813526 2326 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:44.814128 2326 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:44.819252 2326 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data/instance:
uuid: "f32553325fab49f4be873dc49204a278"
format_stamp: "Formatted at 2026-08-05 19:55:44 on dist-test-slave-27sr"
I20260805 19:55:44.820693 2326 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/wal/instance:
uuid: "f32553325fab49f4be873dc49204a278"
format_stamp: "Formatted at 2026-08-05 19:55:44 on dist-test-slave-27sr"
I20260805 19:55:44.829613 2326 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.005s sys 0.003s
I20260805 19:55:44.836056 2343 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:44.837373 2326 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260805 19:55:44.837764 2326 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/wal
uuid: "f32553325fab49f4be873dc49204a278"
format_stamp: "Formatted at 2026-08-05 19:55:44 on dist-test-slave-27sr"
I20260805 19:55:44.838138 2326 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:44.901986 2326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:44.903784 2326 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:44.904366 2326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:44.907166 2326 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:55:44.911629 2326 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:55:44.911908 2326 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:44.912233 2326 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:55:44.912447 2326 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:45.060853 2326 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.130:35261
I20260805 19:55:45.061053 2457 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.130:35261 every 8 connection(s)
I20260805 19:55:45.063886 2326 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data/info.pb
I20260805 19:55:45.071775 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 2326
I20260805 19:55:45.072335 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/wal/instance
I20260805 19:55:45.079514 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.131:0
--local_ip_for_outbound_sockets=127.27.203.131
--webserver_interface=127.27.203.131
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42149
--builtin_ntp_servers=127.27.203.148:43627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260805 19:55:45.094579 2458 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42149
I20260805 19:55:45.095098 2458 heartbeater.cc:461] Registering TS with master...
I20260805 19:55:45.096372 2458 heartbeater.cc:507] Master 127.27.203.190:42149 requested a full tablet report, sending...
I20260805 19:55:45.099030 2125 ts_manager.cc:194] Registered new tserver with Master: f32553325fab49f4be873dc49204a278 (127.27.203.130:35261)
I20260805 19:55:45.101135 2125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.130:49001
W20260805 19:55:45.415773 2463 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:45.416375 2463 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:45.416818 2463 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:45.451632 2463 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:45.452553 2463 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.131
I20260805 19:55:45.490986 2463 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:43627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.203.131
--webserver_port=0
--tserver_master_addrs=127.27.203.190:42149
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:45.492570 2463 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:45.494350 2463 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:45.507223 2470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:55:46.105628 2458 heartbeater.cc:499] Master 127.27.203.190:42149 was elected leader, sending a full tablet report...
W20260805 19:55:45.509639 2471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:46.740742 2473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:46.743120 2472 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1229 milliseconds
I20260805 19:55:46.743207 2463 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:55:46.744602 2463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:46.747470 2463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:46.748939 2463 hybrid_clock.cc:648] HybridClock initialized: now 1785959746748903 us; error 53 us; skew 500 ppm
I20260805 19:55:46.749838 2463 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:46.756946 2463 webserver.cc:533] Webserver started at http://127.27.203.131:44219/ using document root <none> and password file <none>
I20260805 19:55:46.757979 2463 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:46.758222 2463 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:46.758787 2463 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:46.763347 2463 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data/instance:
uuid: "e9b8c52d3be04c2b9b90307d8cd3b749"
format_stamp: "Formatted at 2026-08-05 19:55:46 on dist-test-slave-27sr"
I20260805 19:55:46.764539 2463 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/wal/instance:
uuid: "e9b8c52d3be04c2b9b90307d8cd3b749"
format_stamp: "Formatted at 2026-08-05 19:55:46 on dist-test-slave-27sr"
I20260805 19:55:46.773562 2463 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.005s sys 0.004s
I20260805 19:55:46.779704 2482 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:46.781132 2463 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260805 19:55:46.781576 2463 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/wal
uuid: "e9b8c52d3be04c2b9b90307d8cd3b749"
format_stamp: "Formatted at 2026-08-05 19:55:46 on dist-test-slave-27sr"
I20260805 19:55:46.782002 2463 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:46.849053 2463 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:46.850821 2463 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:46.851364 2463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:46.854346 2463 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:55:46.859189 2463 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 19:55:46.859460 2463 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:46.859766 2463 ts_tablet_manager.cc:616] Registered 0 tablets
I20260805 19:55:46.859994 2463 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260805 19:55:47.037456 2463 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.131:39261
I20260805 19:55:47.037559 2595 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.131:39261 every 8 connection(s)
I20260805 19:55:47.040421 2463 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data/info.pb
I20260805 19:55:47.050401 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 2463
I20260805 19:55:47.051179 28462 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/wal/instance
I20260805 19:55:47.065332 2596 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42149
I20260805 19:55:47.065816 2596 heartbeater.cc:461] Registering TS with master...
I20260805 19:55:47.067114 2596 heartbeater.cc:507] Master 127.27.203.190:42149 requested a full tablet report, sending...
I20260805 19:55:47.069875 2125 ts_manager.cc:194] Registered new tserver with Master: e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131:39261)
I20260805 19:55:47.072070 2125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.131:38491
I20260805 19:55:47.074687 28462 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260805 19:55:47.152370 2125 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48534:
name: "rebuild_and_add_columns"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 19:55:47.154949 2125 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebuild_and_add_columns in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 19:55:47.222451 2530 tablet_service.cc:1511] Processing CreateTablet for tablet 05016693f14e4d51a9d83b60cfca35f0 (DEFAULT_TABLE table=rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:55:47.222833 2391 tablet_service.cc:1511] Processing CreateTablet for tablet 05016693f14e4d51a9d83b60cfca35f0 (DEFAULT_TABLE table=rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:55:47.222833 2255 tablet_service.cc:1511] Processing CreateTablet for tablet 05016693f14e4d51a9d83b60cfca35f0 (DEFAULT_TABLE table=rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 19:55:47.224730 2530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05016693f14e4d51a9d83b60cfca35f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:47.224761 2255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05016693f14e4d51a9d83b60cfca35f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:47.224767 2391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05016693f14e4d51a9d83b60cfca35f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:47.248138 2622 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: Bootstrap starting.
I20260805 19:55:47.252449 2624 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28: Bootstrap starting.
I20260805 19:55:47.255319 2623 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: Bootstrap starting.
I20260805 19:55:47.256023 2622 tablet_bootstrap.cc:654] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:47.258574 2622 log.cc:826] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:47.262216 2624 tablet_bootstrap.cc:654] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:47.262415 2623 tablet_bootstrap.cc:654] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:47.264482 2623 log.cc:826] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:47.264715 2624 log.cc:826] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:47.265004 2622 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: No bootstrap required, opened a new log
I20260805 19:55:47.265520 2622 ts_tablet_manager.cc:1403] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: Time spent bootstrapping tablet: real 0.018s user 0.014s sys 0.002s
I20260805 19:55:47.270232 2624 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28: No bootstrap required, opened a new log
I20260805 19:55:47.270437 2623 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: No bootstrap required, opened a new log
I20260805 19:55:47.270748 2624 ts_tablet_manager.cc:1403] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.005s
I20260805 19:55:47.270949 2623 ts_tablet_manager.cc:1403] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.005s
I20260805 19:55:47.291011 2624 raft_consensus.cc:359] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:55:47.292040 2624 raft_consensus.cc:385] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:47.292387 2624 raft_consensus.cc:740] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218c5471fd9e462cbff7b5031215ff28, State: Initialized, Role: FOLLOWER
I20260805 19:55:47.293457 2624 consensus_queue.cc:260] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:55:47.294721 2622 raft_consensus.cc:359] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:55:47.296048 2622 raft_consensus.cc:385] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:47.296432 2622 raft_consensus.cc:740] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9b8c52d3be04c2b9b90307d8cd3b749, State: Initialized, Role: FOLLOWER
I20260805 19:55:47.297920 2624 ts_tablet_manager.cc:1434] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28: Time spent starting tablet: real 0.027s user 0.028s sys 0.000s
I20260805 19:55:47.297463 2622 consensus_queue.cc:260] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:55:47.300011 2623 raft_consensus.cc:359] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:55:47.300918 2596 heartbeater.cc:499] Master 127.27.203.190:42149 was elected leader, sending a full tablet report...
I20260805 19:55:47.300917 2623 raft_consensus.cc:385] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:47.301210 2623 raft_consensus.cc:740] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f32553325fab49f4be873dc49204a278, State: Initialized, Role: FOLLOWER
I20260805 19:55:47.302356 2622 ts_tablet_manager.cc:1434] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: Time spent starting tablet: real 0.037s user 0.034s sys 0.002s
I20260805 19:55:47.302443 2623 consensus_queue.cc:260] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:55:47.306648 2623 ts_tablet_manager.cc:1434] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: Time spent starting tablet: real 0.035s user 0.034s sys 0.002s
W20260805 19:55:47.323208 2459 tablet.cc:2406] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 19:55:47.439021 2631 raft_consensus.cc:493] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 19:55:47.439638 2631 raft_consensus.cc:515] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:55:47.442487 2631 leader_election.cc:290] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131:39261), 218c5471fd9e462cbff7b5031215ff28 (127.27.203.129:45341)
I20260805 19:55:47.458290 2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05016693f14e4d51a9d83b60cfca35f0" candidate_uuid: "f32553325fab49f4be873dc49204a278" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218c5471fd9e462cbff7b5031215ff28" is_pre_election: true
I20260805 19:55:47.458494 2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05016693f14e4d51a9d83b60cfca35f0" candidate_uuid: "f32553325fab49f4be873dc49204a278" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" is_pre_election: true
I20260805 19:55:47.459153 2275 raft_consensus.cc:2468] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f32553325fab49f4be873dc49204a278 in term 0.
I20260805 19:55:47.459443 2551 raft_consensus.cc:2468] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f32553325fab49f4be873dc49204a278 in term 0.
I20260805 19:55:47.460695 2346 leader_election.cc:304] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218c5471fd9e462cbff7b5031215ff28, f32553325fab49f4be873dc49204a278; no voters:
I20260805 19:55:47.461503 2631 raft_consensus.cc:2804] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 19:55:47.461793 2631 raft_consensus.cc:493] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 19:55:47.462102 2631 raft_consensus.cc:3060] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:47.466688 2631 raft_consensus.cc:515] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:55:47.468477 2631 leader_election.cc:290] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [CANDIDATE]: Term 1 election: Requested vote from peers e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131:39261), 218c5471fd9e462cbff7b5031215ff28 (127.27.203.129:45341)
I20260805 19:55:47.469316 2551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05016693f14e4d51a9d83b60cfca35f0" candidate_uuid: "f32553325fab49f4be873dc49204a278" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749"
I20260805 19:55:47.469620 2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05016693f14e4d51a9d83b60cfca35f0" candidate_uuid: "f32553325fab49f4be873dc49204a278" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218c5471fd9e462cbff7b5031215ff28"
I20260805 19:55:47.469789 2551 raft_consensus.cc:3060] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:47.470152 2275 raft_consensus.cc:3060] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:47.474669 2551 raft_consensus.cc:2468] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f32553325fab49f4be873dc49204a278 in term 1.
I20260805 19:55:47.474817 2275 raft_consensus.cc:2468] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f32553325fab49f4be873dc49204a278 in term 1.
I20260805 19:55:47.475977 2345 leader_election.cc:304] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9b8c52d3be04c2b9b90307d8cd3b749, f32553325fab49f4be873dc49204a278; no voters:
I20260805 19:55:47.476739 2631 raft_consensus.cc:2804] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:47.478463 2631 raft_consensus.cc:697] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 1 LEADER]: Becoming Leader. State: Replica: f32553325fab49f4be873dc49204a278, State: Running, Role: LEADER
I20260805 19:55:47.479710 2631 consensus_queue.cc:237] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:55:47.493006 2123 catalog_manager.cc:5697] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 reported cstate change: term changed from 0 to 1, leader changed from <none> to f32553325fab49f4be873dc49204a278 (127.27.203.130). New cstate: current_term: 1 leader_uuid: "f32553325fab49f4be873dc49204a278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } health_report { overall_health: UNKNOWN } } }
W20260805 19:55:47.501820 2323 tablet.cc:2406] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 19:55:47.545943 2597 tablet.cc:2406] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 19:55:47.601069 2551 raft_consensus.cc:1275] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749 [term 1 FOLLOWER]: Refusing update from remote peer f32553325fab49f4be873dc49204a278: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 19:55:47.601069 2275 raft_consensus.cc:1275] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 1 FOLLOWER]: Refusing update from remote peer f32553325fab49f4be873dc49204a278: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 19:55:47.603235 2634 consensus_queue.cc:1048] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260805 19:55:47.604332 2631 consensus_queue.cc:1048] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 19:55:47.637349 2641 mvcc.cc:204] Tried to move back new op lower bound from 7315291126154354688 to 7315291125685477376. Current Snapshot: MvccSnapshot[applied={T|T < 7315291126154354688}]
I20260805 19:55:47.644325 2642 mvcc.cc:204] Tried to move back new op lower bound from 7315291126154354688 to 7315291125685477376. Current Snapshot: MvccSnapshot[applied={T|T < 7315291126154354688}]
I20260805 19:55:52.735529 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 2091
W20260805 19:55:52.766711 2206 connection.cc:573] client connection to 127.27.203.190:42149 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260805 19:55:52.766858 2345 connection.cc:573] client connection to 127.27.203.190:42149 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260805 19:55:52.768003 2458 heartbeater.cc:646] Failed to heartbeat to 127.27.203.190:42149 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260805 19:55:52.768083 2322 heartbeater.cc:646] Failed to heartbeat to 127.27.203.190:42149 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260805 19:55:53.156515 2671 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:53.157142 2671 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:53.706202 2596 heartbeater.cc:646] Failed to heartbeat to 127.27.203.190:42149 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.203.190:42149: connect: Connection refused (error 111)
W20260805 19:55:54.474484 2671 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.237s user 0.484s sys 0.750s
W20260805 19:55:54.474869 2671 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.237s user 0.484s sys 0.750s
I20260805 19:55:54.522933 2671 master_rebuilder.cc:266] Preserving original table_id 'a9c503127eb448119afc3433db1e18cc' for table 'rebuild_and_add_columns'
I20260805 19:55:54.584146 2671 minidump.cc:252] Setting minidump size limit to 20M
I20260805 19:55:54.586856 2671 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:54.588255 2671 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:54.600127 2702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:54.601488 2703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:55:54.781615 2671 server_base.cc:1061] running on GCE node
W20260805 19:55:54.781613 2705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:55:54.783129 2671 hybrid_clock.cc:584] initializing the hybrid clock with 'system' time source
I20260805 19:55:54.783579 2671 hybrid_clock.cc:648] HybridClock initialized: now 1785959754783554 us; error 49422 us; skew 500 ppm
I20260805 19:55:54.784335 2671 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:54.790848 2671 webserver.cc:533] Webserver started at http://0.0.0.0:33117/ using document root <none> and password file <none>
I20260805 19:55:54.791721 2671 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:54.792001 2671 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:54.792647 2671 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 19:55:54.797178 2671 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data/instance:
uuid: "63804ddc17f840c48cc9a0141a824d1c"
format_stamp: "Formatted at 2026-08-05 19:55:54 on dist-test-slave-27sr"
I20260805 19:55:54.798322 2671 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal/instance:
uuid: "63804ddc17f840c48cc9a0141a824d1c"
format_stamp: "Formatted at 2026-08-05 19:55:54 on dist-test-slave-27sr"
I20260805 19:55:54.805270 2671 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260805 19:55:54.810324 2713 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:54.811321 2671 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260805 19:55:54.811698 2671 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal
uuid: "63804ddc17f840c48cc9a0141a824d1c"
format_stamp: "Formatted at 2026-08-05 19:55:54 on dist-test-slave-27sr"
I20260805 19:55:54.812132 2671 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:54.877144 2671 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:54.878927 2671 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:54.879474 2671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:54.884667 2671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 19:55:54.900398 2671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c: Bootstrap starting.
I20260805 19:55:54.906162 2671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c: Neither blocks nor log segments found. Creating new log.
I20260805 19:55:54.908176 2671 log.cc:826] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:54.912879 2671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c: No bootstrap required, opened a new log
I20260805 19:55:54.931047 2671 raft_consensus.cc:359] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63804ddc17f840c48cc9a0141a824d1c" member_type: VOTER }
I20260805 19:55:54.931979 2671 raft_consensus.cc:385] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 19:55:54.932380 2671 raft_consensus.cc:740] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63804ddc17f840c48cc9a0141a824d1c, State: Initialized, Role: FOLLOWER
I20260805 19:55:54.933526 2671 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63804ddc17f840c48cc9a0141a824d1c" member_type: VOTER }
I20260805 19:55:54.934396 2671 raft_consensus.cc:399] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:54.934837 2671 raft_consensus.cc:493] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:54.935328 2671 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 0 FOLLOWER]: Advancing to term 1
I20260805 19:55:54.941107 2671 raft_consensus.cc:515] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63804ddc17f840c48cc9a0141a824d1c" member_type: VOTER }
I20260805 19:55:54.941953 2671 leader_election.cc:304] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63804ddc17f840c48cc9a0141a824d1c; no voters:
I20260805 19:55:54.943979 2671 leader_election.cc:290] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 19:55:54.944273 2720 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 1 FOLLOWER]: Leader election won for term 1
I20260805 19:55:54.947147 2720 raft_consensus.cc:697] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 1 LEADER]: Becoming Leader. State: Replica: 63804ddc17f840c48cc9a0141a824d1c, State: Running, Role: LEADER
I20260805 19:55:54.948221 2720 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63804ddc17f840c48cc9a0141a824d1c" member_type: VOTER }
I20260805 19:55:54.955690 2722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63804ddc17f840c48cc9a0141a824d1c. Latest consensus state: current_term: 1 leader_uuid: "63804ddc17f840c48cc9a0141a824d1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63804ddc17f840c48cc9a0141a824d1c" member_type: VOTER } }
I20260805 19:55:54.956451 2722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [sys.catalog]: This master's current role is: LEADER
I20260805 19:55:54.955909 2721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63804ddc17f840c48cc9a0141a824d1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63804ddc17f840c48cc9a0141a824d1c" member_type: VOTER } }
I20260805 19:55:54.956960 2721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [sys.catalog]: This master's current role is: LEADER
I20260805 19:55:54.969916 2671 tablet_replica.cc:333] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c: stopping tablet replica
I20260805 19:55:54.970489 2671 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 1 LEADER]: Raft consensus shutting down.
I20260805 19:55:54.971107 2671 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 19:55:54.973572 2671 master.cc:562] Master@0.0.0.0:7051 shutting down...
W20260805 19:55:54.974110 2671 acceptor_pool.cc:196] Could not shut down acceptor socket on 0.0.0.0:7051: Network error: shutdown error: Transport endpoint is not connected (error 107)
I20260805 19:55:55.006108 2671 master.cc:584] Master@0.0.0.0:7051 shutdown complete.
I20260805 19:55:56.039758 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 2186
I20260805 19:55:56.087224 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 2326
I20260805 19:55:56.135301 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 2463
I20260805 19:55:56.176271 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:42149
--webserver_interface=127.27.203.190
--webserver_port=36165
--builtin_ntp_servers=127.27.203.148:43627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.203.190:42149 with env {}
W20260805 19:55:56.520448 2730 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:56.521121 2730 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:56.521654 2730 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:56.562105 2730 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 19:55:56.562479 2730 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:56.562763 2730 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 19:55:56.563040 2730 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260805 19:55:56.603814 2730 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:43627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.203.190:42149
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.203.190:42149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.203.190
--webserver_port=36165
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:56.605326 2730 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:56.607234 2730 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:56.619354 2737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:56.621134 2738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:56.625283 2740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:57.968501 2739 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1343 milliseconds
I20260805 19:55:57.968641 2730 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:55:57.970173 2730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:57.973317 2730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:57.974735 2730 hybrid_clock.cc:648] HybridClock initialized: now 1785959757974694 us; error 81 us; skew 500 ppm
I20260805 19:55:57.975698 2730 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:57.982672 2730 webserver.cc:533] Webserver started at http://127.27.203.190:36165/ using document root <none> and password file <none>
I20260805 19:55:57.983758 2730 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:57.984102 2730 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:57.994519 2730 fs_manager.cc:714] Time spent opening directory manager: real 0.007s user 0.009s sys 0.000s
I20260805 19:55:57.999744 2747 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:58.001153 2730 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 19:55:58.001595 2730 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal
uuid: "63804ddc17f840c48cc9a0141a824d1c"
format_stamp: "Formatted at 2026-08-05 19:55:54 on dist-test-slave-27sr"
I20260805 19:55:58.003734 2730 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:58.078027 2730 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:58.079744 2730 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:58.080307 2730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:58.158531 2730 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.190:42149
I20260805 19:55:58.158774 2798 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.190:42149 every 8 connection(s)
I20260805 19:55:58.161692 2730 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data/info.pb
I20260805 19:55:58.168448 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 2730
I20260805 19:55:58.170943 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.129:45341
--local_ip_for_outbound_sockets=127.27.203.129
--tserver_master_addrs=127.27.203.190:42149
--webserver_port=45683
--webserver_interface=127.27.203.129
--builtin_ntp_servers=127.27.203.148:43627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260805 19:55:58.178354 2800 sys_catalog.cc:263] Verifying existing consensus state
I20260805 19:55:58.194253 2800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c: Bootstrap starting.
I20260805 19:55:58.205920 2800 log.cc:826] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c: Log is configured to *not* fsync() on all Append() calls
I20260805 19:55:58.218851 2800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 19:55:58.219723 2800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c: Bootstrap complete.
I20260805 19:55:58.241889 2800 raft_consensus.cc:359] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63804ddc17f840c48cc9a0141a824d1c" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42149 } }
I20260805 19:55:58.242699 2800 raft_consensus.cc:740] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63804ddc17f840c48cc9a0141a824d1c, State: Initialized, Role: FOLLOWER
I20260805 19:55:58.243650 2800 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63804ddc17f840c48cc9a0141a824d1c" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42149 } }
I20260805 19:55:58.244295 2800 raft_consensus.cc:399] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 19:55:58.244623 2800 raft_consensus.cc:493] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 19:55:58.244966 2800 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 1 FOLLOWER]: Advancing to term 2
I20260805 19:55:58.249534 2800 raft_consensus.cc:515] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63804ddc17f840c48cc9a0141a824d1c" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42149 } }
I20260805 19:55:58.250316 2800 leader_election.cc:304] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63804ddc17f840c48cc9a0141a824d1c; no voters:
I20260805 19:55:58.252774 2800 leader_election.cc:290] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 19:55:58.253228 2804 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 2 FOLLOWER]: Leader election won for term 2
I20260805 19:55:58.256573 2804 raft_consensus.cc:697] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [term 2 LEADER]: Becoming Leader. State: Replica: 63804ddc17f840c48cc9a0141a824d1c, State: Running, Role: LEADER
I20260805 19:55:58.257529 2804 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63804ddc17f840c48cc9a0141a824d1c" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42149 } }
I20260805 19:55:58.258270 2800 sys_catalog.cc:565] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [sys.catalog]: configured and running, proceeding with master startup.
I20260805 19:55:58.268716 2806 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63804ddc17f840c48cc9a0141a824d1c. Latest consensus state: current_term: 2 leader_uuid: "63804ddc17f840c48cc9a0141a824d1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63804ddc17f840c48cc9a0141a824d1c" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42149 } } }
I20260805 19:55:58.270396 2806 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [sys.catalog]: This master's current role is: LEADER
I20260805 19:55:58.269729 2805 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "63804ddc17f840c48cc9a0141a824d1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63804ddc17f840c48cc9a0141a824d1c" member_type: VOTER last_known_addr { host: "127.27.203.190" port: 42149 } } }
I20260805 19:55:58.272483 2805 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c [sys.catalog]: This master's current role is: LEADER
I20260805 19:55:58.274164 2811 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260805 19:55:58.289968 2811 catalog_manager.cc:679] Loaded metadata for table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]
I20260805 19:55:58.299855 2811 tablet_loader.cc:96] loaded metadata for tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc])
I20260805 19:55:58.301805 2811 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260805 19:55:58.333664 2811 catalog_manager.cc:1383] Generated new cluster ID: 553de0c2b502499fb31916efafbad303
I20260805 19:55:58.335153 2811 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260805 19:55:58.383996 2811 catalog_manager.cc:1406] Generated new certificate authority record
I20260805 19:55:58.386389 2811 catalog_manager.cc:1540] Loading token signing keys...
I20260805 19:55:58.404029 2811 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c: Generated new TSK 0
I20260805 19:55:58.405328 2811 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260805 19:55:58.557664 2802 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:55:58.558281 2802 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:55:58.558926 2802 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:55:58.595109 2802 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:55:58.596118 2802 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.129
I20260805 19:55:58.636406 2802 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:43627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.129:45341
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.203.129
--webserver_port=45683
--tserver_master_addrs=127.27.203.190:42149
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:55:58.637845 2802 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:55:58.639635 2802 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:55:58.655055 2829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:58.657735 2830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:58.659538 2832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:55:59.857786 2831 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260805 19:55:59.857874 2802 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:55:59.862411 2802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:55:59.865183 2802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:55:59.866696 2802 hybrid_clock.cc:648] HybridClock initialized: now 1785959759866655 us; error 45 us; skew 500 ppm
I20260805 19:55:59.867776 2802 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:55:59.875453 2802 webserver.cc:533] Webserver started at http://127.27.203.129:45683/ using document root <none> and password file <none>
I20260805 19:55:59.876742 2802 fs_manager.cc:362] Metadata directory not provided
I20260805 19:55:59.877030 2802 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:55:59.887880 2802 fs_manager.cc:714] Time spent opening directory manager: real 0.007s user 0.006s sys 0.001s
I20260805 19:55:59.894131 2841 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:55:59.895555 2802 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260805 19:55:59.895998 2802 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/wal
uuid: "218c5471fd9e462cbff7b5031215ff28"
format_stamp: "Formatted at 2026-08-05 19:55:42 on dist-test-slave-27sr"
I20260805 19:55:59.898751 2802 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:55:59.960537 2802 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:55:59.962109 2802 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:55:59.962603 2802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:55:59.965987 2802 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:55:59.972604 2848 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260805 19:55:59.981918 2802 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 19:55:59.982161 2802 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.012s user 0.000s sys 0.003s
I20260805 19:55:59.982529 2802 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260805 19:55:59.987638 2802 ts_tablet_manager.cc:616] Registered 1 tablets
I20260805 19:55:59.987964 2802 ts_tablet_manager.cc:595] Time spent register tablets: real 0.005s user 0.002s sys 0.004s
I20260805 19:55:59.988442 2848 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28: Bootstrap starting.
I20260805 19:56:00.245726 2802 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.129:45341
I20260805 19:56:00.245903 2959 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.129:45341 every 8 connection(s)
I20260805 19:56:00.250139 2802 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data/info.pb
I20260805 19:56:00.260514 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 2802
I20260805 19:56:00.262773 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.130:35261
--local_ip_for_outbound_sockets=127.27.203.130
--tserver_master_addrs=127.27.203.190:42149
--webserver_port=33423
--webserver_interface=127.27.203.130
--builtin_ntp_servers=127.27.203.148:43627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260805 19:56:00.328539 2960 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42149
I20260805 19:56:00.329258 2960 heartbeater.cc:461] Registering TS with master...
I20260805 19:56:00.330830 2960 heartbeater.cc:507] Master 127.27.203.190:42149 requested a full tablet report, sending...
I20260805 19:56:00.336879 2764 ts_manager.cc:194] Registered new tserver with Master: 218c5471fd9e462cbff7b5031215ff28 (127.27.203.129:45341)
I20260805 19:56:00.343412 2764 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.129:57557
I20260805 19:56:00.377688 2848 log.cc:826] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28: Log is configured to *not* fsync() on all Append() calls
W20260805 19:56:00.653110 2964 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:56:00.653673 2964 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:56:00.654232 2964 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:56:00.690138 2964 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:56:00.691118 2964 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.130
I20260805 19:56:00.729121 2964 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:43627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.130:35261
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.203.130
--webserver_port=33423
--tserver_master_addrs=127.27.203.190:42149
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:56:00.730540 2964 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:56:00.732396 2964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:56:00.746567 2971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:56:01.349395 2960 heartbeater.cc:499] Master 127.27.203.190:42149 was elected leader, sending a full tablet report...
W20260805 19:56:00.751060 2974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:56:00.747818 2972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:56:02.191730 2973 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1443 milliseconds
I20260805 19:56:02.191965 2964 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260805 19:56:02.193707 2964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:56:02.196928 2964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:56:02.198544 2964 hybrid_clock.cc:648] HybridClock initialized: now 1785959762198487 us; error 58 us; skew 500 ppm
I20260805 19:56:02.199875 2964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:56:02.209069 2964 webserver.cc:533] Webserver started at http://127.27.203.130:33423/ using document root <none> and password file <none>
I20260805 19:56:02.210719 2964 fs_manager.cc:362] Metadata directory not provided
I20260805 19:56:02.211093 2964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:56:02.223695 2964 fs_manager.cc:714] Time spent opening directory manager: real 0.008s user 0.006s sys 0.001s
I20260805 19:56:02.230959 2981 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:56:02.232558 2964 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.006s sys 0.001s
I20260805 19:56:02.233021 2964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/wal
uuid: "f32553325fab49f4be873dc49204a278"
format_stamp: "Formatted at 2026-08-05 19:55:44 on dist-test-slave-27sr"
I20260805 19:56:02.236233 2964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:56:02.354723 2964 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:56:02.356433 2964 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:56:02.356931 2964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:56:02.360402 2964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:56:02.367969 2988 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260805 19:56:02.376605 2964 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 19:56:02.376895 2964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.011s user 0.002s sys 0.001s
I20260805 19:56:02.377197 2964 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260805 19:56:02.382508 2964 ts_tablet_manager.cc:616] Registered 1 tablets
I20260805 19:56:02.382800 2964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.006s user 0.003s sys 0.000s
I20260805 19:56:02.383240 2988 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: Bootstrap starting.
I20260805 19:56:02.581311 2964 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.130:35261
I20260805 19:56:02.581583 3098 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.130:35261 every 8 connection(s)
I20260805 19:56:02.584455 2964 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data/info.pb
I20260805 19:56:02.595309 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 2964
I20260805 19:56:02.597783 28462 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
/tmp/dist-test-taskZMieQk/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.203.131:39261
--local_ip_for_outbound_sockets=127.27.203.131
--tserver_master_addrs=127.27.203.190:42149
--webserver_port=44219
--webserver_interface=127.27.203.131
--builtin_ntp_servers=127.27.203.148:43627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260805 19:56:02.670194 3099 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42149
I20260805 19:56:02.670806 3099 heartbeater.cc:461] Registering TS with master...
I20260805 19:56:02.672616 3099 heartbeater.cc:507] Master 127.27.203.190:42149 requested a full tablet report, sending...
I20260805 19:56:02.677419 2764 ts_manager.cc:194] Registered new tserver with Master: f32553325fab49f4be873dc49204a278 (127.27.203.130:35261)
I20260805 19:56:02.680684 2764 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.130:48129
I20260805 19:56:02.729463 2988 log.cc:826] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: Log is configured to *not* fsync() on all Append() calls
W20260805 19:56:03.165671 3103 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 19:56:03.166445 3103 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 19:56:03.167407 3103 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260805 19:56:03.229120 3103 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260805 19:56:03.230630 3103 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.203.131
I20260805 19:56:03.299116 3103 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.203.148:43627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.203.131:39261
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.203.131
--webserver_port=44219
--tserver_master_addrs=127.27.203.190:42149
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.203.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision d6bc70083ab5366b25adcd3db763c677bf38b6d0
build type FASTDEBUG
built by None at 05 Aug 2026 19:43:20 UTC on e7f111948823
build id 13199
TSAN enabled
I20260805 19:56:03.301103 3103 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 19:56:03.303535 3103 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260805 19:56:03.322207 3110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:56:03.510643 2848 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28: Bootstrap replayed 1/1 log segments. Stats: ops{read=205 overwritten=0 applied=205 ignored=0} inserts{seen=10200 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 19:56:03.512712 2848 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28: Bootstrap complete.
I20260805 19:56:03.516268 2848 ts_tablet_manager.cc:1403] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28: Time spent bootstrapping tablet: real 3.528s user 3.431s sys 0.064s
I20260805 19:56:03.546437 2848 raft_consensus.cc:359] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:56:03.552044 2848 raft_consensus.cc:740] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218c5471fd9e462cbff7b5031215ff28, State: Initialized, Role: FOLLOWER
I20260805 19:56:03.554040 2848 consensus_queue.cc:260] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 205, Last appended: 1.205, Last appended by leader: 205, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:56:03.565634 2848 ts_tablet_manager.cc:1434] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28: Time spent starting tablet: real 0.049s user 0.045s sys 0.000s
I20260805 19:56:03.685590 3099 heartbeater.cc:499] Master 127.27.203.190:42149 was elected leader, sending a full tablet report...
W20260805 19:56:04.724498 3109 debug-util.cc:398] Leaking SignalData structure 0x7b080002ede0 after lost signal to thread 3103
W20260805 19:56:03.324003 3111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 19:56:05.128129 3103 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.808s user 0.651s sys 1.154s
W20260805 19:56:05.129207 3103 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.809s user 0.651s sys 1.154s
I20260805 19:56:05.139137 3103 server_base.cc:1061] running on GCE node
W20260805 19:56:05.139405 3116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 19:56:05.140847 3103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 19:56:05.143079 3103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 19:56:05.144533 3103 hybrid_clock.cc:648] HybridClock initialized: now 1785959765144459 us; error 75 us; skew 500 ppm
I20260805 19:56:05.145668 3103 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 19:56:05.153023 3103 webserver.cc:533] Webserver started at http://127.27.203.131:44219/ using document root <none> and password file <none>
I20260805 19:56:05.154072 3103 fs_manager.cc:362] Metadata directory not provided
I20260805 19:56:05.154361 3103 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 19:56:05.165503 3103 fs_manager.cc:714] Time spent opening directory manager: real 0.008s user 0.006s sys 0.002s
I20260805 19:56:05.171754 3121 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 19:56:05.173403 3103 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260805 19:56:05.173800 3103 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/wal
uuid: "e9b8c52d3be04c2b9b90307d8cd3b749"
format_stamp: "Formatted at 2026-08-05 19:55:46 on dist-test-slave-27sr"
I20260805 19:56:05.176662 3103 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 19:56:05.207312 3122 raft_consensus.cc:493] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 19:56:05.208004 3122 raft_consensus.cc:515] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:56:05.211383 3122 leader_election.cc:290] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f32553325fab49f4be873dc49204a278 (127.27.203.130:35261), e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131:39261)
W20260805 19:56:05.232137 2843 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.203.131:39261: connect: Connection refused (error 111)
W20260805 19:56:05.243641 2843 leader_election.cc:336] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131:39261): Network error: Client connection negotiation failed: client connection to 127.27.203.131:39261: connect: Connection refused (error 111)
I20260805 19:56:05.245222 3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05016693f14e4d51a9d83b60cfca35f0" candidate_uuid: "218c5471fd9e462cbff7b5031215ff28" candidate_term: 2 candidate_status { last_received { term: 1 index: 205 } } ignore_live_leader: false dest_uuid: "f32553325fab49f4be873dc49204a278" is_pre_election: true
W20260805 19:56:05.259704 2845 leader_election.cc:343] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f32553325fab49f4be873dc49204a278 (127.27.203.130:35261): Illegal state: must be running to vote when last-logged opid is not known
I20260805 19:56:05.260231 2845 leader_election.cc:304] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218c5471fd9e462cbff7b5031215ff28; no voters: e9b8c52d3be04c2b9b90307d8cd3b749, f32553325fab49f4be873dc49204a278
I20260805 19:56:05.261543 3122 raft_consensus.cc:2749] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 19:56:05.270550 3103 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260805 19:56:05.272671 3103 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 19:56:05.273258 3103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 19:56:05.276835 3103 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260805 19:56:05.284951 3134 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260805 19:56:05.294036 3103 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260805 19:56:05.294441 3103 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.011s user 0.002s sys 0.000s
I20260805 19:56:05.294827 3103 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260805 19:56:05.302507 3103 ts_tablet_manager.cc:616] Registered 1 tablets
I20260805 19:56:05.302802 3103 ts_tablet_manager.cc:595] Time spent register tablets: real 0.008s user 0.004s sys 0.002s
I20260805 19:56:05.303285 3134 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: Bootstrap starting.
I20260805 19:56:05.515882 3103 rpc_server.cc:307] RPC server started. Bound to: 127.27.203.131:39261
I20260805 19:56:05.516223 3242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.203.131:39261 every 8 connection(s)
I20260805 19:56:05.519948 3103 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data/info.pb
I20260805 19:56:05.523397 28462 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu as pid 3103
I20260805 19:56:05.572942 3243 heartbeater.cc:344] Connected to a master server at 127.27.203.190:42149
I20260805 19:56:05.573413 3243 heartbeater.cc:461] Registering TS with master...
I20260805 19:56:05.574826 3243 heartbeater.cc:507] Master 127.27.203.190:42149 requested a full tablet report, sending...
I20260805 19:56:05.578964 2764 ts_manager.cc:194] Registered new tserver with Master: e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131:39261)
I20260805 19:56:05.582211 2764 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.203.131:59857
I20260805 19:56:05.585256 28462 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260805 19:56:05.645951 3134 log.cc:826] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: Log is configured to *not* fsync() on all Append() calls
I20260805 19:56:05.666343 2764 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48982:
table { table_name: "rebuild_and_add_columns" } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "c0" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "c1" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "c2" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "c3" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "c4" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "c5" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "c6" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "c7" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "c8" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "c9" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } modify_external_catalogs: true
W20260805 19:56:05.714100 2764 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05016693f14e4d51a9d83b60cfca35f0 consensus state has no leader
W20260805 19:56:05.766875 2749 catalog_manager.cc:4810] Async tablet task AlterTable RPC for tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 05016693f14e4d51a9d83b60cfca35f0 consensus state has no leader
I20260805 19:56:05.899611 2988 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: Bootstrap replayed 1/1 log segments. Stats: ops{read=205 overwritten=0 applied=205 ignored=0} inserts{seen=10200 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 19:56:05.900555 2988 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: Bootstrap complete.
I20260805 19:56:05.902309 2988 ts_tablet_manager.cc:1403] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: Time spent bootstrapping tablet: real 3.520s user 3.395s sys 0.076s
I20260805 19:56:05.908318 2988 raft_consensus.cc:359] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:56:05.910552 2988 raft_consensus.cc:740] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f32553325fab49f4be873dc49204a278, State: Initialized, Role: FOLLOWER
I20260805 19:56:05.911381 2988 consensus_queue.cc:260] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 205, Last appended: 1.205, Last appended by leader: 205, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:56:05.914817 2988 ts_tablet_manager.cc:1434] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: Time spent starting tablet: real 0.012s user 0.014s sys 0.000s
I20260805 19:56:05.918206 2764 catalog_manager.cc:5789] TS f32553325fab49f4be873dc49204a278 (127.27.203.130:35261) does not have the latest schema for tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]). Expected version 1 got 0
I20260805 19:56:05.924538 2764 catalog_manager.cc:5789] TS f32553325fab49f4be873dc49204a278 (127.27.203.130:35261) does not have the latest schema for tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]). Expected version 1 got 0
I20260805 19:56:06.587440 3243 heartbeater.cc:499] Master 127.27.203.190:42149 was elected leader, sending a full tablet report...
I20260805 19:56:06.592149 2764 catalog_manager.cc:5789] TS e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131:39261) does not have the latest schema for tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]). Expected version 1 got 0
W20260805 19:56:06.934931 2749 catalog_manager.cc:4810] Async tablet task AlterTable RPC for tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 05016693f14e4d51a9d83b60cfca35f0 consensus state has no leader
I20260805 19:56:07.015076 3262 raft_consensus.cc:493] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 19:56:07.015518 3262 raft_consensus.cc:515] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:56:07.017232 3262 leader_election.cc:290] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f32553325fab49f4be873dc49204a278 (127.27.203.130:35261), e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131:39261)
I20260805 19:56:07.018334 3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05016693f14e4d51a9d83b60cfca35f0" candidate_uuid: "218c5471fd9e462cbff7b5031215ff28" candidate_term: 2 candidate_status { last_received { term: 1 index: 205 } } ignore_live_leader: false dest_uuid: "f32553325fab49f4be873dc49204a278" is_pre_election: true
I20260805 19:56:07.019112 3051 raft_consensus.cc:2468] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218c5471fd9e462cbff7b5031215ff28 in term 1.
I20260805 19:56:07.020660 2845 leader_election.cc:304] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218c5471fd9e462cbff7b5031215ff28, f32553325fab49f4be873dc49204a278; no voters:
I20260805 19:56:07.023336 3262 raft_consensus.cc:2804] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260805 19:56:07.023736 3262 raft_consensus.cc:493] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 19:56:07.024138 3262 raft_consensus.cc:3060] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 1 FOLLOWER]: Advancing to term 2
I20260805 19:56:07.034528 3262 raft_consensus.cc:515] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:56:07.036666 3262 leader_election.cc:290] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [CANDIDATE]: Term 2 election: Requested vote from peers f32553325fab49f4be873dc49204a278 (127.27.203.130:35261), e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131:39261)
I20260805 19:56:07.038053 3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05016693f14e4d51a9d83b60cfca35f0" candidate_uuid: "218c5471fd9e462cbff7b5031215ff28" candidate_term: 2 candidate_status { last_received { term: 1 index: 205 } } ignore_live_leader: false dest_uuid: "f32553325fab49f4be873dc49204a278"
I20260805 19:56:07.038672 3051 raft_consensus.cc:3060] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 1 FOLLOWER]: Advancing to term 2
I20260805 19:56:07.034431 3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05016693f14e4d51a9d83b60cfca35f0" candidate_uuid: "218c5471fd9e462cbff7b5031215ff28" candidate_term: 2 candidate_status { last_received { term: 1 index: 205 } } ignore_live_leader: false dest_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" is_pre_election: true
I20260805 19:56:07.038362 3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05016693f14e4d51a9d83b60cfca35f0" candidate_uuid: "218c5471fd9e462cbff7b5031215ff28" candidate_term: 2 candidate_status { last_received { term: 1 index: 205 } } ignore_live_leader: false dest_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749"
I20260805 19:56:07.048377 3051 raft_consensus.cc:2468] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218c5471fd9e462cbff7b5031215ff28 in term 2.
I20260805 19:56:07.049654 2845 leader_election.cc:304] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218c5471fd9e462cbff7b5031215ff28, f32553325fab49f4be873dc49204a278; no voters:
I20260805 19:56:07.050582 3262 raft_consensus.cc:2804] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 2 FOLLOWER]: Leader election won for term 2
W20260805 19:56:07.051098 2843 leader_election.cc:343] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131:39261): Illegal state: must be running to vote when last-logged opid is not known
I20260805 19:56:07.052528 3262 raft_consensus.cc:697] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 2 LEADER]: Becoming Leader. State: Replica: 218c5471fd9e462cbff7b5031215ff28, State: Running, Role: LEADER
I20260805 19:56:07.053612 3262 consensus_queue.cc:237] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 205, Committed index: 205, Last appended: 1.205, Last appended by leader: 205, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:56:07.065922 2764 catalog_manager.cc:5697] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 reported cstate change: term changed from 0 to 2, leader changed from <none> to 218c5471fd9e462cbff7b5031215ff28 (127.27.203.129), VOTER 218c5471fd9e462cbff7b5031215ff28 (127.27.203.129) added, VOTER e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131) added, VOTER f32553325fab49f4be873dc49204a278 (127.27.203.130) added. New cstate: current_term: 2 leader_uuid: "218c5471fd9e462cbff7b5031215ff28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } health_report { overall_health: HEALTHY } } }
I20260805 19:56:07.068207 2764 catalog_manager.cc:5789] TS 218c5471fd9e462cbff7b5031215ff28 (127.27.203.129:45341) does not have the latest schema for tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]). Expected version 1 got 0
W20260805 19:56:07.474637 2843 consensus_peers.cc:597] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 -> Peer e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131:39261): Couldn't send request to peer e9b8c52d3be04c2b9b90307d8cd3b749. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260805 19:56:07.664767 3051 raft_consensus.cc:1275] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 2 FOLLOWER]: Refusing update from remote peer 218c5471fd9e462cbff7b5031215ff28: Log matching property violated. Preceding OpId in replica: term: 1 index: 205. Preceding OpId from leader: term: 2 index: 206. (index mismatch)
I20260805 19:56:07.666596 3262 consensus_queue.cc:1048] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 206, Last known committed idx: 205, Time since last communication: 0.000s
I20260805 19:56:07.683409 2764 catalog_manager.cc:5789] TS f32553325fab49f4be873dc49204a278 (127.27.203.130:35261) does not have the latest schema for tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]). Expected version 1 got 0
I20260805 19:56:07.688220 2763 catalog_manager.cc:5789] TS 218c5471fd9e462cbff7b5031215ff28 (127.27.203.129:45341) does not have the latest schema for tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]). Expected version 1 got 0
I20260805 19:56:07.690071 2764 catalog_manager.cc:5789] TS f32553325fab49f4be873dc49204a278 (127.27.203.130:35261) does not have the latest schema for tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]). Expected version 1 got 0
I20260805 19:56:07.709905 2913 consensus_queue.cc:237] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 206, Committed index: 206, Last appended: 2.206, Last appended by leader: 205, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:56:07.714270 3051 raft_consensus.cc:1275] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 2 FOLLOWER]: Refusing update from remote peer 218c5471fd9e462cbff7b5031215ff28: Log matching property violated. Preceding OpId in replica: term: 2 index: 206. Preceding OpId from leader: term: 2 index: 207. (index mismatch)
I20260805 19:56:07.715974 3273 consensus_queue.cc:1048] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 206, Time since last communication: 0.001s
I20260805 19:56:07.721820 3262 raft_consensus.cc:2955] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 2 LEADER]: Committing config change with OpId 2.207: config changed from index -1 to 207, VOTER e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131) evicted. New config: { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } } }
I20260805 19:56:07.723738 3051 raft_consensus.cc:2955] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 2 FOLLOWER]: Committing config change with OpId 2.207: config changed from index -1 to 207, VOTER e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131) evicted. New config: { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } } }
I20260805 19:56:07.731598 2750 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05016693f14e4d51a9d83b60cfca35f0 with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260805 19:56:07.735597 2763 catalog_manager.cc:5697] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 reported cstate change: config changed from index -1 to 207, VOTER e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131) evicted. New cstate: current_term: 2 leader_uuid: "218c5471fd9e462cbff7b5031215ff28" committed_config { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } health_report { overall_health: HEALTHY } } }
I20260805 19:56:07.736935 2763 catalog_manager.cc:5789] TS 218c5471fd9e462cbff7b5031215ff28 (127.27.203.129:45341) does not have the latest schema for tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]). Expected version 1 got 0
I20260805 19:56:07.746515 2764 catalog_manager.cc:5789] TS f32553325fab49f4be873dc49204a278 (127.27.203.130:35261) does not have the latest schema for tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]). Expected version 1 got 0
I20260805 19:56:07.751396 2913 consensus_queue.cc:237] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 207, Committed index: 207, Last appended: 2.207, Last appended by leader: 205, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:56:07.755601 3273 raft_consensus.cc:2955] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 [term 2 LEADER]: Committing config change with OpId 2.208: config changed from index 207 to 208, VOTER f32553325fab49f4be873dc49204a278 (127.27.203.130) evicted. New config: { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } } }
I20260805 19:56:07.756522 2763 catalog_manager.cc:5789] TS 218c5471fd9e462cbff7b5031215ff28 (127.27.203.129:45341) does not have the latest schema for tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]). Expected version 1 got 0
I20260805 19:56:07.763439 3177 tablet_service.cc:1558] Processing DeleteTablet for tablet 05016693f14e4d51a9d83b60cfca35f0 with delete_type TABLET_DATA_TOMBSTONED (TS e9b8c52d3be04c2b9b90307d8cd3b749 not found in new config with opid_index 207) from {username='slave'} at 127.0.0.1:51250
I20260805 19:56:07.764298 2750 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05016693f14e4d51a9d83b60cfca35f0 with cas_config_opid_index 207: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260805 19:56:07.767985 2749 catalog_manager.cc:5008] TS e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131:39261): delete failed for tablet 05016693f14e4d51a9d83b60cfca35f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05016693f14e4d51a9d83b60cfca35f0 already in progress: opening tablet
I20260805 19:56:07.768085 2763 catalog_manager.cc:5697] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28 reported cstate change: config changed from index 207 to 208, VOTER f32553325fab49f4be873dc49204a278 (127.27.203.130) evicted. New cstate: current_term: 2 leader_uuid: "218c5471fd9e462cbff7b5031215ff28" committed_config { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } health_report { overall_health: HEALTHY } } }
I20260805 19:56:07.769114 2763 catalog_manager.cc:5789] TS 218c5471fd9e462cbff7b5031215ff28 (127.27.203.129:45341) does not have the latest schema for tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]). Expected version 1 got 0
I20260805 19:56:07.788009 3031 tablet_service.cc:1558] Processing DeleteTablet for tablet 05016693f14e4d51a9d83b60cfca35f0 with delete_type TABLET_DATA_TOMBSTONED (TS f32553325fab49f4be873dc49204a278 not found in new config with opid_index 208) from {username='slave'} at 127.0.0.1:45758
I20260805 19:56:07.790932 3284 tablet_replica.cc:333] stopping tablet replica
I20260805 19:56:07.791813 3284 raft_consensus.cc:2243] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260805 19:56:07.792548 3284 raft_consensus.cc:2272] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260805 19:56:07.823086 3284 ts_tablet_manager.cc:1916] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260805 19:56:07.831156 3134 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: Bootstrap replayed 1/1 log segments. Stats: ops{read=205 overwritten=0 applied=205 ignored=0} inserts{seen=10200 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 19:56:07.832190 3134 tablet_bootstrap.cc:492] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: Bootstrap complete.
I20260805 19:56:07.833709 3134 ts_tablet_manager.cc:1403] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: Time spent bootstrapping tablet: real 2.531s user 2.441s sys 0.076s
I20260805 19:56:07.835738 3284 ts_tablet_manager.cc:1929] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.207
I20260805 19:56:07.836191 3284 log.cc:1199] T 05016693f14e4d51a9d83b60cfca35f0 P f32553325fab49f4be873dc49204a278: Deleting WAL directory at /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/wal/wals/05016693f14e4d51a9d83b60cfca35f0
I20260805 19:56:07.838075 2751 catalog_manager.cc:5028] TS f32553325fab49f4be873dc49204a278 (127.27.203.130:35261): tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]) successfully deleted
I20260805 19:56:07.840229 3134 raft_consensus.cc:359] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:56:07.842384 3134 raft_consensus.cc:740] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9b8c52d3be04c2b9b90307d8cd3b749, State: Initialized, Role: FOLLOWER
I20260805 19:56:07.843171 3134 consensus_queue.cc:260] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 205, Last appended: 1.205, Last appended by leader: 205, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f32553325fab49f4be873dc49204a278" member_type: VOTER last_known_addr { host: "127.27.203.130" port: 35261 } } peers { permanent_uuid: "e9b8c52d3be04c2b9b90307d8cd3b749" member_type: VOTER last_known_addr { host: "127.27.203.131" port: 39261 } } peers { permanent_uuid: "218c5471fd9e462cbff7b5031215ff28" member_type: VOTER last_known_addr { host: "127.27.203.129" port: 45341 } }
I20260805 19:56:07.845863 3134 ts_tablet_manager.cc:1434] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260805 19:56:07.850888 3177 tablet_service.cc:1558] Processing DeleteTablet for tablet 05016693f14e4d51a9d83b60cfca35f0 with delete_type TABLET_DATA_TOMBSTONED (Replica has no consensus available (current committed config index is 208)) from {username='slave'} at 127.0.0.1:51250
I20260805 19:56:07.851836 3282 tablet_replica.cc:333] stopping tablet replica
I20260805 19:56:07.852639 3282 raft_consensus.cc:2243] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 19:56:07.853204 3282 raft_consensus.cc:2272] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 19:56:07.874464 3282 ts_tablet_manager.cc:1916] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260805 19:56:07.887575 3282 ts_tablet_manager.cc:1929] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.205
I20260805 19:56:07.888031 3282 log.cc:1199] T 05016693f14e4d51a9d83b60cfca35f0 P e9b8c52d3be04c2b9b90307d8cd3b749: Deleting WAL directory at /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/wal/wals/05016693f14e4d51a9d83b60cfca35f0
I20260805 19:56:07.889794 2749 catalog_manager.cc:5028] TS e9b8c52d3be04c2b9b90307d8cd3b749 (127.27.203.131:39261): tablet 05016693f14e4d51a9d83b60cfca35f0 (table rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc]) successfully deleted
I20260805 19:56:08.019706 3286 tablet.cc:1724] T 05016693f14e4d51a9d83b60cfca35f0 P 218c5471fd9e462cbff7b5031215ff28: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:c0 INT32 NULLABLE,
14:c1 INT32 NULLABLE,
15:c2 INT32 NULLABLE,
16:c3 INT32 NULLABLE,
17:c4 INT32 NULLABLE,
18:c5 INT32 NULLABLE,
19:c6 INT32 NULLABLE,
20:c7 INT32 NULLABLE,
21:c8 INT32 NULLABLE,
22:c9 INT32 NULLABLE,
PRIMARY KEY (key)
) version 1
I20260805 19:56:10.680536 3286 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:58396 (request call id 2) took 2668 ms. Trace:
I20260805 19:56:10.681154 3286 rpcz_store.cc:276] 0805 19:56:08.011876 (+ 0us) service_pool.cc:167] Inserting onto call queue
0805 19:56:08.012114 (+ 238us) service_pool.cc:224] Handling call
0805 19:56:10.680356 (+2668242us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0805 19:56:08.014141 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0805 19:56:08.015344 (+ 1203us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0805 19:56:08.015381 (+ 37us) alter_schema_op.cc:66] Acquired schema lock
0805 19:56:08.015486 (+ 105us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0805 19:56:08.015620 (+ 134us) alter_schema_op.cc:128] START. Timestamp: 1785959768015516
0805 19:56:08.015651 (+ 31us) op_driver.cc:348] REPLICATION: starting
0805 19:56:08.016555 (+ 904us) log.cc:844] Serialized 429 byte log entry
0805 19:56:08.017830 (+ 1275us) op_driver.cc:464] REPLICATION: finished
0805 19:56:08.019499 (+ 1669us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0805 19:56:10.650280 (+2630781us) tablet_metadata.cc:716] TabletMetadata updated
0805 19:56:10.651412 (+ 1132us) log.cc:844] Serialized 5 byte log entry
0805 19:56:10.657994 (+ 6582us) tablet_metadata.cc:665] Metadata flushed
0805 19:56:10.679774 (+ 21780us) log.cc:844] Serialized 15 byte log entry
0805 19:56:10.679940 (+ 166us) alter_schema_op.cc:73] Released schema lock
0805 19:56:10.680005 (+ 65us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1473,"bytes_written":293160,"cfile_init":1,"compiler_manager_pool.queue_time_us":92600,"compiler_manager_pool.run_cpu_time_us":2186401,"compiler_manager_pool.run_wall_time_us":2198574,"dirs.queue_time_us":1200,"dirs.run_cpu_time_us":345,"dirs.run_wall_time_us":1399,"drs_written":1,"lbm_read_time_us":206,"lbm_reads_lt_1ms":4,"lbm_write_time_us":7978,"lbm_writes_lt_1ms":72,"peak_mem_usage":0,"prepare.queue_time_us":169,"prepare.run_cpu_time_us":2670,"prepare.run_wall_time_us":2670,"replication_time_us":2074,"rows_written":10200,"spinlock_wait_cycles":44800,"thread_start_us":3550,"threads_started":4,"wal-append.queue_time_us":825}]]}
I20260805 19:56:10.694257 2763 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 63804ddc17f840c48cc9a0141a824d1c: rebuild_and_add_columns [id=a9c503127eb448119afc3433db1e18cc] alter complete (version 1)
I20260805 19:56:10.830987 2961 maintenance_manager.cc:419] P 218c5471fd9e462cbff7b5031215ff28: Scheduling UndoDeltaBlockGCOp(05016693f14e4d51a9d83b60cfca35f0): 95510 bytes on disk
I20260805 19:56:10.833391 2846 maintenance_manager.cc:643] P 218c5471fd9e462cbff7b5031215ff28: UndoDeltaBlockGCOp(05016693f14e4d51a9d83b60cfca35f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":260,"lbm_reads_lt_1ms":4}
I20260805 19:56:12.107685 3031 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260805 19:56:12.108566 3177 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260805 19:56:12.108819 2892 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
63804ddc17f840c48cc9a0141a824d1c | 127.27.203.190:42149 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.27.203.148:43627 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
218c5471fd9e462cbff7b5031215ff28 | 127.27.203.129:45341 | HEALTHY | <none> | 1 | 0
e9b8c52d3be04c2b9b90307d8cd3b749 | 127.27.203.131:39261 | HEALTHY | <none> | 0 | 0
f32553325fab49f4be873dc49204a278 | 127.27.203.130:35261 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.27.203.129 | experimental | 127.27.203.129:45341
local_ip_for_outbound_sockets | 127.27.203.130 | experimental | 127.27.203.130:35261
local_ip_for_outbound_sockets | 127.27.203.131 | experimental | 127.27.203.131:39261
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-0/data/info.pb | hidden | 127.27.203.129:45341
server_dump_info_path | /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-1/data/info.pb | hidden | 127.27.203.130:35261
server_dump_info_path | /tmp/dist-test-taskZMieQk/test-tmp/kudu-admin-test.2.IsSecure_SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns_0.1785959555696825-28462-0/minicluster-data/ts-2/data/info.pb | hidden | 127.27.203.131:39261
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.27.203.148:43627 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-------------------------+----+---------+---------------+---------+------------+------------------+-------------
rebuild_and_add_columns | 1 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 0
Median | 0
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 1
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260805 19:56:12.427718 28462 log_verifier.cc:126] Checking tablet 05016693f14e4d51a9d83b60cfca35f0
I20260805 19:56:12.774312 28462 log_verifier.cc:177] Verified matching terms for 209 ops in tablet 05016693f14e4d51a9d83b60cfca35f0
I20260805 19:56:12.775938 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 2802
I20260805 19:56:12.818506 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 2964
I20260805 19:56:12.852273 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 3103
I20260805 19:56:12.884114 28462 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZMieQk/build/tsan/bin/kudu with pid 2730
2026-08-05T19:56:12Z chronyd exiting
[ OK ] IsSecure/SecureClusterAdminCliParamTest.TestRebuildMasterAndAddColumns/0 (34963 ms)
[----------] 1 test from IsSecure/SecureClusterAdminCliParamTest (34963 ms total)
[----------] Global test environment tear-down
[==========] 10 tests from 5 test suites ran. (217169 ms total)
[ PASSED ] 9 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] AdminCliTest.TestUnsafeChangeConfigWithMultiplePendingConfigs
1 FAILED TEST