Diagnosed failure

SlowTabletBootstrapTest.TestFallBehindSlowBootstrap: /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/integration-tests/raft_config_change-itest.cc:500: Failure
Value of: IsRaftConfigMember(added_replica_uuid, cstate.committed_config())
  Actual: false
Expected: true
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20261118 09:03:22.880757 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 22684
I20261118 09:03:22.886961 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 22815
I20261118 09:03:22.894106 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 22946
I20261118 09:03:22.900820 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 23241
I20261118 09:03:22.907128 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 22593
2026-11-18T09:03:22Z chronyd exiting
I20261118 09:03:22.924110 18974 test_util.cc:182] -----------------------------------------------
I20261118 09:03:22.924158 18974 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0

Full log

[==========] Running 6 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 3 tests from RaftConfigChangeITest
[ RUN      ] RaftConfigChangeITest.TestKudu2147
2026-11-18T09:02:21Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-18T09:02:21Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20261118 09:02:21.591809 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.135.190:39403
--webserver_interface=127.18.135.190
--webserver_port=0
--builtin_ntp_servers=127.18.135.148:41797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.135.190:39403 with env {}
W20261118 09:02:21.699551 18982 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:21.699694 18982 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:21.699735 18982 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:21.702977 18982 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261118 09:02:21.703027 18982 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:21.703048 18982 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261118 09:02:21.703066 18982 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261118 09:02:21.706812 18982 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:41797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.135.190:39403
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.135.190:39403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.135.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.18982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:21.707432 18982 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:21.708056 18982 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:21.713625 18990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:21.713605 18987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:21.713598 18988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:21.713861 18982 server_base.cc:1061] running on GCE node
I20261118 09:02:21.714221 18982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:21.714919 18982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:21.716086 18982 hybrid_clock.cc:648] HybridClock initialized: now 1794992541716080 us; error 26 us; skew 500 ppm
I20261118 09:02:21.717545 18982 webserver.cc:577] Webserver started at http://127.18.135.190:34589/ using document root <none> and password file <none>
I20261118 09:02:21.718132 18982 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:21.718204 18982 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:21.718428 18982 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:21.719659 18982 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/data/instance:
uuid: "7cca56b76bdf46e196f6573a65f7cdfc"
format_stamp: "Formatted at 2026-11-18 09:02:21 on dist-test-slave-q6bx"
I20261118 09:02:21.720088 18982 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/wal/instance:
uuid: "7cca56b76bdf46e196f6573a65f7cdfc"
format_stamp: "Formatted at 2026-11-18 09:02:21 on dist-test-slave-q6bx"
I20261118 09:02:21.723081 18982 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 09:02:21.725083 18996 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:21.726040 18982 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 09:02:21.726184 18982 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/wal
uuid: "7cca56b76bdf46e196f6573a65f7cdfc"
format_stamp: "Formatted at 2026-11-18 09:02:21 on dist-test-slave-q6bx"
I20261118 09:02:21.726276 18982 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:21.739147 18982 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:21.739570 18982 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:21.739737 18982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:21.746279 18982 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.190:39403
I20261118 09:02:21.746300 19048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.190:39403 every 8 connection(s)
I20261118 09:02:21.747222 18982 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/data/info.pb
I20261118 09:02:21.747706 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 18982
I20261118 09:02:21.747867 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/master-0/wal/instance
I20261118 09:02:21.750190 19049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:21.755510 19049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc: Bootstrap starting.
I20261118 09:02:21.757485 19049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:21.758267 19049 log.cc:826] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:21.759560 19049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc: No bootstrap required, opened a new log
I20261118 09:02:21.762193 19049 raft_consensus.cc:360] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cca56b76bdf46e196f6573a65f7cdfc" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 39403 } }
I20261118 09:02:21.762341 19049 raft_consensus.cc:386] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:21.762415 19049 raft_consensus.cc:748] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cca56b76bdf46e196f6573a65f7cdfc, State: Initialized, Role: FOLLOWER
I20261118 09:02:21.762755 19049 consensus_queue.cc:261] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cca56b76bdf46e196f6573a65f7cdfc" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 39403 } }
I20261118 09:02:21.762895 19049 raft_consensus.cc:400] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261118 09:02:21.762974 19049 raft_consensus.cc:499] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261118 09:02:21.763085 19049 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:21.763767 19049 raft_consensus.cc:521] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cca56b76bdf46e196f6573a65f7cdfc" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 39403 } }
I20261118 09:02:21.764097 19049 leader_election.cc:304] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cca56b76bdf46e196f6573a65f7cdfc; no voters: 
I20261118 09:02:21.764358 19049 leader_election.cc:290] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261118 09:02:21.764482 19054 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [term 1 FOLLOWER]: Leader election won for term 1
I20261118 09:02:21.764691 19054 raft_consensus.cc:705] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [term 1 LEADER]: Becoming Leader. State: Replica: 7cca56b76bdf46e196f6573a65f7cdfc, State: Running, Role: LEADER
I20261118 09:02:21.765044 19054 consensus_queue.cc:238] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cca56b76bdf46e196f6573a65f7cdfc" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 39403 } }
I20261118 09:02:21.765340 19049 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [sys.catalog]: configured and running, proceeding with master startup.
I20261118 09:02:21.767201 19056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cca56b76bdf46e196f6573a65f7cdfc. Latest consensus state: current_term: 1 leader_uuid: "7cca56b76bdf46e196f6573a65f7cdfc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cca56b76bdf46e196f6573a65f7cdfc" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 39403 } } }
I20261118 09:02:21.767306 19056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [sys.catalog]: This master's current role is: LEADER
I20261118 09:02:21.767590 19055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7cca56b76bdf46e196f6573a65f7cdfc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cca56b76bdf46e196f6573a65f7cdfc" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 39403 } } }
I20261118 09:02:21.767705 19055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc [sys.catalog]: This master's current role is: LEADER
W20261118 09:02:21.770136 19070 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20261118 09:02:21.770252 19070 catalog_manager.cc:898] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20261118 09:02:21.770375 19069 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261118 09:02:21.771335 19069 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261118 09:02:21.776463 19069 catalog_manager.cc:1398] Generated new cluster ID: 02e228df332c40a9b3a2ac67b8eac50b
I20261118 09:02:21.776517 19069 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261118 09:02:21.793088 19069 catalog_manager.cc:1421] Generated new certificate authority record
I20261118 09:02:21.793890 19069 catalog_manager.cc:1555] Loading token signing keys...
I20261118 09:02:21.801400 19069 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 7cca56b76bdf46e196f6573a65f7cdfc: Generated new TSK 0
I20261118 09:02:21.802000 19069 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261118 09:02:21.807760 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.129:0
--local_ip_for_outbound_sockets=127.18.135.129
--webserver_interface=127.18.135.129
--webserver_port=0
--tserver_master_addrs=127.18.135.190:39403
--builtin_ntp_servers=127.18.135.148:41797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=3000 with env {}
W20261118 09:02:21.906052 19073 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:21.906190 19073 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:21.906231 19073 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:21.909469 19073 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:21.909605 19073 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.129
I20261118 09:02:21.913497 19073 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:41797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=3000
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.135.129
--webserver_port=0
--tserver_master_addrs=127.18.135.190:39403
--never_fsync=true
--heap_profile_path=/tmp/kudu.19073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:21.914219 19073 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:21.914901 19073 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:21.920257 19078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:21.920305 19079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:21.920275 19081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:21.920594 19073 server_base.cc:1061] running on GCE node
I20261118 09:02:21.921027 19073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:21.921700 19073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:21.922914 19073 hybrid_clock.cc:648] HybridClock initialized: now 1794992541922891 us; error 38 us; skew 500 ppm
I20261118 09:02:21.924559 19073 webserver.cc:577] Webserver started at http://127.18.135.129:38803/ using document root <none> and password file <none>
I20261118 09:02:21.925176 19073 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:21.925232 19073 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:21.925439 19073 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:21.926966 19073 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/data/instance:
uuid: "fad312cf224b4b29b985aa1d62a50d14"
format_stamp: "Formatted at 2026-11-18 09:02:21 on dist-test-slave-q6bx"
I20261118 09:02:21.927424 19073 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/wal/instance:
uuid: "fad312cf224b4b29b985aa1d62a50d14"
format_stamp: "Formatted at 2026-11-18 09:02:21 on dist-test-slave-q6bx"
I20261118 09:02:21.931147 19073 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.004s
I20261118 09:02:21.933641 19087 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:21.934700 19073 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20261118 09:02:21.934801 19073 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/wal
uuid: "fad312cf224b4b29b985aa1d62a50d14"
format_stamp: "Formatted at 2026-11-18 09:02:21 on dist-test-slave-q6bx"
I20261118 09:02:21.934880 19073 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:21.952317 19073 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:21.952677 19073 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:21.952787 19073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:21.953169 19073 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:21.953989 19073 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:21.954031 19073 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:21.954069 19073 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:21.954092 19073 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:21.962347 19073 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.129:36925
I20261118 09:02:21.962419 19200 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.129:36925 every 8 connection(s)
I20261118 09:02:21.963268 19073 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/data/info.pb
I20261118 09:02:21.970741 19201 heartbeater.cc:345] Connected to a master server at 127.18.135.190:39403
I20261118 09:02:21.970955 19201 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:21.971367 19201 heartbeater.cc:508] Master 127.18.135.190:39403 requested a full tablet report, sending...
I20261118 09:02:21.972759 19013 ts_manager.cc:210] Registered new tserver with Master: fad312cf224b4b29b985aa1d62a50d14 (127.18.135.129:36925)
I20261118 09:02:21.972777 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 19073
I20261118 09:02:21.972903 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/wal/instance
I20261118 09:02:21.974305 19013 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.129:40723
I20261118 09:02:21.975224 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.130:0
--local_ip_for_outbound_sockets=127.18.135.130
--webserver_interface=127.18.135.130
--webserver_port=0
--tserver_master_addrs=127.18.135.190:39403
--builtin_ntp_servers=127.18.135.148:41797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=3000 with env {}
W20261118 09:02:22.071125 19204 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:22.071301 19204 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:22.071376 19204 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:22.074678 19204 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:22.074834 19204 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.130
I20261118 09:02:22.078518 19204 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:41797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=3000
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.135.130
--webserver_port=0
--tserver_master_addrs=127.18.135.190:39403
--never_fsync=true
--heap_profile_path=/tmp/kudu.19204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:22.079210 19204 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:22.079875 19204 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:22.085050 19210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:22.085060 19212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:22.085054 19209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:22.085470 19204 server_base.cc:1061] running on GCE node
I20261118 09:02:22.085813 19204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:22.086306 19204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:22.087443 19204 hybrid_clock.cc:648] HybridClock initialized: now 1794992542087421 us; error 44 us; skew 500 ppm
I20261118 09:02:22.088814 19204 webserver.cc:577] Webserver started at http://127.18.135.130:44703/ using document root <none> and password file <none>
I20261118 09:02:22.089296 19204 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:22.089342 19204 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:22.089574 19204 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:22.090786 19204 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/data/instance:
uuid: "71a0a2fb252e43b0a017ccc1763b87c2"
format_stamp: "Formatted at 2026-11-18 09:02:22 on dist-test-slave-q6bx"
I20261118 09:02:22.091159 19204 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/wal/instance:
uuid: "71a0a2fb252e43b0a017ccc1763b87c2"
format_stamp: "Formatted at 2026-11-18 09:02:22 on dist-test-slave-q6bx"
I20261118 09:02:22.094034 19204 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.002s
I20261118 09:02:22.095978 19218 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:22.096850 19204 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 09:02:22.096974 19204 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/wal
uuid: "71a0a2fb252e43b0a017ccc1763b87c2"
format_stamp: "Formatted at 2026-11-18 09:02:22 on dist-test-slave-q6bx"
I20261118 09:02:22.097064 19204 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:22.116268 19204 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:22.116699 19204 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:22.116850 19204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:22.117312 19204 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:22.118292 19204 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:22.118359 19204 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:22.118431 19204 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:22.118484 19204 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:22.126891 19204 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.130:43363
I20261118 09:02:22.126919 19331 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.130:43363 every 8 connection(s)
I20261118 09:02:22.127775 19204 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/data/info.pb
I20261118 09:02:22.130154 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 19204
I20261118 09:02:22.130264 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-1/wal/instance
I20261118 09:02:22.132336 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.131:0
--local_ip_for_outbound_sockets=127.18.135.131
--webserver_interface=127.18.135.131
--webserver_port=0
--tserver_master_addrs=127.18.135.190:39403
--builtin_ntp_servers=127.18.135.148:41797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=3000 with env {}
I20261118 09:02:22.135540 19332 heartbeater.cc:345] Connected to a master server at 127.18.135.190:39403
I20261118 09:02:22.135767 19332 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:22.136345 19332 heartbeater.cc:508] Master 127.18.135.190:39403 requested a full tablet report, sending...
I20261118 09:02:22.137523 19013 ts_manager.cc:210] Registered new tserver with Master: 71a0a2fb252e43b0a017ccc1763b87c2 (127.18.135.130:43363)
I20261118 09:02:22.138391 19013 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.130:45437
W20261118 09:02:22.231868 19335 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:22.231999 19335 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:22.232038 19335 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:22.235213 19335 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:22.235304 19335 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.131
I20261118 09:02:22.239034 19335 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:41797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=3000
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.135.131
--webserver_port=0
--tserver_master_addrs=127.18.135.190:39403
--never_fsync=true
--heap_profile_path=/tmp/kudu.19335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:22.239657 19335 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:22.240265 19335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:22.245448 19343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:22.245448 19340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:22.245474 19341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:22.246027 19335 server_base.cc:1061] running on GCE node
I20261118 09:02:22.246359 19335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:22.246905 19335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:22.248070 19335 hybrid_clock.cc:648] HybridClock initialized: now 1794992542248053 us; error 28 us; skew 500 ppm
I20261118 09:02:22.249558 19335 webserver.cc:577] Webserver started at http://127.18.135.131:37635/ using document root <none> and password file <none>
I20261118 09:02:22.250176 19335 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:22.250252 19335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:22.250463 19335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:22.251660 19335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/data/instance:
uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76"
format_stamp: "Formatted at 2026-11-18 09:02:22 on dist-test-slave-q6bx"
I20261118 09:02:22.252085 19335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/wal/instance:
uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76"
format_stamp: "Formatted at 2026-11-18 09:02:22 on dist-test-slave-q6bx"
I20261118 09:02:22.255131 19335 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 09:02:22.257174 19349 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:22.258131 19335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 09:02:22.258255 19335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/wal
uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76"
format_stamp: "Formatted at 2026-11-18 09:02:22 on dist-test-slave-q6bx"
I20261118 09:02:22.258347 19335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:22.275244 19335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:22.275689 19335 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:22.275851 19335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:22.276325 19335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:22.277215 19335 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:22.277283 19335 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:22.277356 19335 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:22.277410 19335 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:22.286231 19335 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.131:35435
I20261118 09:02:22.286260 19462 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.131:35435 every 8 connection(s)
I20261118 09:02:22.287149 19335 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/data/info.pb
I20261118 09:02:22.287704 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 19335
I20261118 09:02:22.287803 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-2/wal/instance
I20261118 09:02:22.294763 19463 heartbeater.cc:345] Connected to a master server at 127.18.135.190:39403
I20261118 09:02:22.294934 19463 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:22.295305 19463 heartbeater.cc:508] Master 127.18.135.190:39403 requested a full tablet report, sending...
I20261118 09:02:22.296171 19013 ts_manager.cc:210] Registered new tserver with Master: ff8a27a3ec4b43f5a0b9bad90ab93f76 (127.18.135.131:35435)
I20261118 09:02:22.296654 19013 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.131:58447
I20261118 09:02:22.302227 18974 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20261118 09:02:22.324301 19013 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60896:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20261118 09:02:22.325634 19013 catalog_manager.cc:7228] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261118 09:02:22.340610 19397 tablet_service.cc:1500] Processing CreateTablet for tablet 0f7742ebb72c4835aa467da67cc825f6 (DEFAULT_TABLE table=test-workload [id=c438d0385fd042e2b29c299cc9b70c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:22.340938 19135 tablet_service.cc:1500] Processing CreateTablet for tablet 0f7742ebb72c4835aa467da67cc825f6 (DEFAULT_TABLE table=test-workload [id=c438d0385fd042e2b29c299cc9b70c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:22.340938 19266 tablet_service.cc:1500] Processing CreateTablet for tablet 0f7742ebb72c4835aa467da67cc825f6 (DEFAULT_TABLE table=test-workload [id=c438d0385fd042e2b29c299cc9b70c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:22.341517 19397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7742ebb72c4835aa467da67cc825f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:22.341832 19135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7742ebb72c4835aa467da67cc825f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:22.341832 19266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7742ebb72c4835aa467da67cc825f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:22.346624 19485 tablet_bootstrap.cc:492] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76: Bootstrap starting.
I20261118 09:02:22.347374 19486 tablet_bootstrap.cc:492] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2: Bootstrap starting.
I20261118 09:02:22.347851 19487 tablet_bootstrap.cc:492] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Bootstrap starting.
I20261118 09:02:22.349017 19485 tablet_bootstrap.cc:654] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:22.349586 19487 tablet_bootstrap.cc:654] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:22.349629 19486 tablet_bootstrap.cc:654] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:22.349993 19485 log.cc:826] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:22.350416 19487 log.cc:826] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:22.350485 19486 log.cc:826] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:22.351632 19485 tablet_bootstrap.cc:492] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76: No bootstrap required, opened a new log
I20261118 09:02:22.351869 19485 ts_tablet_manager.cc:1449] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 09:02:22.351943 19486 tablet_bootstrap.cc:492] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2: No bootstrap required, opened a new log
I20261118 09:02:22.352128 19487 tablet_bootstrap.cc:492] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: No bootstrap required, opened a new log
I20261118 09:02:22.352133 19486 ts_tablet_manager.cc:1449] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 09:02:22.352306 19487 ts_tablet_manager.cc:1449] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20261118 09:02:22.354279 19485 raft_consensus.cc:360] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 36925 } } peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } }
I20261118 09:02:22.354458 19485 raft_consensus.cc:386] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:22.354538 19485 raft_consensus.cc:748] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff8a27a3ec4b43f5a0b9bad90ab93f76, State: Initialized, Role: FOLLOWER
I20261118 09:02:22.354945 19485 consensus_queue.cc:261] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 36925 } } peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } }
I20261118 09:02:22.355167 19486 raft_consensus.cc:360] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 36925 } } peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } }
I20261118 09:02:22.355316 19487 raft_consensus.cc:360] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 36925 } } peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } }
I20261118 09:02:22.355430 19486 raft_consensus.cc:386] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:22.355496 19486 raft_consensus.cc:748] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0a2fb252e43b0a017ccc1763b87c2, State: Initialized, Role: FOLLOWER
I20261118 09:02:22.355528 19487 raft_consensus.cc:386] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:22.355558 19463 heartbeater.cc:500] Master 127.18.135.190:39403 was elected leader, sending a full tablet report...
I20261118 09:02:22.355577 19487 raft_consensus.cc:748] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fad312cf224b4b29b985aa1d62a50d14, State: Initialized, Role: FOLLOWER
I20261118 09:02:22.355924 19487 consensus_queue.cc:261] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 36925 } } peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } }
I20261118 09:02:22.355986 19486 consensus_queue.cc:261] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 36925 } } peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } }
I20261118 09:02:22.356664 19487 ts_tablet_manager.cc:1480] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20261118 09:02:22.356665 19486 ts_tablet_manager.cc:1480] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20261118 09:02:22.356933 19485 ts_tablet_manager.cc:1480] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20261118 09:02:22.356971 19332 heartbeater.cc:500] Master 127.18.135.190:39403 was elected leader, sending a full tablet report...
I20261118 09:02:22.357784 19201 heartbeater.cc:500] Master 127.18.135.190:39403 was elected leader, sending a full tablet report...
W20261118 09:02:22.378495 19333 tablet.cc:2441] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 09:02:22.464257 19202 tablet.cc:2441] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 09:02:22.537957 19464 tablet.cc:2441] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261118 09:02:23.077342 19494 raft_consensus.cc:499] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261118 09:02:23.077519 19494 raft_consensus.cc:521] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 36925 } } peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } }
I20261118 09:02:23.078701 19494 leader_election.cc:290] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fad312cf224b4b29b985aa1d62a50d14 (127.18.135.129:36925), ff8a27a3ec4b43f5a0b9bad90ab93f76 (127.18.135.131:35435)
I20261118 09:02:23.082633 19155 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "0f7742ebb72c4835aa467da67cc825f6" candidate_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fad312cf224b4b29b985aa1d62a50d14" is_pre_election: true
I20261118 09:02:23.082638 19417 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "0f7742ebb72c4835aa467da67cc825f6" candidate_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" is_pre_election: true
I20261118 09:02:23.082904 19155 raft_consensus.cc:2490] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0a2fb252e43b0a017ccc1763b87c2 in term 0.
I20261118 09:02:23.082904 19417 raft_consensus.cc:2490] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0a2fb252e43b0a017ccc1763b87c2 in term 0.
I20261118 09:02:23.083662 19222 leader_election.cc:304] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0a2fb252e43b0a017ccc1763b87c2, ff8a27a3ec4b43f5a0b9bad90ab93f76; no voters: 
I20261118 09:02:23.083885 19494 raft_consensus.cc:2826] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261118 09:02:23.083971 19494 raft_consensus.cc:499] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261118 09:02:23.084055 19494 raft_consensus.cc:3096] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:23.084939 19494 raft_consensus.cc:521] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 36925 } } peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } }
I20261118 09:02:23.085327 19494 leader_election.cc:290] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [CANDIDATE]: Term 1 election: Requested vote from peers fad312cf224b4b29b985aa1d62a50d14 (127.18.135.129:36925), ff8a27a3ec4b43f5a0b9bad90ab93f76 (127.18.135.131:35435)
I20261118 09:02:23.085711 19155 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "0f7742ebb72c4835aa467da67cc825f6" candidate_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fad312cf224b4b29b985aa1d62a50d14"
I20261118 09:02:23.085742 19417 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "0f7742ebb72c4835aa467da67cc825f6" candidate_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76"
I20261118 09:02:23.085858 19155 raft_consensus.cc:3096] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:23.085865 19417 raft_consensus.cc:3096] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:23.086838 19417 raft_consensus.cc:2490] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0a2fb252e43b0a017ccc1763b87c2 in term 1.
I20261118 09:02:23.086838 19155 raft_consensus.cc:2490] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0a2fb252e43b0a017ccc1763b87c2 in term 1.
I20261118 09:02:23.087110 19222 leader_election.cc:304] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0a2fb252e43b0a017ccc1763b87c2, fad312cf224b4b29b985aa1d62a50d14; no voters: 
I20261118 09:02:23.087271 19494 raft_consensus.cc:2826] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 1 FOLLOWER]: Leader election won for term 1
I20261118 09:02:23.087430 19494 raft_consensus.cc:705] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 1 LEADER]: Becoming Leader. State: Replica: 71a0a2fb252e43b0a017ccc1763b87c2, State: Running, Role: LEADER
I20261118 09:02:23.087749 19494 consensus_queue.cc:238] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 36925 } } peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } }
I20261118 09:02:23.090813 19494 consensus_queue.cc:1049] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 09:02:23.091014 19499 consensus_queue.cc:1049] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 09:02:23.090970 19013 catalog_manager.cc:5840] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0a2fb252e43b0a017ccc1763b87c2 (127.18.135.130). New cstate: current_term: 1 leader_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } health_report { overall_health: HEALTHY } } }
W20261118 09:02:23.352560 19195 generic_service.cc:139] {username='slave'} at 127.0.0.1:43432 forcing change of non-runtime-safe flag follower_reject_update_consensus_requests
I20261118 09:02:23.352660 19195 generic_service.cc:175] {username='slave'} at 127.0.0.1:43432 changed flags via RPC: follower_reject_update_consensus_requests from 'false' to 'false'
I20261118 09:02:23.353432 19195 generic_service.cc:175] {username='slave'} at 127.0.0.1:43432 changed flags via RPC: heartbeat_inject_latency_before_heartbeat_ms from '0' to '5000'
W20261118 09:02:23.354267 19326 generic_service.cc:139] {username='slave'} at 127.0.0.1:59386 forcing change of non-runtime-safe flag follower_reject_update_consensus_requests
I20261118 09:02:23.354349 19326 generic_service.cc:175] {username='slave'} at 127.0.0.1:59386 changed flags via RPC: follower_reject_update_consensus_requests from 'false' to 'false'
I20261118 09:02:23.355020 19326 generic_service.cc:175] {username='slave'} at 127.0.0.1:59386 changed flags via RPC: heartbeat_inject_latency_before_heartbeat_ms from '0' to '2000'
W20261118 09:02:23.355782 19457 generic_service.cc:139] {username='slave'} at 127.0.0.1:41376 forcing change of non-runtime-safe flag follower_reject_update_consensus_requests
I20261118 09:02:23.355862 19457 generic_service.cc:175] {username='slave'} at 127.0.0.1:41376 changed flags via RPC: follower_reject_update_consensus_requests from 'false' to 'false'
I20261118 09:02:23.356572 19457 generic_service.cc:175] {username='slave'} at 127.0.0.1:41376 changed flags via RPC: heartbeat_inject_latency_before_heartbeat_ms from '0' to '5000'
I20261118 09:02:23.357950 19286 consensus_queue.cc:238] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 1.31, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } }
I20261118 09:02:23.358912 19416 raft_consensus.cc:1285] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [term 1 FOLLOWER]: Refusing update from remote peer 71a0a2fb252e43b0a017ccc1763b87c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20261118 09:02:23.359258 19530 consensus_queue.cc:1049] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20261118 09:02:23.360733 19501 raft_consensus.cc:2983] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 1 LEADER]: Committing config change with OpId 1.32: config changed from index -1 to 32, VOTER fad312cf224b4b29b985aa1d62a50d14 (127.18.135.129) evicted. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } } }
I20261118 09:02:23.361043 19416 raft_consensus.cc:2983] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index -1 to 32, VOTER fad312cf224b4b29b985aa1d62a50d14 (127.18.135.129) evicted. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } } }
W20261118 09:02:23.363242 19326 generic_service.cc:139] {username='slave'} at 127.0.0.1:59386 forcing change of non-runtime-safe flag follower_reject_update_consensus_requests
I20261118 09:02:23.363305 19326 generic_service.cc:175] {username='slave'} at 127.0.0.1:59386 changed flags via RPC: follower_reject_update_consensus_requests from 'false' to 'true'
I20261118 09:02:23.363953 19416 tablet_service.cc:2033] Received Run Leader Election RPC: tablet_id: "0f7742ebb72c4835aa467da67cc825f6"
dest_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76"
 from {username='slave'} at 127.0.0.1:41376
I20261118 09:02:23.364059 19416 raft_consensus.cc:499] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20261118 09:02:23.364109 19416 raft_consensus.cc:3096] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [term 1 FOLLOWER]: Advancing to term 2
I20261118 09:02:23.364684 19416 raft_consensus.cc:521] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } }
I20261118 09:02:23.365392 19416 leader_election.cc:290] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [CANDIDATE]: Term 2 election: Requested vote from peers 71a0a2fb252e43b0a017ccc1763b87c2 (127.18.135.130:43363)
I20261118 09:02:23.369302 19286 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "0f7742ebb72c4835aa467da67cc825f6" candidate_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: true dest_uuid: "71a0a2fb252e43b0a017ccc1763b87c2"
I20261118 09:02:23.369455 19286 raft_consensus.cc:3091] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 1 LEADER]: Stepping down as leader of term 1
I20261118 09:02:23.369508 19286 raft_consensus.cc:748] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71a0a2fb252e43b0a017ccc1763b87c2, State: Running, Role: LEADER
I20261118 09:02:23.369663 19286 consensus_queue.cc:261] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 1.32, Last appended by leader: 32, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } }
I20261118 09:02:23.369838 19286 raft_consensus.cc:3096] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 1 FOLLOWER]: Advancing to term 2
I20261118 09:02:23.370575 19286 raft_consensus.cc:2490] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff8a27a3ec4b43f5a0b9bad90ab93f76 in term 2.
I20261118 09:02:23.370926 19351 leader_election.cc:304] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 71a0a2fb252e43b0a017ccc1763b87c2, ff8a27a3ec4b43f5a0b9bad90ab93f76; no voters: 
I20261118 09:02:23.371151 19503 raft_consensus.cc:2826] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [term 2 FOLLOWER]: Leader election won for term 2
I20261118 09:02:23.371348 19503 raft_consensus.cc:705] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [term 2 LEADER]: Becoming Leader. State: Replica: ff8a27a3ec4b43f5a0b9bad90ab93f76, State: Running, Role: LEADER
I20261118 09:02:23.371632 19503 consensus_queue.cc:238] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 1.32, Last appended by leader: 32, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } }
W20261118 09:02:23.373391 19351 consensus_peers.cc:597] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 -> Peer 71a0a2fb252e43b0a017ccc1763b87c2 (127.18.135.130:43363): Couldn't send request to peer 71a0a2fb252e43b0a017ccc1763b87c2. Error code: UNKNOWN_ERROR (1). Status: Illegal state: Rejected: --follower_reject_update_consensus_requests is set to true.. This is attempt 1: this message will repeat every 5th retry.
I20261118 09:02:25.363857 19010 catalog_manager.cc:5840] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 reported cstate change: config changed from index -1 to 32, term changed from 1 to 2, leader changed from 71a0a2fb252e43b0a017ccc1763b87c2 (127.18.135.130) to <none>, VOTER fad312cf224b4b29b985aa1d62a50d14 (127.18.135.129) evicted. New cstate: current_term: 2 committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } } }
I20261118 09:02:25.367949 19135 tablet_service.cc:1547] Processing DeleteTablet for tablet 0f7742ebb72c4835aa467da67cc825f6 with delete_type TABLET_DATA_TOMBSTONED (TS fad312cf224b4b29b985aa1d62a50d14 not found in new config with opid_index 32) from {username='slave'} at 127.0.0.1:43420
I20261118 09:02:25.368538 19538 tablet_replica.cc:333] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: stopping tablet replica
I20261118 09:02:25.368783 19538 raft_consensus.cc:2261] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261118 09:02:25.369026 19538 raft_consensus.cc:2290] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261118 09:02:25.370054 19538 ts_tablet_manager.cc:1962] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20261118 09:02:25.371966 19538 ts_tablet_manager.cc:1975] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.31
I20261118 09:02:25.372061 19538 log.cc:1199] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Deleting WAL directory at /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794992541567553-18974-0/minicluster-data/ts-0/wal/wals/0f7742ebb72c4835aa467da67cc825f6
I20261118 09:02:25.372709 19000 catalog_manager.cc:5065] TS fad312cf224b4b29b985aa1d62a50d14 (127.18.135.129:36925): tablet 0f7742ebb72c4835aa467da67cc825f6 (table test-workload [id=c438d0385fd042e2b29c299cc9b70c8c]) successfully deleted
W20261118 09:02:25.405576 19326 generic_service.cc:139] {username='slave'} at 127.0.0.1:59386 forcing change of non-runtime-safe flag follower_reject_update_consensus_requests
I20261118 09:02:25.405678 19326 generic_service.cc:175] {username='slave'} at 127.0.0.1:59386 changed flags via RPC: follower_reject_update_consensus_requests from 'true' to 'false'
I20261118 09:02:25.408406 18974 cluster_itest_util.cc:258] Not converged past 1 yet: 2.33 1.32 <uninitialized op>
I20261118 09:02:25.511229 18974 cluster_itest_util.cc:258] Not converged past 1 yet: 2.33 1.32 <uninitialized op>
I20261118 09:02:25.714095 18974 cluster_itest_util.cc:258] Not converged past 1 yet: 2.33 1.32 <uninitialized op>
I20261118 09:02:26.016659 18974 cluster_itest_util.cc:258] Not converged past 1 yet: 2.33 2.33 <uninitialized op>
I20261118 09:02:26.419687 18974 cluster_itest_util.cc:258] Not converged past 1 yet: 2.33 2.33 <uninitialized op>
I20261118 09:02:26.922468 18974 cluster_itest_util.cc:258] Not converged past 1 yet: 2.33 2.33 <uninitialized op>
I20261118 09:02:27.369220 19010 catalog_manager.cc:5840] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 reported cstate change: leader changed from <none> to ff8a27a3ec4b43f5a0b9bad90ab93f76 (127.18.135.131). New cstate: current_term: 2 leader_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } } }
I20261118 09:02:27.525279 18974 cluster_itest_util.cc:258] Not converged past 1 yet: 2.33 2.33 <uninitialized op>
I20261118 09:02:28.227988 18974 cluster_itest_util.cc:258] Not converged past 1 yet: 2.33 2.33 <uninitialized op>
I20261118 09:02:28.366242 19416 consensus_queue.cc:238] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 2.33, Last appended by leader: 32, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } } peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 36925 } attrs { promote: true } }
I20261118 09:02:28.368201 19286 raft_consensus.cc:1285] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 2 FOLLOWER]: Refusing update from remote peer ff8a27a3ec4b43f5a0b9bad90ab93f76: Log matching property violated. Preceding OpId in replica: term: 2 index: 33. Preceding OpId from leader: term: 2 index: 34. (index mismatch)
I20261118 09:02:28.368745 19551 consensus_queue.cc:1049] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20261118 09:02:28.371191 19552 raft_consensus.cc:2983] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 [term 2 LEADER]: Committing config change with OpId 2.34: config changed from index 32 to 34, NON_VOTER fad312cf224b4b29b985aa1d62a50d14 (127.18.135.129) added. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } } peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 36925 } attrs { promote: true } } }
I20261118 09:02:28.372619 19286 raft_consensus.cc:2983] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 [term 2 FOLLOWER]: Committing config change with OpId 2.34: config changed from index 32 to 34, NON_VOTER fad312cf224b4b29b985aa1d62a50d14 (127.18.135.129) added. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } } peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 36925 } attrs { promote: true } } }
W20261118 09:02:28.373164 19353 consensus_peers.cc:597] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76 -> Peer fad312cf224b4b29b985aa1d62a50d14 (127.18.135.129:36925): Couldn't send request to peer fad312cf224b4b29b985aa1d62a50d14. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20261118 09:02:28.373329 19000 catalog_manager.cc:5247] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 0f7742ebb72c4835aa467da67cc825f6 with cas_config_opid_index 32: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20261118 09:02:29.030972 18974 cluster_itest_util.cc:258] Not converged past 1 yet: 2.34 2.34 <uninitialized op>
I20261118 09:02:29.374006 19010 catalog_manager.cc:5840] T 0f7742ebb72c4835aa467da67cc825f6 P 71a0a2fb252e43b0a017ccc1763b87c2 reported cstate change: config changed from index 32 to 34, NON_VOTER fad312cf224b4b29b985aa1d62a50d14 (127.18.135.129) added. New cstate: current_term: 2 leader_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" committed_config { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } } peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 36925 } attrs { promote: true } } }
I20261118 09:02:29.933696 18974 cluster_itest_util.cc:258] Not converged past 1 yet: 2.34 2.34 <uninitialized op>
I20261118 09:02:30.936611 18974 cluster_itest_util.cc:258] Not converged past 1 yet: 2.34 2.34 <uninitialized op>
I20261118 09:02:31.766062 19563 ts_tablet_manager.cc:979] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Initiating tablet copy from peer ff8a27a3ec4b43f5a0b9bad90ab93f76 (127.18.135.131:35435)
I20261118 09:02:31.766750 19563 tablet_copy_client.cc:323] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: tablet copy: Beginning tablet copy session from remote peer at address 127.18.135.131:35435
I20261118 09:02:31.770602 19437 tablet_copy_service.cc:140] P ff8a27a3ec4b43f5a0b9bad90ab93f76: Received BeginTabletCopySession request for tablet 0f7742ebb72c4835aa467da67cc825f6 from peer fad312cf224b4b29b985aa1d62a50d14 ({username='slave'} at 127.18.135.129:34671)
I20261118 09:02:31.770725 19437 tablet_copy_service.cc:161] P ff8a27a3ec4b43f5a0b9bad90ab93f76: Beginning new tablet copy session on tablet 0f7742ebb72c4835aa467da67cc825f6 from peer fad312cf224b4b29b985aa1d62a50d14 at {username='slave'} at 127.18.135.129:34671: session id = fad312cf224b4b29b985aa1d62a50d14-0f7742ebb72c4835aa467da67cc825f6
I20261118 09:02:31.771940 19437 tablet_copy_source_session.cc:215] T 0f7742ebb72c4835aa467da67cc825f6 P ff8a27a3ec4b43f5a0b9bad90ab93f76: Tablet Copy: opened 0 blocks and 1 log segments
I20261118 09:02:31.773262 19563 ts_tablet_manager.cc:1962] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Deleting tablet data with delete state TABLET_DATA_COPYING
I20261118 09:02:31.775249 19563 ts_tablet_manager.cc:1975] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.31
I20261118 09:02:31.775470 19563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7742ebb72c4835aa467da67cc825f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:31.776525 19563 tablet_copy_client.cc:806] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: tablet copy: Starting download of 0 data blocks...
I20261118 09:02:31.776696 19563 tablet_copy_client.cc:670] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: tablet copy: Starting download of 1 WAL segments...
I20261118 09:02:31.778651 19563 tablet_copy_client.cc:538] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261118 09:02:31.779976 19563 tablet_bootstrap.cc:492] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Bootstrap starting.
I20261118 09:02:31.826911 19563 tablet_bootstrap.cc:492] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Bootstrap replayed 1/1 log segments. Stats: ops{read=34 overwritten=0 applied=34 ignored=0} inserts{seen=1500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261118 09:02:31.827268 19563 tablet_bootstrap.cc:492] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Bootstrap complete.
I20261118 09:02:31.827474 19563 ts_tablet_manager.cc:1449] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Time spent bootstrapping tablet: real 0.048s	user 0.043s	sys 0.004s
I20261118 09:02:31.827961 19563 raft_consensus.cc:360] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } } peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 36925 } attrs { promote: true } }
I20261118 09:02:31.828092 19563 raft_consensus.cc:748] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: fad312cf224b4b29b985aa1d62a50d14, State: Initialized, Role: LEARNER
I20261118 09:02:31.828246 19563 consensus_queue.cc:261] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 34, Last appended: 2.34, Last appended by leader: 34, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "ff8a27a3ec4b43f5a0b9bad90ab93f76" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 35435 } } peers { permanent_uuid: "71a0a2fb252e43b0a017ccc1763b87c2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43363 } } peers { permanent_uuid: "fad312cf224b4b29b985aa1d62a50d14" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 36925 } attrs { promote: true } }
I20261118 09:02:31.828601 19563 ts_tablet_manager.cc:1480] T 0f7742ebb72c4835aa467da67cc825f6 P fad312cf224b4b29b985aa1d62a50d14: Time spent starting tablet: real 0.001s	user 0.003s	sys 0.000s
I20261118 09:02:31.829458 19437 tablet_copy_service.cc:342] P ff8a27a3ec4b43f5a0b9bad90ab93f76: Request end of tablet copy session fad312cf224b4b29b985aa1d62a50d14-0f7742ebb72c4835aa467da67cc825f6 received from {username='slave'} at 127.18.135.129:34671
I20261118 09:02:31.829555 19437 tablet_copy_service.cc:434] P ff8a27a3ec4b43f5a0b9bad90ab93f76: ending tablet copy session fad312cf224b4b29b985aa1d62a50d14-0f7742ebb72c4835aa467da67cc825f6 on tablet 0f7742ebb72c4835aa467da67cc825f6 with peer fad312cf224b4b29b985aa1d62a50d14
I20261118 09:02:31.940402 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 19073
I20261118 09:02:31.947386 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 19204
I20261118 09:02:31.953190 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 19335
I20261118 09:02:31.958745 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 18982
2026-11-18T09:02:31Z chronyd exiting
[       OK ] RaftConfigChangeITest.TestKudu2147 (10403 ms)
[ RUN      ] RaftConfigChangeITest.TestNonVoterPromotion
2026-11-18T09:02:31Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-18T09:02:31Z Disabled control of system clock
I20261118 09:02:31.987893 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.135.190:35533
--webserver_interface=127.18.135.190
--webserver_port=0
--builtin_ntp_servers=127.18.135.148:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.135.190:35533
--raft_prepare_replacement_before_eviction=true
--catalog_manager_evict_excess_replicas=false with env {}
W20261118 09:02:32.085609 19572 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:32.085791 19572 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:32.085868 19572 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:32.089156 19572 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261118 09:02:32.089207 19572 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:32.089262 19572 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261118 09:02:32.089305 19572 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261118 09:02:32.093242 19572 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/wal
--catalog_manager_evict_excess_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.18.135.190:35533
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.135.190:35533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.135.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.19572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:32.093986 19572 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:32.094679 19572 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:32.099392 19580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:32.099347 19577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:32.099539 19578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:32.099654 19572 server_base.cc:1061] running on GCE node
I20261118 09:02:32.100135 19572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:32.100737 19572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:32.101861 19572 hybrid_clock.cc:648] HybridClock initialized: now 1794992552101839 us; error 32 us; skew 500 ppm
I20261118 09:02:32.103417 19572 webserver.cc:577] Webserver started at http://127.18.135.190:42283/ using document root <none> and password file <none>
I20261118 09:02:32.103958 19572 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:32.104005 19572 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:32.104257 19572 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:32.105479 19572 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/data/instance:
uuid: "787a6dacf5014c34a51b66bf006ca404"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.105945 19572 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/wal/instance:
uuid: "787a6dacf5014c34a51b66bf006ca404"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.108870 19572 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.002s
I20261118 09:02:32.111029 19586 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:32.111922 19572 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261118 09:02:32.112058 19572 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/wal
uuid: "787a6dacf5014c34a51b66bf006ca404"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.112159 19572 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:32.121210 19572 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:32.121603 19572 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:32.121788 19572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:32.128141 19572 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.190:35533
I20261118 09:02:32.128150 19638 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.190:35533 every 8 connection(s)
I20261118 09:02:32.129072 19572 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/data/info.pb
I20261118 09:02:32.132043 19639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:32.132339 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 19572
I20261118 09:02:32.132463 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/master-0/wal/instance
I20261118 09:02:32.138248 19639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404: Bootstrap starting.
I20261118 09:02:32.140271 19639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:32.140996 19639 log.cc:826] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:32.142340 19639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404: No bootstrap required, opened a new log
I20261118 09:02:32.144586 19639 raft_consensus.cc:360] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "787a6dacf5014c34a51b66bf006ca404" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 35533 } }
I20261118 09:02:32.144820 19639 raft_consensus.cc:386] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:32.144910 19639 raft_consensus.cc:748] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787a6dacf5014c34a51b66bf006ca404, State: Initialized, Role: FOLLOWER
I20261118 09:02:32.145301 19639 consensus_queue.cc:261] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "787a6dacf5014c34a51b66bf006ca404" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 35533 } }
I20261118 09:02:32.145511 19639 raft_consensus.cc:400] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261118 09:02:32.145588 19639 raft_consensus.cc:499] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261118 09:02:32.145685 19639 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:32.146621 19639 raft_consensus.cc:521] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "787a6dacf5014c34a51b66bf006ca404" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 35533 } }
I20261118 09:02:32.146991 19639 leader_election.cc:304] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 787a6dacf5014c34a51b66bf006ca404; no voters: 
I20261118 09:02:32.147310 19639 leader_election.cc:290] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261118 09:02:32.147403 19644 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [term 1 FOLLOWER]: Leader election won for term 1
I20261118 09:02:32.147647 19644 raft_consensus.cc:705] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [term 1 LEADER]: Becoming Leader. State: Replica: 787a6dacf5014c34a51b66bf006ca404, State: Running, Role: LEADER
I20261118 09:02:32.147964 19644 consensus_queue.cc:238] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "787a6dacf5014c34a51b66bf006ca404" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 35533 } }
I20261118 09:02:32.148362 19639 sys_catalog.cc:565] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [sys.catalog]: configured and running, proceeding with master startup.
I20261118 09:02:32.149556 19646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 787a6dacf5014c34a51b66bf006ca404. Latest consensus state: current_term: 1 leader_uuid: "787a6dacf5014c34a51b66bf006ca404" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "787a6dacf5014c34a51b66bf006ca404" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 35533 } } }
I20261118 09:02:32.149689 19646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [sys.catalog]: This master's current role is: LEADER
I20261118 09:02:32.150082 19645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "787a6dacf5014c34a51b66bf006ca404" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "787a6dacf5014c34a51b66bf006ca404" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 35533 } } }
I20261118 09:02:32.150235 19645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404 [sys.catalog]: This master's current role is: LEADER
I20261118 09:02:32.150367 19653 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261118 09:02:32.153110 19653 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261118 09:02:32.157949 19653 catalog_manager.cc:1398] Generated new cluster ID: 4e89e28b800d4837b9bfc16e681f0320
I20261118 09:02:32.158010 19653 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261118 09:02:32.175164 19653 catalog_manager.cc:1421] Generated new certificate authority record
I20261118 09:02:32.176201 19653 catalog_manager.cc:1555] Loading token signing keys...
I20261118 09:02:32.192526 19653 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 787a6dacf5014c34a51b66bf006ca404: Generated new TSK 0
I20261118 09:02:32.193140 19653 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261118 09:02:32.205107 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.129:0
--local_ip_for_outbound_sockets=127.18.135.129
--webserver_interface=127.18.135.129
--webserver_port=0
--tserver_master_addrs=127.18.135.190:35533
--builtin_ntp_servers=127.18.135.148:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20261118 09:02:32.306708 19663 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:32.306861 19663 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:32.306912 19663 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:32.310352 19663 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:32.310500 19663 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.129
I20261118 09:02:32.314373 19663 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.135.129
--webserver_port=0
--tserver_master_addrs=127.18.135.190:35533
--never_fsync=true
--heap_profile_path=/tmp/kudu.19663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:32.315091 19663 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:32.315819 19663 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:32.320942 19668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:32.320957 19669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:32.320948 19671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:32.321218 19663 server_base.cc:1061] running on GCE node
I20261118 09:02:32.321549 19663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:32.322093 19663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:32.323236 19663 hybrid_clock.cc:648] HybridClock initialized: now 1794992552323211 us; error 36 us; skew 500 ppm
I20261118 09:02:32.324661 19663 webserver.cc:577] Webserver started at http://127.18.135.129:33259/ using document root <none> and password file <none>
I20261118 09:02:32.325168 19663 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:32.325213 19663 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:32.325381 19663 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:32.326612 19663 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/data/instance:
uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.326992 19663 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/wal/instance:
uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.329977 19663 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20261118 09:02:32.332301 19677 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:32.333207 19663 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20261118 09:02:32.333324 19663 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/wal
uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.333416 19663 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:32.355677 19663 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:32.356154 19663 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:32.356324 19663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:32.356829 19663 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:32.357818 19663 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:32.357863 19663 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:32.357945 19663 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:32.357985 19663 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:32.366703 19663 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.129:41449
I20261118 09:02:32.366729 19790 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.129:41449 every 8 connection(s)
I20261118 09:02:32.367640 19663 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/data/info.pb
I20261118 09:02:32.370445 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 19663
I20261118 09:02:32.370558 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-0/wal/instance
I20261118 09:02:32.372799 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.130:0
--local_ip_for_outbound_sockets=127.18.135.130
--webserver_interface=127.18.135.130
--webserver_port=0
--tserver_master_addrs=127.18.135.190:35533
--builtin_ntp_servers=127.18.135.148:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20261118 09:02:32.375758 19791 heartbeater.cc:345] Connected to a master server at 127.18.135.190:35533
I20261118 09:02:32.375964 19791 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:32.376447 19791 heartbeater.cc:508] Master 127.18.135.190:35533 requested a full tablet report, sending...
I20261118 09:02:32.378176 19603 ts_manager.cc:210] Registered new tserver with Master: fcbe8a5cf4984f6ebbc8cef19a98838a (127.18.135.129:41449)
I20261118 09:02:32.380029 19603 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.129:46585
W20261118 09:02:32.472554 19794 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:32.472714 19794 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:32.472755 19794 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:32.476145 19794 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:32.476245 19794 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.130
I20261118 09:02:32.480021 19794 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.135.130
--webserver_port=0
--tserver_master_addrs=127.18.135.190:35533
--never_fsync=true
--heap_profile_path=/tmp/kudu.19794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:32.480710 19794 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:32.481343 19794 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:32.486907 19800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:32.487058 19802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:32.487021 19794 server_base.cc:1061] running on GCE node
W20261118 09:02:32.487177 19799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:32.487560 19794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:32.488160 19794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:32.489303 19794 hybrid_clock.cc:648] HybridClock initialized: now 1794992552489291 us; error 28 us; skew 500 ppm
I20261118 09:02:32.490897 19794 webserver.cc:577] Webserver started at http://127.18.135.130:40067/ using document root <none> and password file <none>
I20261118 09:02:32.491460 19794 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:32.491508 19794 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:32.491731 19794 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:32.492995 19794 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/data/instance:
uuid: "f0df2437445843ff92258004410c48f2"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.493443 19794 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/wal/instance:
uuid: "f0df2437445843ff92258004410c48f2"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.496659 19794 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20261118 09:02:32.499029 19808 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:32.500005 19794 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261118 09:02:32.500147 19794 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/wal
uuid: "f0df2437445843ff92258004410c48f2"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.500252 19794 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:32.513325 19794 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:32.513917 19794 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:32.514088 19794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:32.514592 19794 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:32.515609 19794 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:32.515676 19794 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:32.515753 19794 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:32.515797 19794 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:32.524792 19794 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.130:36251
I20261118 09:02:32.524819 19921 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.130:36251 every 8 connection(s)
I20261118 09:02:32.525810 19794 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/data/info.pb
I20261118 09:02:32.528659 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 19794
I20261118 09:02:32.528795 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-1/wal/instance
I20261118 09:02:32.531085 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.131:0
--local_ip_for_outbound_sockets=127.18.135.131
--webserver_interface=127.18.135.131
--webserver_port=0
--tserver_master_addrs=127.18.135.190:35533
--builtin_ntp_servers=127.18.135.148:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20261118 09:02:32.534001 19922 heartbeater.cc:345] Connected to a master server at 127.18.135.190:35533
I20261118 09:02:32.534243 19922 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:32.534720 19922 heartbeater.cc:508] Master 127.18.135.190:35533 requested a full tablet report, sending...
I20261118 09:02:32.535842 19603 ts_manager.cc:210] Registered new tserver with Master: f0df2437445843ff92258004410c48f2 (127.18.135.130:36251)
I20261118 09:02:32.536697 19603 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.130:54691
W20261118 09:02:32.634326 19925 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:32.634485 19925 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:32.634524 19925 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:32.637814 19925 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:32.637953 19925 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.131
I20261118 09:02:32.642202 19925 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.135.131
--webserver_port=0
--tserver_master_addrs=127.18.135.190:35533
--never_fsync=true
--heap_profile_path=/tmp/kudu.19925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:32.642872 19925 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:32.643504 19925 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20261118 09:02:32.649183 19925 server_base.cc:1061] running on GCE node
W20261118 09:02:32.649155 19931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:32.649171 19930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:32.649251 19933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:32.649787 19925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:32.650318 19925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:32.651459 19925 hybrid_clock.cc:648] HybridClock initialized: now 1794992552651427 us; error 47 us; skew 500 ppm
I20261118 09:02:32.652886 19925 webserver.cc:577] Webserver started at http://127.18.135.131:43041/ using document root <none> and password file <none>
I20261118 09:02:32.653378 19925 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:32.653431 19925 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:32.653682 19925 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:32.654937 19925 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/data/instance:
uuid: "de3ecfff03fd46afbf97de3dbc68193c"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.655308 19925 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/wal/instance:
uuid: "de3ecfff03fd46afbf97de3dbc68193c"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.658326 19925 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.002s
I20261118 09:02:32.660328 19939 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:32.661242 19925 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20261118 09:02:32.661406 19925 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/wal
uuid: "de3ecfff03fd46afbf97de3dbc68193c"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.661511 19925 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:32.685497 19925 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:32.686095 19925 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:32.686272 19925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:32.686856 19925 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:32.687841 19925 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:32.687912 19925 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:32.687990 19925 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:32.688041 19925 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:32.697336 19925 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.131:37081
I20261118 09:02:32.697359 20052 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.131:37081 every 8 connection(s)
I20261118 09:02:32.698467 19925 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/data/info.pb
I20261118 09:02:32.705854 20053 heartbeater.cc:345] Connected to a master server at 127.18.135.190:35533
I20261118 09:02:32.706092 20053 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:32.706589 20053 heartbeater.cc:508] Master 127.18.135.190:35533 requested a full tablet report, sending...
I20261118 09:02:32.707269 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 19925
I20261118 09:02:32.707388 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-2/wal/instance
I20261118 09:02:32.707666 19603 ts_manager.cc:210] Registered new tserver with Master: de3ecfff03fd46afbf97de3dbc68193c (127.18.135.131:37081)
I20261118 09:02:32.708320 19603 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.131:59781
I20261118 09:02:32.709594 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.132:0
--local_ip_for_outbound_sockets=127.18.135.132
--webserver_interface=127.18.135.132
--webserver_port=0
--tserver_master_addrs=127.18.135.190:35533
--builtin_ntp_servers=127.18.135.148:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20261118 09:02:32.811489 20056 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:32.811677 20056 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:32.811759 20056 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:32.815164 20056 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:32.815336 20056 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.132
I20261118 09:02:32.819186 20056 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.18.135.132
--webserver_port=0
--tserver_master_addrs=127.18.135.190:35533
--never_fsync=true
--heap_profile_path=/tmp/kudu.20056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:32.819962 20056 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:32.820662 20056 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:32.826061 20064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:32.826109 20062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:32.826231 20056 server_base.cc:1061] running on GCE node
W20261118 09:02:32.826285 20061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:32.826714 20056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:32.827237 20056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:32.828410 20056 hybrid_clock.cc:648] HybridClock initialized: now 1794992552828399 us; error 24 us; skew 500 ppm
I20261118 09:02:32.830018 20056 webserver.cc:577] Webserver started at http://127.18.135.132:35667/ using document root <none> and password file <none>
I20261118 09:02:32.830577 20056 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:32.830651 20056 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:32.830911 20056 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:32.832227 20056 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/data/instance:
uuid: "c627ff57a7a941afa58e23bf80736d82"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.832681 20056 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/wal/instance:
uuid: "c627ff57a7a941afa58e23bf80736d82"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.835903 20056 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 09:02:32.838179 20070 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:32.839206 20056 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 09:02:32.839340 20056 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/wal
uuid: "c627ff57a7a941afa58e23bf80736d82"
format_stamp: "Formatted at 2026-11-18 09:02:32 on dist-test-slave-q6bx"
I20261118 09:02:32.839454 20056 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:32.854857 20056 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:32.855336 20056 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:32.855510 20056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:32.856021 20056 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:32.856966 20056 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:32.857036 20056 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:32.857110 20056 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:32.857162 20056 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:32.866353 20056 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.132:43031
I20261118 09:02:32.866375 20183 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.132:43031 every 8 connection(s)
I20261118 09:02:32.867281 20056 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/data/info.pb
I20261118 09:02:32.874287 20184 heartbeater.cc:345] Connected to a master server at 127.18.135.190:35533
I20261118 09:02:32.874534 20184 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:32.874816 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 20056
I20261118 09:02:32.874924 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794992541567553-18974-0/minicluster-data/ts-3/wal/instance
I20261118 09:02:32.875087 20184 heartbeater.cc:508] Master 127.18.135.190:35533 requested a full tablet report, sending...
I20261118 09:02:32.876250 19603 ts_manager.cc:210] Registered new tserver with Master: c627ff57a7a941afa58e23bf80736d82 (127.18.135.132:43031)
I20261118 09:02:32.876995 19603 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.132:48589
I20261118 09:02:32.877403 18974 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 09:02:32.893337 19603 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40662:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261118 09:02:32.910475 20118 tablet_service.cc:1500] Processing CreateTablet for tablet f36a1c262de646ab9b46de5e3f2afcff (DEFAULT_TABLE table=test-workload [id=545d1651960842eeb3980461a7a0afe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:32.910503 19856 tablet_service.cc:1500] Processing CreateTablet for tablet f36a1c262de646ab9b46de5e3f2afcff (DEFAULT_TABLE table=test-workload [id=545d1651960842eeb3980461a7a0afe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:32.910503 19725 tablet_service.cc:1500] Processing CreateTablet for tablet f36a1c262de646ab9b46de5e3f2afcff (DEFAULT_TABLE table=test-workload [id=545d1651960842eeb3980461a7a0afe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:32.911358 20118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36a1c262de646ab9b46de5e3f2afcff. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:32.911381 19856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36a1c262de646ab9b46de5e3f2afcff. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:32.911382 19725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36a1c262de646ab9b46de5e3f2afcff. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:32.916507 20206 tablet_bootstrap.cc:492] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82: Bootstrap starting.
I20261118 09:02:32.917541 20207 tablet_bootstrap.cc:492] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a: Bootstrap starting.
I20261118 09:02:32.918083 20208 tablet_bootstrap.cc:492] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2: Bootstrap starting.
I20261118 09:02:32.919238 20206 tablet_bootstrap.cc:654] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:32.919857 20207 tablet_bootstrap.cc:654] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:32.920105 20208 tablet_bootstrap.cc:654] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:32.920161 20206 log.cc:826] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:32.920703 20207 log.cc:826] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:32.920929 20208 log.cc:826] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:32.921818 20206 tablet_bootstrap.cc:492] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82: No bootstrap required, opened a new log
I20261118 09:02:32.922030 20206 ts_tablet_manager.cc:1449] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20261118 09:02:32.922443 20208 tablet_bootstrap.cc:492] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2: No bootstrap required, opened a new log
I20261118 09:02:32.922643 20208 ts_tablet_manager.cc:1449] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 09:02:32.924736 20206 raft_consensus.cc:360] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } }
I20261118 09:02:32.924891 20206 raft_consensus.cc:386] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:32.924957 20206 raft_consensus.cc:748] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c627ff57a7a941afa58e23bf80736d82, State: Initialized, Role: FOLLOWER
I20261118 09:02:32.925251 20208 raft_consensus.cc:360] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } }
I20261118 09:02:32.925426 20208 raft_consensus.cc:386] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:32.925405 20206 consensus_queue.cc:261] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } }
I20261118 09:02:32.925485 20208 raft_consensus.cc:748] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0df2437445843ff92258004410c48f2, State: Initialized, Role: FOLLOWER
I20261118 09:02:32.925886 20208 consensus_queue.cc:261] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } }
I20261118 09:02:32.926110 20184 heartbeater.cc:500] Master 127.18.135.190:35533 was elected leader, sending a full tablet report...
I20261118 09:02:32.926241 20206 ts_tablet_manager.cc:1480] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20261118 09:02:32.926507 19922 heartbeater.cc:500] Master 127.18.135.190:35533 was elected leader, sending a full tablet report...
I20261118 09:02:32.926622 20208 ts_tablet_manager.cc:1480] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20261118 09:02:32.927503 20207 tablet_bootstrap.cc:492] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a: No bootstrap required, opened a new log
I20261118 09:02:32.927685 20207 ts_tablet_manager.cc:1449] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a: Time spent bootstrapping tablet: real 0.010s	user 0.004s	sys 0.000s
I20261118 09:02:32.930635 20207 raft_consensus.cc:360] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } }
I20261118 09:02:32.930832 20207 raft_consensus.cc:386] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:32.930896 20207 raft_consensus.cc:748] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcbe8a5cf4984f6ebbc8cef19a98838a, State: Initialized, Role: FOLLOWER
I20261118 09:02:32.931290 20207 consensus_queue.cc:261] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } }
I20261118 09:02:32.931823 19791 heartbeater.cc:500] Master 127.18.135.190:35533 was elected leader, sending a full tablet report...
I20261118 09:02:32.931965 20207 ts_tablet_manager.cc:1480] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
W20261118 09:02:33.026777 19923 tablet.cc:2441] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 09:02:33.118060 20185 tablet.cc:2441] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 09:02:33.118743 19792 tablet.cc:2441] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261118 09:02:33.156587 20212 raft_consensus.cc:499] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261118 09:02:33.156791 20212 raft_consensus.cc:521] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } }
I20261118 09:02:33.158028 20212 leader_election.cc:290] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcbe8a5cf4984f6ebbc8cef19a98838a (127.18.135.129:41449), f0df2437445843ff92258004410c48f2 (127.18.135.130:36251)
I20261118 09:02:33.162178 19745 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "f36a1c262de646ab9b46de5e3f2afcff" candidate_uuid: "c627ff57a7a941afa58e23bf80736d82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" is_pre_election: true
I20261118 09:02:33.162465 19745 raft_consensus.cc:2490] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c627ff57a7a941afa58e23bf80736d82 in term 0.
I20261118 09:02:33.162438 19876 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "f36a1c262de646ab9b46de5e3f2afcff" candidate_uuid: "c627ff57a7a941afa58e23bf80736d82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0df2437445843ff92258004410c48f2" is_pre_election: true
I20261118 09:02:33.162712 19876 raft_consensus.cc:2490] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c627ff57a7a941afa58e23bf80736d82 in term 0.
I20261118 09:02:33.162951 20072 leader_election.cc:304] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c627ff57a7a941afa58e23bf80736d82, fcbe8a5cf4984f6ebbc8cef19a98838a; no voters: 
I20261118 09:02:33.163211 20212 raft_consensus.cc:2826] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261118 09:02:33.163280 20212 raft_consensus.cc:499] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261118 09:02:33.163322 20212 raft_consensus.cc:3096] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:33.164204 20212 raft_consensus.cc:521] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } }
I20261118 09:02:33.164584 20212 leader_election.cc:290] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [CANDIDATE]: Term 1 election: Requested vote from peers fcbe8a5cf4984f6ebbc8cef19a98838a (127.18.135.129:41449), f0df2437445843ff92258004410c48f2 (127.18.135.130:36251)
I20261118 09:02:33.164914 19745 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "f36a1c262de646ab9b46de5e3f2afcff" candidate_uuid: "c627ff57a7a941afa58e23bf80736d82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a"
I20261118 09:02:33.164976 19876 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "f36a1c262de646ab9b46de5e3f2afcff" candidate_uuid: "c627ff57a7a941afa58e23bf80736d82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0df2437445843ff92258004410c48f2"
I20261118 09:02:33.165040 19745 raft_consensus.cc:3096] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:33.165119 19876 raft_consensus.cc:3096] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:33.166322 19745 raft_consensus.cc:2490] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c627ff57a7a941afa58e23bf80736d82 in term 1.
I20261118 09:02:33.166431 19876 raft_consensus.cc:2490] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c627ff57a7a941afa58e23bf80736d82 in term 1.
I20261118 09:02:33.166618 20072 leader_election.cc:304] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c627ff57a7a941afa58e23bf80736d82, fcbe8a5cf4984f6ebbc8cef19a98838a; no voters: 
I20261118 09:02:33.166828 20212 raft_consensus.cc:2826] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [term 1 FOLLOWER]: Leader election won for term 1
I20261118 09:02:33.167068 20212 raft_consensus.cc:705] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [term 1 LEADER]: Becoming Leader. State: Replica: c627ff57a7a941afa58e23bf80736d82, State: Running, Role: LEADER
I20261118 09:02:33.167399 20212 consensus_queue.cc:238] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } }
I20261118 09:02:33.170722 20218 consensus_queue.cc:1049] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 09:02:33.170890 20216 consensus_queue.cc:1049] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 09:02:33.171033 19603 catalog_manager.cc:5840] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 reported cstate change: term changed from 0 to 1, leader changed from <none> to c627ff57a7a941afa58e23bf80736d82 (127.18.135.132). New cstate: current_term: 1 leader_uuid: "c627ff57a7a941afa58e23bf80736d82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } health_report { overall_health: HEALTHY } } }
I20261118 09:02:33.207036 20138 consensus_queue.cc:238] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } } peers { permanent_uuid: "de3ecfff03fd46afbf97de3dbc68193c" member_type: NON_VOTER last_known_addr { host: "127.18.135.131" port: 37081 } attrs { promote: true } }
I20261118 09:02:33.209020 19745 raft_consensus.cc:1285] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a [term 1 FOLLOWER]: Refusing update from remote peer c627ff57a7a941afa58e23bf80736d82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20261118 09:02:33.208997 19876 raft_consensus.cc:1285] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2 [term 1 FOLLOWER]: Refusing update from remote peer c627ff57a7a941afa58e23bf80736d82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20261118 09:02:33.209435 20218 consensus_queue.cc:1049] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20261118 09:02:33.209616 20212 consensus_queue.cc:1049] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20261118 09:02:33.211388 20212 raft_consensus.cc:2983] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER de3ecfff03fd46afbf97de3dbc68193c (127.18.135.131) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } } peers { permanent_uuid: "de3ecfff03fd46afbf97de3dbc68193c" member_type: NON_VOTER last_known_addr { host: "127.18.135.131" port: 37081 } attrs { promote: true } } }
I20261118 09:02:33.211882 19745 raft_consensus.cc:2983] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER de3ecfff03fd46afbf97de3dbc68193c (127.18.135.131) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } } peers { permanent_uuid: "de3ecfff03fd46afbf97de3dbc68193c" member_type: NON_VOTER last_known_addr { host: "127.18.135.131" port: 37081 } attrs { promote: true } } }
W20261118 09:02:33.214211 20072 consensus_peers.cc:597] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 -> Peer de3ecfff03fd46afbf97de3dbc68193c (127.18.135.131:37081): Couldn't send request to peer de3ecfff03fd46afbf97de3dbc68193c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f36a1c262de646ab9b46de5e3f2afcff. This is attempt 1: this message will repeat every 5th retry.
I20261118 09:02:33.214120 19876 raft_consensus.cc:2983] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER de3ecfff03fd46afbf97de3dbc68193c (127.18.135.131) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } } peers { permanent_uuid: "de3ecfff03fd46afbf97de3dbc68193c" member_type: NON_VOTER last_known_addr { host: "127.18.135.131" port: 37081 } attrs { promote: true } } }
I20261118 09:02:33.214885 19600 catalog_manager.cc:5840] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 reported cstate change: config changed from index -1 to 2, NON_VOTER de3ecfff03fd46afbf97de3dbc68193c (127.18.135.131) added. New cstate: current_term: 1 leader_uuid: "c627ff57a7a941afa58e23bf80736d82" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de3ecfff03fd46afbf97de3dbc68193c" member_type: NON_VOTER last_known_addr { host: "127.18.135.131" port: 37081 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20261118 09:02:33.700331 20227 ts_tablet_manager.cc:979] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c: Initiating tablet copy from peer c627ff57a7a941afa58e23bf80736d82 (127.18.135.132:43031)
I20261118 09:02:33.700997 20227 tablet_copy_client.cc:323] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.135.132:43031
I20261118 09:02:33.704872 20158 tablet_copy_service.cc:140] P c627ff57a7a941afa58e23bf80736d82: Received BeginTabletCopySession request for tablet f36a1c262de646ab9b46de5e3f2afcff from peer de3ecfff03fd46afbf97de3dbc68193c ({username='slave'} at 127.18.135.131:51289)
I20261118 09:02:33.705036 20158 tablet_copy_service.cc:161] P c627ff57a7a941afa58e23bf80736d82: Beginning new tablet copy session on tablet f36a1c262de646ab9b46de5e3f2afcff from peer de3ecfff03fd46afbf97de3dbc68193c at {username='slave'} at 127.18.135.131:51289: session id = de3ecfff03fd46afbf97de3dbc68193c-f36a1c262de646ab9b46de5e3f2afcff
I20261118 09:02:33.706383 20158 tablet_copy_source_session.cc:215] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82: Tablet Copy: opened 0 blocks and 1 log segments
I20261118 09:02:33.709848 20227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36a1c262de646ab9b46de5e3f2afcff. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:33.710246 20053 heartbeater.cc:500] Master 127.18.135.190:35533 was elected leader, sending a full tablet report...
I20261118 09:02:33.714807 20227 tablet_copy_client.cc:806] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c: tablet copy: Starting download of 0 data blocks...
I20261118 09:02:33.715000 20227 tablet_copy_client.cc:670] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c: tablet copy: Starting download of 1 WAL segments...
I20261118 09:02:33.716761 20227 tablet_copy_client.cc:538] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261118 09:02:33.718384 20227 tablet_bootstrap.cc:492] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c: Bootstrap starting.
I20261118 09:02:33.722448 20227 log.cc:826] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:33.724436 20227 tablet_bootstrap.cc:492] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261118 09:02:33.724720 20227 tablet_bootstrap.cc:492] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c: Bootstrap complete.
I20261118 09:02:33.724997 20227 ts_tablet_manager.cc:1449] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c: Time spent bootstrapping tablet: real 0.007s	user 0.005s	sys 0.000s
I20261118 09:02:33.727221 20227 raft_consensus.cc:360] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } } peers { permanent_uuid: "de3ecfff03fd46afbf97de3dbc68193c" member_type: NON_VOTER last_known_addr { host: "127.18.135.131" port: 37081 } attrs { promote: true } }
I20261118 09:02:33.727402 20227 raft_consensus.cc:748] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: de3ecfff03fd46afbf97de3dbc68193c, State: Initialized, Role: LEARNER
I20261118 09:02:33.727756 20227 consensus_queue.cc:261] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } } peers { permanent_uuid: "de3ecfff03fd46afbf97de3dbc68193c" member_type: NON_VOTER last_known_addr { host: "127.18.135.131" port: 37081 } attrs { promote: true } }
I20261118 09:02:33.728474 20227 ts_tablet_manager.cc:1480] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c: Time spent starting tablet: real 0.003s	user 0.005s	sys 0.000s
I20261118 09:02:33.729152 20158 tablet_copy_service.cc:342] P c627ff57a7a941afa58e23bf80736d82: Request end of tablet copy session de3ecfff03fd46afbf97de3dbc68193c-f36a1c262de646ab9b46de5e3f2afcff received from {username='slave'} at 127.18.135.131:51289
I20261118 09:02:33.729266 20158 tablet_copy_service.cc:434] P c627ff57a7a941afa58e23bf80736d82: ending tablet copy session de3ecfff03fd46afbf97de3dbc68193c-f36a1c262de646ab9b46de5e3f2afcff on tablet f36a1c262de646ab9b46de5e3f2afcff with peer de3ecfff03fd46afbf97de3dbc68193c
I20261118 09:02:34.140214 20007 raft_consensus.cc:1227] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20261118 09:02:34.616168 20212 raft_consensus.cc:1074] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82: attempting to promote NON_VOTER de3ecfff03fd46afbf97de3dbc68193c to VOTER
I20261118 09:02:34.616688 20212 consensus_queue.cc:238] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } } peers { permanent_uuid: "de3ecfff03fd46afbf97de3dbc68193c" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 37081 } attrs { promote: false } }
I20261118 09:02:34.618213 19745 raft_consensus.cc:1285] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a [term 1 FOLLOWER]: Refusing update from remote peer c627ff57a7a941afa58e23bf80736d82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20261118 09:02:34.618255 20007 raft_consensus.cc:1285] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c [term 1 LEARNER]: Refusing update from remote peer c627ff57a7a941afa58e23bf80736d82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20261118 09:02:34.618304 19876 raft_consensus.cc:1285] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2 [term 1 FOLLOWER]: Refusing update from remote peer c627ff57a7a941afa58e23bf80736d82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20261118 09:02:34.618672 20233 consensus_queue.cc:1049] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20261118 09:02:34.618875 20232 consensus_queue.cc:1049] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de3ecfff03fd46afbf97de3dbc68193c" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 37081 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20261118 09:02:34.618999 20235 consensus_queue.cc:1049] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20261118 09:02:34.620985 20233 raft_consensus.cc:2983] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, de3ecfff03fd46afbf97de3dbc68193c (127.18.135.131) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } } peers { permanent_uuid: "de3ecfff03fd46afbf97de3dbc68193c" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 37081 } attrs { promote: false } } }
I20261118 09:02:34.621449 19745 raft_consensus.cc:2983] T f36a1c262de646ab9b46de5e3f2afcff P fcbe8a5cf4984f6ebbc8cef19a98838a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, de3ecfff03fd46afbf97de3dbc68193c (127.18.135.131) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } } peers { permanent_uuid: "de3ecfff03fd46afbf97de3dbc68193c" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 37081 } attrs { promote: false } } }
I20261118 09:02:34.622474 20007 raft_consensus.cc:2983] T f36a1c262de646ab9b46de5e3f2afcff P de3ecfff03fd46afbf97de3dbc68193c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, de3ecfff03fd46afbf97de3dbc68193c (127.18.135.131) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } } peers { permanent_uuid: "de3ecfff03fd46afbf97de3dbc68193c" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 37081 } attrs { promote: false } } }
I20261118 09:02:34.623903 19603 catalog_manager.cc:5840] T f36a1c262de646ab9b46de5e3f2afcff P c627ff57a7a941afa58e23bf80736d82 reported cstate change: config changed from index 2 to 3, de3ecfff03fd46afbf97de3dbc68193c (127.18.135.131) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c627ff57a7a941afa58e23bf80736d82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de3ecfff03fd46afbf97de3dbc68193c" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 37081 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20261118 09:02:34.624703 19876 raft_consensus.cc:2983] T f36a1c262de646ab9b46de5e3f2afcff P f0df2437445843ff92258004410c48f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, de3ecfff03fd46afbf97de3dbc68193c (127.18.135.131) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcbe8a5cf4984f6ebbc8cef19a98838a" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 41449 } } peers { permanent_uuid: "f0df2437445843ff92258004410c48f2" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 36251 } } peers { permanent_uuid: "c627ff57a7a941afa58e23bf80736d82" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43031 } } peers { permanent_uuid: "de3ecfff03fd46afbf97de3dbc68193c" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 37081 } attrs { promote: false } } }
I20261118 09:02:34.642885 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 19663
I20261118 09:02:34.649151 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 19794
I20261118 09:02:34.654928 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 19925
I20261118 09:02:34.660398 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 20056
I20261118 09:02:34.665853 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 19572
2026-11-18T09:02:34Z chronyd exiting
[       OK ] RaftConfigChangeITest.TestNonVoterPromotion (2707 ms)
[ RUN      ] RaftConfigChangeITest.TestBulkChangeConfig
2026-11-18T09:02:34Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-18T09:02:34Z Disabled control of system clock
I20261118 09:02:34.695022 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.135.190:34167
--webserver_interface=127.18.135.190
--webserver_port=0
--builtin_ntp_servers=127.18.135.148:42707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.135.190:34167
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--raft_prepare_replacement_before_eviction=true with env {}
W20261118 09:02:34.793119 20248 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:34.793265 20248 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:34.793303 20248 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:34.796553 20248 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261118 09:02:34.796604 20248 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:34.796626 20248 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261118 09:02:34.796644 20248 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261118 09:02:34.800359 20248 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:42707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.18.135.190:34167
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.135.190:34167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.135.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.20248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:34.801028 20248 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:34.801661 20248 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:34.806391 20256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:34.806475 20254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:34.806504 20253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:34.806682 20248 server_base.cc:1061] running on GCE node
I20261118 09:02:34.807122 20248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:34.807796 20248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:34.808940 20248 hybrid_clock.cc:648] HybridClock initialized: now 1794992554808930 us; error 23 us; skew 500 ppm
I20261118 09:02:34.810583 20248 webserver.cc:577] Webserver started at http://127.18.135.190:43829/ using document root <none> and password file <none>
I20261118 09:02:34.811136 20248 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:34.811183 20248 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:34.811399 20248 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:34.812638 20248 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/data/instance:
uuid: "d8dcbc2f880a45f78272a5bf920ea74c"
format_stamp: "Formatted at 2026-11-18 09:02:34 on dist-test-slave-q6bx"
I20261118 09:02:34.813059 20248 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/wal/instance:
uuid: "d8dcbc2f880a45f78272a5bf920ea74c"
format_stamp: "Formatted at 2026-11-18 09:02:34 on dist-test-slave-q6bx"
I20261118 09:02:34.816618 20248 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 09:02:34.818842 20262 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:34.819743 20248 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261118 09:02:34.819878 20248 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/wal
uuid: "d8dcbc2f880a45f78272a5bf920ea74c"
format_stamp: "Formatted at 2026-11-18 09:02:34 on dist-test-slave-q6bx"
I20261118 09:02:34.819965 20248 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:34.841514 20248 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:34.842140 20248 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:34.842303 20248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:34.851974 20314 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.190:34167 every 8 connection(s)
I20261118 09:02:34.851986 20248 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.190:34167
I20261118 09:02:34.853436 20248 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/data/info.pb
I20261118 09:02:34.858093 20315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:34.859407 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 20248
I20261118 09:02:34.859524 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/master-0/wal/instance
I20261118 09:02:34.864805 20315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c: Bootstrap starting.
I20261118 09:02:34.867635 20315 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:34.868566 20315 log.cc:826] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:34.870242 20315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c: No bootstrap required, opened a new log
I20261118 09:02:34.873865 20315 raft_consensus.cc:360] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8dcbc2f880a45f78272a5bf920ea74c" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 34167 } }
I20261118 09:02:34.874070 20315 raft_consensus.cc:386] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:34.874128 20315 raft_consensus.cc:748] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8dcbc2f880a45f78272a5bf920ea74c, State: Initialized, Role: FOLLOWER
I20261118 09:02:34.874507 20315 consensus_queue.cc:261] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8dcbc2f880a45f78272a5bf920ea74c" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 34167 } }
I20261118 09:02:34.874660 20315 raft_consensus.cc:400] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261118 09:02:34.874747 20315 raft_consensus.cc:499] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261118 09:02:34.874835 20315 raft_consensus.cc:3096] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:34.875846 20315 raft_consensus.cc:521] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8dcbc2f880a45f78272a5bf920ea74c" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 34167 } }
I20261118 09:02:34.876217 20315 leader_election.cc:304] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8dcbc2f880a45f78272a5bf920ea74c; no voters: 
I20261118 09:02:34.876601 20315 leader_election.cc:290] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261118 09:02:34.876662 20320 raft_consensus.cc:2826] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [term 1 FOLLOWER]: Leader election won for term 1
I20261118 09:02:34.876840 20320 raft_consensus.cc:705] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [term 1 LEADER]: Becoming Leader. State: Replica: d8dcbc2f880a45f78272a5bf920ea74c, State: Running, Role: LEADER
I20261118 09:02:34.877197 20320 consensus_queue.cc:238] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8dcbc2f880a45f78272a5bf920ea74c" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 34167 } }
I20261118 09:02:34.877678 20315 sys_catalog.cc:565] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [sys.catalog]: configured and running, proceeding with master startup.
I20261118 09:02:34.878794 20321 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8dcbc2f880a45f78272a5bf920ea74c. Latest consensus state: current_term: 1 leader_uuid: "d8dcbc2f880a45f78272a5bf920ea74c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8dcbc2f880a45f78272a5bf920ea74c" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 34167 } } }
I20261118 09:02:34.879293 20321 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [sys.catalog]: This master's current role is: LEADER
I20261118 09:02:34.879192 20322 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8dcbc2f880a45f78272a5bf920ea74c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8dcbc2f880a45f78272a5bf920ea74c" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 34167 } } }
I20261118 09:02:34.879631 20322 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c [sys.catalog]: This master's current role is: LEADER
W20261118 09:02:34.882393 20336 catalog_manager.cc:1609] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20261118 09:02:34.882478 20336 catalog_manager.cc:898] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20261118 09:02:34.882537 20331 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261118 09:02:34.883550 20331 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261118 09:02:34.888492 20331 catalog_manager.cc:1398] Generated new cluster ID: f29565d6f3de4f3e988e39430ce156a8
I20261118 09:02:34.888551 20331 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261118 09:02:34.906111 20331 catalog_manager.cc:1421] Generated new certificate authority record
I20261118 09:02:34.907188 20331 catalog_manager.cc:1555] Loading token signing keys...
I20261118 09:02:34.916456 20331 catalog_manager.cc:6221] T 00000000000000000000000000000000 P d8dcbc2f880a45f78272a5bf920ea74c: Generated new TSK 0
I20261118 09:02:34.917153 20331 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261118 09:02:34.923002 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.129:0
--local_ip_for_outbound_sockets=127.18.135.129
--webserver_interface=127.18.135.129
--webserver_port=0
--tserver_master_addrs=127.18.135.190:34167
--builtin_ntp_servers=127.18.135.148:42707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=true with env {}
W20261118 09:02:35.023124 20339 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20261118 09:02:35.023335 20339 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:35.023412 20339 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:35.023509 20339 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:35.027328 20339 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:35.027511 20339 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.129
I20261118 09:02:35.031368 20339 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:42707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.135.129
--webserver_port=0
--tserver_master_addrs=127.18.135.190:34167
--never_fsync=true
--heap_profile_path=/tmp/kudu.20339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:35.032124 20339 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:35.032814 20339 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:35.038095 20345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:35.038136 20347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:35.038254 20344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:35.038548 20339 server_base.cc:1061] running on GCE node
I20261118 09:02:35.038908 20339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:35.039520 20339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:35.040683 20339 hybrid_clock.cc:648] HybridClock initialized: now 1794992555040662 us; error 29 us; skew 500 ppm
I20261118 09:02:35.042423 20339 webserver.cc:577] Webserver started at http://127.18.135.129:38367/ using document root <none> and password file <none>
I20261118 09:02:35.043054 20339 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:35.043110 20339 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:35.043323 20339 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:35.044905 20339 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/data/instance:
uuid: "7bd7242379b54aa9b38afe6426d26c07"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:35.045390 20339 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/wal/instance:
uuid: "7bd7242379b54aa9b38afe6426d26c07"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:35.049019 20339 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.003s
I20261118 09:02:35.051167 20353 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:35.052076 20339 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20261118 09:02:35.052166 20339 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/wal
uuid: "7bd7242379b54aa9b38afe6426d26c07"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:35.052235 20339 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:35.069615 20339 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:35.070132 20339 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:35.070250 20339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:35.070690 20339 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:35.071568 20339 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:35.071611 20339 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:35.071652 20339 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:35.071667 20339 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:35.080334 20339 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.129:34335
I20261118 09:02:35.080420 20466 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.129:34335 every 8 connection(s)
I20261118 09:02:35.081287 20339 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/data/info.pb
I20261118 09:02:35.088135 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 20339
I20261118 09:02:35.088276 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-0/wal/instance
I20261118 09:02:35.089363 20467 heartbeater.cc:345] Connected to a master server at 127.18.135.190:34167
I20261118 09:02:35.089607 20467 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:35.090097 20467 heartbeater.cc:508] Master 127.18.135.190:34167 requested a full tablet report, sending...
I20261118 09:02:35.090387 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.130:0
--local_ip_for_outbound_sockets=127.18.135.130
--webserver_interface=127.18.135.130
--webserver_port=0
--tserver_master_addrs=127.18.135.190:34167
--builtin_ntp_servers=127.18.135.148:42707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=true with env {}
I20261118 09:02:35.091846 20279 ts_manager.cc:210] Registered new tserver with Master: 7bd7242379b54aa9b38afe6426d26c07 (127.18.135.129:34335)
I20261118 09:02:35.093075 20279 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.129:40743
W20261118 09:02:35.190035 20470 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20261118 09:02:35.190253 20470 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:35.190327 20470 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:35.190440 20470 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:35.194205 20470 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:35.194393 20470 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.130
I20261118 09:02:35.198360 20470 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:42707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.135.130
--webserver_port=0
--tserver_master_addrs=127.18.135.190:34167
--never_fsync=true
--heap_profile_path=/tmp/kudu.20470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:35.199141 20470 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:35.199852 20470 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:35.205440 20475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:35.205463 20476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:35.205662 20478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:35.205852 20470 server_base.cc:1061] running on GCE node
I20261118 09:02:35.206131 20470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:35.206640 20470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:35.207793 20470 hybrid_clock.cc:648] HybridClock initialized: now 1794992555207761 us; error 46 us; skew 500 ppm
I20261118 09:02:35.209348 20470 webserver.cc:577] Webserver started at http://127.18.135.130:42227/ using document root <none> and password file <none>
I20261118 09:02:35.209978 20470 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:35.210029 20470 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:35.210310 20470 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:35.211905 20470 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/data/instance:
uuid: "8ddc1048b3344105a3461cca7ecb56eb"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:35.212280 20470 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/wal/instance:
uuid: "8ddc1048b3344105a3461cca7ecb56eb"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:35.215934 20470 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 09:02:35.218380 20484 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:35.219347 20470 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 09:02:35.219439 20470 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/wal
uuid: "8ddc1048b3344105a3461cca7ecb56eb"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:35.219513 20470 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:35.253660 20470 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:35.254196 20470 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:35.254313 20470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:35.254762 20470 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:35.255661 20470 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:35.255707 20470 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:35.255748 20470 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:35.255764 20470 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:35.265082 20470 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.130:46265
I20261118 09:02:35.265112 20597 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.130:46265 every 8 connection(s)
I20261118 09:02:35.266156 20470 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/data/info.pb
I20261118 09:02:35.273972 20598 heartbeater.cc:345] Connected to a master server at 127.18.135.190:34167
I20261118 09:02:35.274178 20598 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:35.274644 20598 heartbeater.cc:508] Master 127.18.135.190:34167 requested a full tablet report, sending...
I20261118 09:02:35.275616 20279 ts_manager.cc:210] Registered new tserver with Master: 8ddc1048b3344105a3461cca7ecb56eb (127.18.135.130:46265)
I20261118 09:02:35.276139 20279 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.130:42887
I20261118 09:02:35.276309 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 20470
I20261118 09:02:35.276427 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-1/wal/instance
I20261118 09:02:35.278587 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.131:0
--local_ip_for_outbound_sockets=127.18.135.131
--webserver_interface=127.18.135.131
--webserver_port=0
--tserver_master_addrs=127.18.135.190:34167
--builtin_ntp_servers=127.18.135.148:42707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=true with env {}
W20261118 09:02:35.377022 20601 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20261118 09:02:35.377180 20601 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:35.377202 20601 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:35.377239 20601 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:35.380779 20601 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:35.380873 20601 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.131
I20261118 09:02:35.384649 20601 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:42707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.135.131
--webserver_port=0
--tserver_master_addrs=127.18.135.190:34167
--never_fsync=true
--heap_profile_path=/tmp/kudu.20601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:35.385274 20601 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:35.385972 20601 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:35.391144 20609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:35.391263 20601 server_base.cc:1061] running on GCE node
W20261118 09:02:35.391268 20606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:35.391162 20607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:35.391670 20601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:35.392196 20601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:35.393360 20601 hybrid_clock.cc:648] HybridClock initialized: now 1794992555393348 us; error 31 us; skew 500 ppm
I20261118 09:02:35.394936 20601 webserver.cc:577] Webserver started at http://127.18.135.131:41689/ using document root <none> and password file <none>
I20261118 09:02:35.395507 20601 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:35.395586 20601 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:35.395816 20601 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:35.397089 20601 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/data/instance:
uuid: "8e6eeff3d47748b395cbe0ff537558e6"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:35.397526 20601 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/wal/instance:
uuid: "8e6eeff3d47748b395cbe0ff537558e6"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:35.400645 20601 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.001s
I20261118 09:02:35.402819 20615 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:35.403779 20601 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261118 09:02:35.403919 20601 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/wal
uuid: "8e6eeff3d47748b395cbe0ff537558e6"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:35.404024 20601 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:35.422662 20601 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:35.423241 20601 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:35.423405 20601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:35.424008 20601 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:35.424944 20601 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:35.425015 20601 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:35.425092 20601 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:35.425144 20601 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:35.433837 20601 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.131:43101
I20261118 09:02:35.433876 20728 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.131:43101 every 8 connection(s)
I20261118 09:02:35.434769 20601 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/data/info.pb
I20261118 09:02:35.441998 20729 heartbeater.cc:345] Connected to a master server at 127.18.135.190:34167
I20261118 09:02:35.442209 20729 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:35.442641 20729 heartbeater.cc:508] Master 127.18.135.190:34167 requested a full tablet report, sending...
I20261118 09:02:35.443570 20279 ts_manager.cc:210] Registered new tserver with Master: 8e6eeff3d47748b395cbe0ff537558e6 (127.18.135.131:43101)
I20261118 09:02:35.443648 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 20601
I20261118 09:02:35.443768 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-2/wal/instance
I20261118 09:02:35.444180 20279 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.131:56225
I20261118 09:02:35.445609 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.132:0
--local_ip_for_outbound_sockets=127.18.135.132
--webserver_interface=127.18.135.132
--webserver_port=0
--tserver_master_addrs=127.18.135.190:34167
--builtin_ntp_servers=127.18.135.148:42707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=true with env {}
W20261118 09:02:35.543267 20732 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20261118 09:02:35.543422 20732 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:35.543444 20732 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:35.543480 20732 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:35.546661 20732 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:35.546749 20732 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.132
I20261118 09:02:35.550479 20732 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:42707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.18.135.132
--webserver_port=0
--tserver_master_addrs=127.18.135.190:34167
--never_fsync=true
--heap_profile_path=/tmp/kudu.20732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:35.551188 20732 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:35.551824 20732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:35.557160 20737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:35.557207 20738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:35.557265 20740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:35.557505 20732 server_base.cc:1061] running on GCE node
I20261118 09:02:35.557850 20732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:35.558341 20732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:35.559480 20732 hybrid_clock.cc:648] HybridClock initialized: now 1794992555559474 us; error 30 us; skew 500 ppm
I20261118 09:02:35.560954 20732 webserver.cc:577] Webserver started at http://127.18.135.132:34971/ using document root <none> and password file <none>
I20261118 09:02:35.561479 20732 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:35.561527 20732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:35.561813 20732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:35.563062 20732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/data/instance:
uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:35.563480 20732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/wal/instance:
uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:35.566493 20732 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20261118 09:02:35.568585 20746 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:35.569525 20732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 09:02:35.569618 20732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/wal
uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:35.569774 20732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:35.592913 20732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:35.593364 20732 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:35.593528 20732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:35.594066 20732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:35.594972 20732 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:35.595016 20732 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:35.595089 20732 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:35.595125 20732 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:35.603950 20732 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.132:45085
I20261118 09:02:35.603978 20859 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.132:45085 every 8 connection(s)
I20261118 09:02:35.604975 20732 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/data/info.pb
I20261118 09:02:35.610638 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 20732
I20261118 09:02:35.610770 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794992541567553-18974-0/minicluster-data/ts-3/wal/instance
I20261118 09:02:35.612696 20860 heartbeater.cc:345] Connected to a master server at 127.18.135.190:34167
I20261118 09:02:35.612898 20860 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:35.613479 20860 heartbeater.cc:508] Master 127.18.135.190:34167 requested a full tablet report, sending...
I20261118 09:02:35.614440 20278 ts_manager.cc:210] Registered new tserver with Master: ec92b1ab43a946b1a9fbfaa3d1b877ef (127.18.135.132:45085)
I20261118 09:02:35.614953 20278 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.132:57585
I20261118 09:02:35.624830 18974 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 09:02:35.640727 20278 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42286:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261118 09:02:35.657444 20401 tablet_service.cc:1500] Processing CreateTablet for tablet 48c0b0e3f09f48cca1dd0233e062f846 (DEFAULT_TABLE table=test-workload [id=0a25fd94893c4ceca284019628688b34]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:35.657514 20794 tablet_service.cc:1500] Processing CreateTablet for tablet 48c0b0e3f09f48cca1dd0233e062f846 (DEFAULT_TABLE table=test-workload [id=0a25fd94893c4ceca284019628688b34]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:35.657514 20663 tablet_service.cc:1500] Processing CreateTablet for tablet 48c0b0e3f09f48cca1dd0233e062f846 (DEFAULT_TABLE table=test-workload [id=0a25fd94893c4ceca284019628688b34]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:35.658354 20401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c0b0e3f09f48cca1dd0233e062f846. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:35.658408 20794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c0b0e3f09f48cca1dd0233e062f846. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:35.658408 20663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c0b0e3f09f48cca1dd0233e062f846. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:35.663373 20882 tablet_bootstrap.cc:492] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07: Bootstrap starting.
I20261118 09:02:35.664307 20883 tablet_bootstrap.cc:492] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef: Bootstrap starting.
I20261118 09:02:35.664539 20884 tablet_bootstrap.cc:492] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6: Bootstrap starting.
I20261118 09:02:35.666146 20882 tablet_bootstrap.cc:654] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:35.666563 20883 tablet_bootstrap.cc:654] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:35.666579 20884 tablet_bootstrap.cc:654] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:35.667050 20882 log.cc:826] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:35.667306 20884 log.cc:826] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:35.667379 20883 log.cc:826] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:35.668586 20882 tablet_bootstrap.cc:492] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07: No bootstrap required, opened a new log
I20261118 09:02:35.668582 20884 tablet_bootstrap.cc:492] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6: No bootstrap required, opened a new log
I20261118 09:02:35.668596 20883 tablet_bootstrap.cc:492] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef: No bootstrap required, opened a new log
I20261118 09:02:35.668787 20884 ts_tablet_manager.cc:1449] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6: Time spent bootstrapping tablet: real 0.004s	user 0.003s	sys 0.000s
I20261118 09:02:35.668787 20882 ts_tablet_manager.cc:1449] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07: Time spent bootstrapping tablet: real 0.006s	user 0.001s	sys 0.003s
I20261118 09:02:35.668802 20883 ts_tablet_manager.cc:1449] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 09:02:35.671664 20883 raft_consensus.cc:360] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } }
I20261118 09:02:35.671866 20883 raft_consensus.cc:748] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec92b1ab43a946b1a9fbfaa3d1b877ef, State: Initialized, Role: FOLLOWER
I20261118 09:02:35.671835 20882 raft_consensus.cc:360] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } }
I20261118 09:02:35.671835 20884 raft_consensus.cc:360] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } }
I20261118 09:02:35.672034 20882 raft_consensus.cc:748] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bd7242379b54aa9b38afe6426d26c07, State: Initialized, Role: FOLLOWER
I20261118 09:02:35.672034 20884 raft_consensus.cc:748] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e6eeff3d47748b395cbe0ff537558e6, State: Initialized, Role: FOLLOWER
I20261118 09:02:35.672232 20883 consensus_queue.cc:261] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } }
I20261118 09:02:35.672367 20884 consensus_queue.cc:261] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } }
I20261118 09:02:35.672366 20882 consensus_queue.cc:261] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } }
I20261118 09:02:35.673032 20883 ts_tablet_manager.cc:1480] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20261118 09:02:35.673077 20882 ts_tablet_manager.cc:1480] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.002s
I20261118 09:02:35.673077 20884 ts_tablet_manager.cc:1480] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20261118 09:02:35.673220 20467 heartbeater.cc:500] Master 127.18.135.190:34167 was elected leader, sending a full tablet report...
I20261118 09:02:35.673415 20860 heartbeater.cc:500] Master 127.18.135.190:34167 was elected leader, sending a full tablet report...
I20261118 09:02:35.673668 20729 heartbeater.cc:500] Master 127.18.135.190:34167 was elected leader, sending a full tablet report...
W20261118 09:02:35.685864 20730 tablet.cc:2441] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261118 09:02:35.694514 20814 tablet_service.cc:2033] Received Run Leader Election RPC: tablet_id: "48c0b0e3f09f48cca1dd0233e062f846"
dest_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef"
 from {username='slave'} at 127.0.0.1:40504
I20261118 09:02:35.694715 20814 raft_consensus.cc:499] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20261118 09:02:35.694832 20814 raft_consensus.cc:3096] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:35.695662 20814 raft_consensus.cc:521] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } }
I20261118 09:02:35.696681 20814 leader_election.cc:290] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [CANDIDATE]: Term 1 election: Requested vote from peers 7bd7242379b54aa9b38afe6426d26c07 (127.18.135.129:34335), 8e6eeff3d47748b395cbe0ff537558e6 (127.18.135.131:43101)
I20261118 09:02:35.700629 20421 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "48c0b0e3f09f48cca1dd0233e062f846" candidate_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7bd7242379b54aa9b38afe6426d26c07"
I20261118 09:02:35.700830 20421 raft_consensus.cc:3096] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:35.700894 20683 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "48c0b0e3f09f48cca1dd0233e062f846" candidate_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8e6eeff3d47748b395cbe0ff537558e6"
I20261118 09:02:35.701062 20683 raft_consensus.cc:3096] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:35.702206 20683 raft_consensus.cc:2490] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec92b1ab43a946b1a9fbfaa3d1b877ef in term 1.
I20261118 09:02:35.702454 20421 raft_consensus.cc:2490] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec92b1ab43a946b1a9fbfaa3d1b877ef in term 1.
I20261118 09:02:35.702636 20748 leader_election.cc:304] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e6eeff3d47748b395cbe0ff537558e6, ec92b1ab43a946b1a9fbfaa3d1b877ef; no voters: 
I20261118 09:02:35.702911 20888 raft_consensus.cc:2826] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [term 1 FOLLOWER]: Leader election won for term 1
I20261118 09:02:35.703126 20888 raft_consensus.cc:705] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [term 1 LEADER]: Becoming Leader. State: Replica: ec92b1ab43a946b1a9fbfaa3d1b877ef, State: Running, Role: LEADER
I20261118 09:02:35.703476 20888 consensus_queue.cc:238] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } }
I20261118 09:02:35.706936 20276 catalog_manager.cc:5840] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef reported cstate change: term changed from 0 to 1, leader changed from <none> to ec92b1ab43a946b1a9fbfaa3d1b877ef (127.18.135.132). New cstate: current_term: 1 leader_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } health_report { overall_health: HEALTHY } } }
I20261118 09:02:35.708532 20888 consensus_queue.cc:1049] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 09:02:35.711098 20888 consensus_queue.cc:1049] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 09:02:35.767448 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 20248
I20261118 09:02:35.773999 18974 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 09:02:35.774060 18974 raft_config_change-itest.cc:351] type: ADD_PEER peer { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: false replace: false } }
I20261118 09:02:35.776742 20814 consensus_queue.cc:238] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: false replace: false } }
I20261118 09:02:35.778110 20683 raft_consensus.cc:1285] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 1 FOLLOWER]: Refusing update from remote peer ec92b1ab43a946b1a9fbfaa3d1b877ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20261118 09:02:35.778348 20421 raft_consensus.cc:1285] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 FOLLOWER]: Refusing update from remote peer ec92b1ab43a946b1a9fbfaa3d1b877ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20261118 09:02:35.778662 20900 consensus_queue.cc:1049] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20261118 09:02:35.778767 20899 consensus_queue.cc:1049] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20261118 09:02:35.780733 20683 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index -1 to 10, VOTER 8ddc1048b3344105a3461cca7ecb56eb (127.18.135.130) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: false replace: false } } }
I20261118 09:02:35.780303 20900 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index -1 to 10, VOTER 8ddc1048b3344105a3461cca7ecb56eb (127.18.135.130) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: false replace: false } } }
W20261118 09:02:35.783382 20729 heartbeater.cc:648] Failed to heartbeat to 127.18.135.190:34167 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.135.190:34167: connect: Connection refused (error 111)
W20261118 09:02:35.784071 20747 consensus_peers.cc:597] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef -> Peer 8ddc1048b3344105a3461cca7ecb56eb (127.18.135.130:46265): Couldn't send request to peer 8ddc1048b3344105a3461cca7ecb56eb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48c0b0e3f09f48cca1dd0233e062f846. This is attempt 1: this message will repeat every 5th retry.
I20261118 09:02:35.784164 20421 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index -1 to 10, VOTER 8ddc1048b3344105a3461cca7ecb56eb (127.18.135.130) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: false replace: false } } }
W20261118 09:02:35.784628 20860 heartbeater.cc:648] Failed to heartbeat to 127.18.135.190:34167 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.135.190:34167: connect: Connection refused (error 111)
I20261118 09:02:35.785190 18974 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 09:02:35.785221 18974 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } }
I20261118 09:02:35.785266 18974 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: true replace: false } }
I20261118 09:02:35.786134 20814 consensus_queue.cc:238] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: true replace: false } }
W20261118 09:02:35.786657 20467 heartbeater.cc:648] Failed to heartbeat to 127.18.135.190:34167 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.135.190:34167: connect: Connection refused (error 111)
I20261118 09:02:35.787374 20683 raft_consensus.cc:1285] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 1 FOLLOWER]: Refusing update from remote peer ec92b1ab43a946b1a9fbfaa3d1b877ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20261118 09:02:35.787489 20421 raft_consensus.cc:1285] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 FOLLOWER]: Refusing update from remote peer ec92b1ab43a946b1a9fbfaa3d1b877ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20261118 09:02:35.787838 20897 consensus_queue.cc:1049] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20261118 09:02:35.787948 20747 consensus_peers.cc:597] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef -> Peer 8ddc1048b3344105a3461cca7ecb56eb (127.18.135.130:46265): Couldn't send request to peer 8ddc1048b3344105a3461cca7ecb56eb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48c0b0e3f09f48cca1dd0233e062f846. This is attempt 1: this message will repeat every 5th retry.
I20261118 09:02:35.788050 20900 consensus_queue.cc:1049] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20261118 09:02:35.789109 20897 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, 7bd7242379b54aa9b38afe6426d26c07 (127.18.135.129) changed from VOTER to NON_VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: true replace: false } } }
I20261118 09:02:35.789534 20683 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, 7bd7242379b54aa9b38afe6426d26c07 (127.18.135.129) changed from VOTER to NON_VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: true replace: false } } }
I20261118 09:02:35.789741 20421 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 LEARNER]: Committing config change with OpId 1.11: config changed from index 10 to 11, 7bd7242379b54aa9b38afe6426d26c07 (127.18.135.129) changed from VOTER to NON_VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: true replace: false } } }
I20261118 09:02:35.791477 18974 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 09:02:35.791527 18974 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: true } }
I20261118 09:02:35.792577 20814 consensus_queue.cc:238] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: true } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: true replace: false } }
I20261118 09:02:35.793655 20683 raft_consensus.cc:1285] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 1 FOLLOWER]: Refusing update from remote peer ec92b1ab43a946b1a9fbfaa3d1b877ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20261118 09:02:35.793701 20421 raft_consensus.cc:1285] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 LEARNER]: Refusing update from remote peer ec92b1ab43a946b1a9fbfaa3d1b877ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20261118 09:02:35.794101 20900 consensus_queue.cc:1049] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20261118 09:02:35.794226 20747 consensus_peers.cc:597] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef -> Peer 8ddc1048b3344105a3461cca7ecb56eb (127.18.135.130:46265): Couldn't send request to peer 8ddc1048b3344105a3461cca7ecb56eb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48c0b0e3f09f48cca1dd0233e062f846. This is attempt 1: this message will repeat every 5th retry.
I20261118 09:02:35.794226 20899 consensus_queue.cc:1049] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20261118 09:02:35.795683 20900 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: true } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: true replace: false } } }
I20261118 09:02:35.796205 20683 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: true } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: true replace: false } } }
I20261118 09:02:35.796236 20421 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 LEARNER]: Committing config change with OpId 1.12: config changed from index 11 to 12. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: true } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: true replace: false } } }
I20261118 09:02:35.797945 18974 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 09:02:35.797989 18974 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } }
I20261118 09:02:35.798045 18974 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: NON_VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: false replace: false } }
I20261118 09:02:35.799134 18974 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 09:02:35.799173 18974 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: NON_VOTER last_known_addr { host: "127.18.135.132" port: 45085 } attrs { promote: false replace: false } }
I20261118 09:02:35.800146 18974 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 09:02:35.800184 18974 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: true replace: false } }
I20261118 09:02:35.801084 18974 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 09:02:35.801123 18974 raft_config_change-itest.cc:351] type: REMOVE_PEER peer { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: UNKNOWN_MEMBER_TYPE last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } }
I20261118 09:02:35.801157 18974 raft_config_change-itest.cc:351] type: REMOVE_PEER peer { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: UNKNOWN_MEMBER_TYPE last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: false replace: false } }
I20261118 09:02:35.801893 20813 consensus_queue.cc:238] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } }
I20261118 09:02:35.802785 20683 raft_consensus.cc:1285] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 1 FOLLOWER]: Refusing update from remote peer ec92b1ab43a946b1a9fbfaa3d1b877ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20261118 09:02:35.803135 20888 consensus_queue.cc:1049] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20261118 09:02:35.804461 20897 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, NON_VOTER 7bd7242379b54aa9b38afe6426d26c07 (127.18.135.129) evicted, VOTER 8ddc1048b3344105a3461cca7ecb56eb (127.18.135.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } }
I20261118 09:02:35.805138 20683 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, NON_VOTER 7bd7242379b54aa9b38afe6426d26c07 (127.18.135.129) evicted, VOTER 8ddc1048b3344105a3461cca7ecb56eb (127.18.135.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } }
I20261118 09:02:35.806882 18974 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 09:02:35.806931 18974 raft_config_change-itest.cc:351] type: ADD_PEER peer { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } }
I20261118 09:02:35.806993 18974 raft_config_change-itest.cc:351] type: ADD_PEER peer { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: false replace: false } }
I20261118 09:02:35.807866 18974 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 09:02:35.807909 18974 raft_config_change-itest.cc:351] type: ADD_PEER peer { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } }
I20261118 09:02:35.808468 20813 consensus_queue.cc:238] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } }
I20261118 09:02:35.809432 20683 raft_consensus.cc:1285] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 1 FOLLOWER]: Refusing update from remote peer ec92b1ab43a946b1a9fbfaa3d1b877ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20261118 09:02:35.809453 20421 raft_consensus.cc:1285] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 LEARNER]: Refusing update from remote peer ec92b1ab43a946b1a9fbfaa3d1b877ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20261118 09:02:35.809777 20900 consensus_queue.cc:1049] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20261118 09:02:35.809973 20897 consensus_queue.cc:1049] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20261118 09:02:35.811487 20421 raft_consensus.cc:879] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: true } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: true replace: false } }.
  Pending config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } }: 
  New config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } }
I20261118 09:02:35.811476 20900 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [term 1 LEADER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 7bd7242379b54aa9b38afe6426d26c07 (127.18.135.129) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } } }
W20261118 09:02:35.811650 20421 raft_consensus.cc:1590] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 14' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: NON_VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: true } } peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: true replace: false } }.
  Pending config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } }: 
  New config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } }
I20261118 09:02:35.811820 20683 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 7bd7242379b54aa9b38afe6426d26c07 (127.18.135.129) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } } }
I20261118 09:02:35.812001 20421 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.13: config changed from index 12 to 13, NON_VOTER 7bd7242379b54aa9b38afe6426d26c07 (127.18.135.129) evicted, VOTER 8ddc1048b3344105a3461cca7ecb56eb (127.18.135.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } }
I20261118 09:02:35.813951 18974 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 09:02:35.814015 18974 raft_config_change-itest.cc:351] type: ADD_PEER peer { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: false replace: false } }
I20261118 09:02:35.814802 20813 consensus_queue.cc:238] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 1.14, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: false replace: false } }
I20261118 09:02:35.815068 20421 raft_consensus.cc:1491] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 NON_PARTICIPANT]: Allowing update even though not a member of the config
I20261118 09:02:35.815380 20421 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 7bd7242379b54aa9b38afe6426d26c07 (127.18.135.129) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } } }
W20261118 09:02:35.816506 20747 consensus_peers.cc:597] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef -> Peer 8ddc1048b3344105a3461cca7ecb56eb (127.18.135.130:46265): Couldn't send request to peer 8ddc1048b3344105a3461cca7ecb56eb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48c0b0e3f09f48cca1dd0233e062f846. This is attempt 1: this message will repeat every 5th retry.
I20261118 09:02:35.816742 20683 raft_consensus.cc:1285] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 1 FOLLOWER]: Refusing update from remote peer ec92b1ab43a946b1a9fbfaa3d1b877ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20261118 09:02:35.817060 20420 raft_consensus.cc:1285] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 FOLLOWER]: Refusing update from remote peer ec92b1ab43a946b1a9fbfaa3d1b877ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20261118 09:02:35.817117 20897 consensus_queue.cc:1049] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20261118 09:02:35.817543 20897 consensus_queue.cc:1049] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20261118 09:02:35.818882 20900 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P ec92b1ab43a946b1a9fbfaa3d1b877ef [term 1 LEADER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 8ddc1048b3344105a3461cca7ecb56eb (127.18.135.130) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: false replace: false } } }
I20261118 09:02:35.819178 20421 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P 7bd7242379b54aa9b38afe6426d26c07 [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 8ddc1048b3344105a3461cca7ecb56eb (127.18.135.130) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: false replace: false } } }
I20261118 09:02:35.821049 18974 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 09:02:35.821099 18974 raft_config_change-itest.cc:351] type: REMOVE_PEER peer { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: UNKNOWN_MEMBER_TYPE last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } }
I20261118 09:02:35.821156 18974 raft_config_change-itest.cc:351] type: REMOVE_PEER peer { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: UNKNOWN_MEMBER_TYPE last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: false replace: false } }
I20261118 09:02:35.821861 20683 raft_consensus.cc:2983] T 48c0b0e3f09f48cca1dd0233e062f846 P 8e6eeff3d47748b395cbe0ff537558e6 [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 8ddc1048b3344105a3461cca7ecb56eb (127.18.135.130) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "8e6eeff3d47748b395cbe0ff537558e6" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 43101 } } peers { permanent_uuid: "ec92b1ab43a946b1a9fbfaa3d1b877ef" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 45085 } } peers { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } } peers { permanent_uuid: "8ddc1048b3344105a3461cca7ecb56eb" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 46265 } attrs { promote: false replace: false } } }
I20261118 09:02:35.822080 18974 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 09:02:35.822125 18974 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: false } }
I20261118 09:02:35.822947 18974 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 09:02:35.823997 18974 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 09:02:35.824034 18974 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: false replace: true } }
I20261118 09:02:35.824069 18974 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "7bd7242379b54aa9b38afe6426d26c07" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 34335 } attrs { promote: true replace: false } }
I20261118 09:02:35.825114 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 20339
I20261118 09:02:35.831629 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 20470
I20261118 09:02:35.836953 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 20601
I20261118 09:02:35.842468 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 20732
2026-11-18T09:02:35Z chronyd exiting
[       OK ] RaftConfigChangeITest.TestBulkChangeConfig (1176 ms)
[----------] 3 tests from RaftConfigChangeITest (14287 ms total)

[----------] 3 tests from SlowTabletBootstrapTest
[ RUN      ] SlowTabletBootstrapTest.TestSlowBootstrap
I20261118 09:02:35.865654 18974 ts_itest-base.cc:115] Starting cluster with:
I20261118 09:02:35.865715 18974 ts_itest-base.cc:116] --------------
I20261118 09:02:35.865763 18974 ts_itest-base.cc:117] 4 tablet servers
I20261118 09:02:35.865801 18974 ts_itest-base.cc:118] 3 replicas per TS
I20261118 09:02:35.865823 18974 ts_itest-base.cc:119] --------------
2026-11-18T09:02:35Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-18T09:02:35Z Disabled control of system clock
I20261118 09:02:35.873703 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.135.190:37883
--webserver_interface=127.18.135.190
--webserver_port=0
--builtin_ntp_servers=127.18.135.148:36927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.135.190:37883 with env {}
W20261118 09:02:35.972946 20928 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:35.973162 20928 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:35.973258 20928 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:35.976589 20928 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261118 09:02:35.976677 20928 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:35.976723 20928 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261118 09:02:35.976787 20928 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261118 09:02:35.980636 20928 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:36927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.135.190:37883
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.135.190:37883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.18.135.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.20928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:35.981410 20928 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:35.982172 20928 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:35.987540 20933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:35.987622 20934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:35.987535 20936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:35.987761 20928 server_base.cc:1061] running on GCE node
I20261118 09:02:35.988133 20928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:35.988819 20928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:35.989989 20928 hybrid_clock.cc:648] HybridClock initialized: now 1794992555989970 us; error 37 us; skew 500 ppm
I20261118 09:02:35.991497 20928 webserver.cc:577] Webserver started at http://127.18.135.190:42769/ using document root <none> and password file <none>
I20261118 09:02:35.992076 20928 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:35.992151 20928 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:35.992391 20928 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:35.993664 20928 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "fff9f9a0d8a94110b13f2f345967669c"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:35.994172 20928 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "fff9f9a0d8a94110b13f2f345967669c"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:35.997282 20928 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20261118 09:02:35.999434 20942 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:36.000324 20928 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261118 09:02:36.000468 20928 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
uuid: "fff9f9a0d8a94110b13f2f345967669c"
format_stamp: "Formatted at 2026-11-18 09:02:35 on dist-test-slave-q6bx"
I20261118 09:02:36.000577 20928 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:36.018380 20928 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:36.018870 20928 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:36.019050 20928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:36.026005 20994 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.190:37883 every 8 connection(s)
I20261118 09:02:36.026016 20928 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.190:37883
I20261118 09:02:36.027024 20928 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20261118 09:02:36.028064 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 20928
I20261118 09:02:36.028206 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal/instance
I20261118 09:02:36.030390 20995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:36.035602 20995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c: Bootstrap starting.
I20261118 09:02:36.037783 20995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:36.038645 20995 log.cc:826] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:36.039891 20995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c: No bootstrap required, opened a new log
I20261118 09:02:36.042235 20995 raft_consensus.cc:360] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff9f9a0d8a94110b13f2f345967669c" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 37883 } }
I20261118 09:02:36.042419 20995 raft_consensus.cc:386] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:36.042500 20995 raft_consensus.cc:748] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fff9f9a0d8a94110b13f2f345967669c, State: Initialized, Role: FOLLOWER
I20261118 09:02:36.042870 20995 consensus_queue.cc:261] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff9f9a0d8a94110b13f2f345967669c" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 37883 } }
I20261118 09:02:36.043044 20995 raft_consensus.cc:400] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261118 09:02:36.043123 20995 raft_consensus.cc:499] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261118 09:02:36.043236 20995 raft_consensus.cc:3096] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:36.044247 20995 raft_consensus.cc:521] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff9f9a0d8a94110b13f2f345967669c" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 37883 } }
I20261118 09:02:36.044598 20995 leader_election.cc:304] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fff9f9a0d8a94110b13f2f345967669c; no voters: 
I20261118 09:02:36.044919 20995 leader_election.cc:290] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261118 09:02:36.045013 21000 raft_consensus.cc:2826] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [term 1 FOLLOWER]: Leader election won for term 1
I20261118 09:02:36.045241 21000 raft_consensus.cc:705] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [term 1 LEADER]: Becoming Leader. State: Replica: fff9f9a0d8a94110b13f2f345967669c, State: Running, Role: LEADER
I20261118 09:02:36.045622 21000 consensus_queue.cc:238] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff9f9a0d8a94110b13f2f345967669c" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 37883 } }
I20261118 09:02:36.046001 20995 sys_catalog.cc:565] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [sys.catalog]: configured and running, proceeding with master startup.
I20261118 09:02:36.047129 21001 sys_catalog.cc:455] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fff9f9a0d8a94110b13f2f345967669c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff9f9a0d8a94110b13f2f345967669c" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 37883 } } }
I20261118 09:02:36.047264 21001 sys_catalog.cc:458] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [sys.catalog]: This master's current role is: LEADER
I20261118 09:02:36.047667 21009 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261118 09:02:36.048023 21002 sys_catalog.cc:455] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [sys.catalog]: SysCatalogTable state changed. Reason: New leader fff9f9a0d8a94110b13f2f345967669c. Latest consensus state: current_term: 1 leader_uuid: "fff9f9a0d8a94110b13f2f345967669c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff9f9a0d8a94110b13f2f345967669c" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 37883 } } }
I20261118 09:02:36.048100 21002 sys_catalog.cc:458] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c [sys.catalog]: This master's current role is: LEADER
I20261118 09:02:36.050463 21009 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261118 09:02:36.055269 21009 catalog_manager.cc:1398] Generated new cluster ID: e4191b72eca44e1b9eba571c6cecf62a
I20261118 09:02:36.055332 21009 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261118 09:02:36.076849 21009 catalog_manager.cc:1421] Generated new certificate authority record
I20261118 09:02:36.078032 21009 catalog_manager.cc:1555] Loading token signing keys...
I20261118 09:02:36.103869 21009 catalog_manager.cc:6221] T 00000000000000000000000000000000 P fff9f9a0d8a94110b13f2f345967669c: Generated new TSK 0
I20261118 09:02:36.104650 21009 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261118 09:02:36.117928 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.129:0
--local_ip_for_outbound_sockets=127.18.135.129
--webserver_interface=127.18.135.129
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37883
--builtin_ntp_servers=127.18.135.148:36927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
W20261118 09:02:36.219441 21019 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:36.219626 21019 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:36.219648 21019 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:36.219686 21019 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:36.223009 21019 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:36.223058 21019 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:36.223093 21019 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:36.223151 21019 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:36.223181 21019 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.129
I20261118 09:02:36.226953 21019 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:36927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.18.135.129
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37883
--never_fsync=true
--heap_profile_path=/tmp/kudu.21019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:36.227617 21019 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:36.228253 21019 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:36.233666 21027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:36.233675 21025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:36.233681 21024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:36.233785 21019 server_base.cc:1061] running on GCE node
I20261118 09:02:36.234221 21019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:36.234730 21019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:36.235881 21019 hybrid_clock.cc:648] HybridClock initialized: now 1794992556235866 us; error 28 us; skew 500 ppm
I20261118 09:02:36.237694 21019 webserver.cc:577] Webserver started at http://127.18.135.129:33993/ using document root <none> and password file <none>
I20261118 09:02:36.238368 21019 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:36.238445 21019 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:36.238713 21019 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:36.240330 21019 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "933f864f1da74c77b1e325d5161d6f5e"
format_stamp: "Formatted at 2026-11-18 09:02:36 on dist-test-slave-q6bx"
I20261118 09:02:36.240782 21019 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "933f864f1da74c77b1e325d5161d6f5e"
format_stamp: "Formatted at 2026-11-18 09:02:36 on dist-test-slave-q6bx"
I20261118 09:02:36.243852 21019 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.005s
I20261118 09:02:36.245968 21033 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:36.246869 21019 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20261118 09:02:36.246997 21019 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "933f864f1da74c77b1e325d5161d6f5e"
format_stamp: "Formatted at 2026-11-18 09:02:36 on dist-test-slave-q6bx"
I20261118 09:02:36.247092 21019 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:36.264025 21019 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:36.264441 21019 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:36.264606 21019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:36.265070 21019 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:36.266057 21019 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:36.266151 21019 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:36.266214 21019 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:36.266232 21019 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:36.275074 21019 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.129:42329
I20261118 09:02:36.275128 21146 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.129:42329 every 8 connection(s)
I20261118 09:02:36.276052 21019 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20261118 09:02:36.283218 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 21019
I20261118 09:02:36.283283 21147 heartbeater.cc:345] Connected to a master server at 127.18.135.190:37883
I20261118 09:02:36.283353 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20261118 09:02:36.283492 21147 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:36.284035 21147 heartbeater.cc:508] Master 127.18.135.190:37883 requested a full tablet report, sending...
I20261118 09:02:36.285477 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.130:0
--local_ip_for_outbound_sockets=127.18.135.130
--webserver_interface=127.18.135.130
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37883
--builtin_ntp_servers=127.18.135.148:36927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 09:02:36.285576 20959 ts_manager.cc:210] Registered new tserver with Master: 933f864f1da74c77b1e325d5161d6f5e (127.18.135.129:42329)
I20261118 09:02:36.286816 20959 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.129:58421
W20261118 09:02:36.383770 21150 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:36.383934 21150 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:36.383956 21150 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:36.383992 21150 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:36.387290 21150 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:36.387334 21150 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:36.387367 21150 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:36.387425 21150 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:36.387454 21150 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.130
I20261118 09:02:36.391371 21150 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:36927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.18.135.130
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37883
--never_fsync=true
--heap_profile_path=/tmp/kudu.21150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:36.392017 21150 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:36.392643 21150 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:36.397881 21156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:36.397898 21155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:36.397962 21150 server_base.cc:1061] running on GCE node
W20261118 09:02:36.397889 21158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:36.398420 21150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:36.398938 21150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:36.400112 21150 hybrid_clock.cc:648] HybridClock initialized: now 1794992556400095 us; error 38 us; skew 500 ppm
I20261118 09:02:36.401651 21150 webserver.cc:577] Webserver started at http://127.18.135.130:39369/ using document root <none> and password file <none>
I20261118 09:02:36.402209 21150 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:36.402284 21150 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:36.402498 21150 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:36.403710 21150 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "ad750d7390ff42dfb74d5642b848a63a"
format_stamp: "Formatted at 2026-11-18 09:02:36 on dist-test-slave-q6bx"
I20261118 09:02:36.404150 21150 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "ad750d7390ff42dfb74d5642b848a63a"
format_stamp: "Formatted at 2026-11-18 09:02:36 on dist-test-slave-q6bx"
I20261118 09:02:36.407264 21150 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 09:02:36.409358 21164 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:36.410305 21150 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 09:02:36.410430 21150 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "ad750d7390ff42dfb74d5642b848a63a"
format_stamp: "Formatted at 2026-11-18 09:02:36 on dist-test-slave-q6bx"
I20261118 09:02:36.410539 21150 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:36.426347 21150 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:36.426779 21150 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:36.426941 21150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:36.427413 21150 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:36.428350 21150 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:36.428421 21150 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:36.428498 21150 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:36.428542 21150 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:36.437412 21150 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.130:33937
I20261118 09:02:36.437438 21277 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.130:33937 every 8 connection(s)
I20261118 09:02:36.438440 21150 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20261118 09:02:36.441054 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 21150
I20261118 09:02:36.441180 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20261118 09:02:36.443645 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.131:0
--local_ip_for_outbound_sockets=127.18.135.131
--webserver_interface=127.18.135.131
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37883
--builtin_ntp_servers=127.18.135.148:36927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 09:02:36.446746 21278 heartbeater.cc:345] Connected to a master server at 127.18.135.190:37883
I20261118 09:02:36.446964 21278 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:36.447467 21278 heartbeater.cc:508] Master 127.18.135.190:37883 requested a full tablet report, sending...
I20261118 09:02:36.449519 20959 ts_manager.cc:210] Registered new tserver with Master: ad750d7390ff42dfb74d5642b848a63a (127.18.135.130:33937)
I20261118 09:02:36.450119 20959 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.130:49747
W20261118 09:02:36.542780 21281 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:36.543030 21281 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:36.543097 21281 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:36.543185 21281 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:36.546475 21281 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:36.546566 21281 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:36.546641 21281 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:36.546799 21281 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:36.546872 21281 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.131
I20261118 09:02:36.550935 21281 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:36927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.18.135.131
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37883
--never_fsync=true
--heap_profile_path=/tmp/kudu.21281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:36.551676 21281 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:36.552376 21281 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:36.557639 21287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:36.557610 21286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:36.557606 21289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:36.558008 21281 server_base.cc:1061] running on GCE node
I20261118 09:02:36.558341 21281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:36.558903 21281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:36.560067 21281 hybrid_clock.cc:648] HybridClock initialized: now 1794992556560047 us; error 37 us; skew 500 ppm
I20261118 09:02:36.561575 21281 webserver.cc:577] Webserver started at http://127.18.135.131:40989/ using document root <none> and password file <none>
I20261118 09:02:36.562171 21281 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:36.562247 21281 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:36.562455 21281 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:36.563686 21281 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "8c879176569047a38c68c07400099594"
format_stamp: "Formatted at 2026-11-18 09:02:36 on dist-test-slave-q6bx"
I20261118 09:02:36.564124 21281 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "8c879176569047a38c68c07400099594"
format_stamp: "Formatted at 2026-11-18 09:02:36 on dist-test-slave-q6bx"
I20261118 09:02:36.567668 21281 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.004s
I20261118 09:02:36.569947 21295 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:36.570875 21281 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20261118 09:02:36.571003 21281 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "8c879176569047a38c68c07400099594"
format_stamp: "Formatted at 2026-11-18 09:02:36 on dist-test-slave-q6bx"
I20261118 09:02:36.571102 21281 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:36.579319 21281 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:36.579697 21281 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:36.579850 21281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:36.580304 21281 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:36.581159 21281 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:36.581228 21281 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:36.581300 21281 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:36.581358 21281 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:36.589788 21281 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.131:35833
I20261118 09:02:36.589828 21408 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.131:35833 every 8 connection(s)
I20261118 09:02:36.590747 21281 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20261118 09:02:36.599417 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 21281
I20261118 09:02:36.599526 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20261118 09:02:36.600660 21409 heartbeater.cc:345] Connected to a master server at 127.18.135.190:37883
I20261118 09:02:36.600931 21409 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:36.601467 21409 heartbeater.cc:508] Master 127.18.135.190:37883 requested a full tablet report, sending...
I20261118 09:02:36.602010 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.132:0
--local_ip_for_outbound_sockets=127.18.135.132
--webserver_interface=127.18.135.132
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37883
--builtin_ntp_servers=127.18.135.148:36927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 09:02:36.604285 20959 ts_manager.cc:210] Registered new tserver with Master: 8c879176569047a38c68c07400099594 (127.18.135.131:35833)
I20261118 09:02:36.605046 20959 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.131:48181
W20261118 09:02:36.702075 21412 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:36.702320 21412 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:36.702382 21412 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:36.702481 21412 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:36.706363 21412 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:36.706439 21412 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:36.706506 21412 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:36.706624 21412 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:36.706691 21412 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.132
I20261118 09:02:36.710618 21412 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:36927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.18.135.132
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37883
--never_fsync=true
--heap_profile_path=/tmp/kudu.21412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:36.711371 21412 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:36.712057 21412 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:36.717463 21418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:36.717451 21417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:36.717536 21420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:36.717754 21412 server_base.cc:1061] running on GCE node
I20261118 09:02:36.718084 21412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:36.718639 21412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:36.719815 21412 hybrid_clock.cc:648] HybridClock initialized: now 1794992556719804 us; error 29 us; skew 500 ppm
I20261118 09:02:36.721457 21412 webserver.cc:577] Webserver started at http://127.18.135.132:38069/ using document root <none> and password file <none>
I20261118 09:02:36.722090 21412 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:36.722164 21412 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:36.722404 21412 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:36.723659 21412 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "889fa6912d12497fbfa839d47058a1ee"
format_stamp: "Formatted at 2026-11-18 09:02:36 on dist-test-slave-q6bx"
I20261118 09:02:36.724103 21412 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "889fa6912d12497fbfa839d47058a1ee"
format_stamp: "Formatted at 2026-11-18 09:02:36 on dist-test-slave-q6bx"
I20261118 09:02:36.727226 21412 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 09:02:36.729388 21426 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:36.730372 21412 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 09:02:36.730500 21412 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "889fa6912d12497fbfa839d47058a1ee"
format_stamp: "Formatted at 2026-11-18 09:02:36 on dist-test-slave-q6bx"
I20261118 09:02:36.730597 21412 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:36.746011 21412 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:36.746390 21412 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:36.746551 21412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:36.747062 21412 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:36.747936 21412 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:36.748013 21412 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:36.748088 21412 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:36.748145 21412 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:36.756848 21412 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.132:38147
I20261118 09:02:36.756873 21539 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.132:38147 every 8 connection(s)
I20261118 09:02:36.757771 21412 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20261118 09:02:36.764513 21540 heartbeater.cc:345] Connected to a master server at 127.18.135.190:37883
I20261118 09:02:36.764750 21540 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:36.765201 21540 heartbeater.cc:508] Master 127.18.135.190:37883 requested a full tablet report, sending...
I20261118 09:02:36.766280 20959 ts_manager.cc:210] Registered new tserver with Master: 889fa6912d12497fbfa839d47058a1ee (127.18.135.132:38147)
I20261118 09:02:36.766938 20959 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.132:39151
I20261118 09:02:36.767638 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 21412
I20261118 09:02:36.767762 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20261118 09:02:36.769906 18974 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 09:02:36.778421 20959 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54570:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
I20261118 09:02:36.796079 21474 tablet_service.cc:1500] Processing CreateTablet for tablet d9ea49f3cb5848509b857bc5ddb86e62 (DEFAULT_TABLE table=TestTable [id=1bbc55dbcd1c4cfc86e45a445e1d07da]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:36.796610 21212 tablet_service.cc:1500] Processing CreateTablet for tablet d9ea49f3cb5848509b857bc5ddb86e62 (DEFAULT_TABLE table=TestTable [id=1bbc55dbcd1c4cfc86e45a445e1d07da]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:36.796610 21081 tablet_service.cc:1500] Processing CreateTablet for tablet d9ea49f3cb5848509b857bc5ddb86e62 (DEFAULT_TABLE table=TestTable [id=1bbc55dbcd1c4cfc86e45a445e1d07da]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:36.796912 21474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ea49f3cb5848509b857bc5ddb86e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:36.797454 21081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ea49f3cb5848509b857bc5ddb86e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:36.797454 21212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ea49f3cb5848509b857bc5ddb86e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:36.801872 21557 tablet_bootstrap.cc:492] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee: Bootstrap starting.
I20261118 09:02:36.804162 21559 tablet_bootstrap.cc:492] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e: Bootstrap starting.
I20261118 09:02:36.804342 21557 tablet_bootstrap.cc:654] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:36.805086 21557 log.cc:826] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:36.805639 21558 tablet_bootstrap.cc:492] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a: Bootstrap starting.
I20261118 09:02:36.806207 21559 tablet_bootstrap.cc:654] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:36.806622 21557 tablet_bootstrap.cc:492] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee: No bootstrap required, opened a new log
I20261118 09:02:36.806828 21557 ts_tablet_manager.cc:1449] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 09:02:36.807031 21559 log.cc:826] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:36.807832 21558 tablet_bootstrap.cc:654] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:36.808333 21559 tablet_bootstrap.cc:492] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e: No bootstrap required, opened a new log
I20261118 09:02:36.808542 21559 ts_tablet_manager.cc:1449] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e: Time spent bootstrapping tablet: real 0.004s	user 0.003s	sys 0.000s
I20261118 09:02:36.808699 21558 log.cc:826] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:36.810123 21558 tablet_bootstrap.cc:492] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a: No bootstrap required, opened a new log
I20261118 09:02:36.810094 21557 raft_consensus.cc:360] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:36.810297 21557 raft_consensus.cc:386] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:36.810312 21558 ts_tablet_manager.cc:1449] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.003s
I20261118 09:02:36.810400 21557 raft_consensus.cc:748] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 889fa6912d12497fbfa839d47058a1ee, State: Initialized, Role: FOLLOWER
I20261118 09:02:36.810825 21557 consensus_queue.cc:261] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:36.811503 21559 raft_consensus.cc:360] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:36.811606 21557 ts_tablet_manager.cc:1480] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20261118 09:02:36.811673 21559 raft_consensus.cc:386] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:36.811744 21559 raft_consensus.cc:748] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 933f864f1da74c77b1e325d5161d6f5e, State: Initialized, Role: FOLLOWER
I20261118 09:02:36.812065 21559 consensus_queue.cc:261] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:36.812659 21559 ts_tablet_manager.cc:1480] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20261118 09:02:36.812670 21147 heartbeater.cc:500] Master 127.18.135.190:37883 was elected leader, sending a full tablet report...
I20261118 09:02:36.813181 21558 raft_consensus.cc:360] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:36.813346 21558 raft_consensus.cc:386] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:36.813405 21558 raft_consensus.cc:748] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad750d7390ff42dfb74d5642b848a63a, State: Initialized, Role: FOLLOWER
I20261118 09:02:36.813854 21540 heartbeater.cc:500] Master 127.18.135.190:37883 was elected leader, sending a full tablet report...
I20261118 09:02:36.813829 21558 consensus_queue.cc:261] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:36.814427 21278 heartbeater.cc:500] Master 127.18.135.190:37883 was elected leader, sending a full tablet report...
I20261118 09:02:36.814718 21558 ts_tablet_manager.cc:1480] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
W20261118 09:02:36.839811 21279 tablet.cc:2441] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 09:02:36.858558 21541 tablet.cc:2441] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 09:02:36.877871 21148 tablet.cc:2441] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261118 09:02:36.888104 21563 raft_consensus.cc:499] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261118 09:02:36.888304 21563 raft_consensus.cc:521] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:36.889523 21563 leader_election.cc:290] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 933f864f1da74c77b1e325d5161d6f5e (127.18.135.129:42329), ad750d7390ff42dfb74d5642b848a63a (127.18.135.130:33937)
I20261118 09:02:36.893070 21101 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d9ea49f3cb5848509b857bc5ddb86e62" candidate_uuid: "889fa6912d12497fbfa839d47058a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "933f864f1da74c77b1e325d5161d6f5e" is_pre_election: true
I20261118 09:02:36.893327 21101 raft_consensus.cc:2490] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 889fa6912d12497fbfa839d47058a1ee in term 0.
I20261118 09:02:36.893561 21232 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d9ea49f3cb5848509b857bc5ddb86e62" candidate_uuid: "889fa6912d12497fbfa839d47058a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad750d7390ff42dfb74d5642b848a63a" is_pre_election: true
I20261118 09:02:36.893836 21232 raft_consensus.cc:2490] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 889fa6912d12497fbfa839d47058a1ee in term 0.
I20261118 09:02:36.893836 21430 leader_election.cc:304] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 889fa6912d12497fbfa839d47058a1ee, 933f864f1da74c77b1e325d5161d6f5e; no voters: 
I20261118 09:02:36.894059 21563 raft_consensus.cc:2826] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261118 09:02:36.894140 21563 raft_consensus.cc:499] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261118 09:02:36.894196 21563 raft_consensus.cc:3096] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:36.895056 21563 raft_consensus.cc:521] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:36.895382 21563 leader_election.cc:290] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 933f864f1da74c77b1e325d5161d6f5e (127.18.135.129:42329), ad750d7390ff42dfb74d5642b848a63a (127.18.135.130:33937)
I20261118 09:02:36.895710 21101 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d9ea49f3cb5848509b857bc5ddb86e62" candidate_uuid: "889fa6912d12497fbfa839d47058a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "933f864f1da74c77b1e325d5161d6f5e"
I20261118 09:02:36.895710 21232 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d9ea49f3cb5848509b857bc5ddb86e62" candidate_uuid: "889fa6912d12497fbfa839d47058a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad750d7390ff42dfb74d5642b848a63a"
I20261118 09:02:36.895835 21232 raft_consensus.cc:3096] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:36.895830 21101 raft_consensus.cc:3096] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:36.896966 21232 raft_consensus.cc:2490] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 889fa6912d12497fbfa839d47058a1ee in term 1.
I20261118 09:02:36.897236 21429 leader_election.cc:304] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 889fa6912d12497fbfa839d47058a1ee, ad750d7390ff42dfb74d5642b848a63a; no voters: 
I20261118 09:02:36.897363 21101 raft_consensus.cc:2490] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 889fa6912d12497fbfa839d47058a1ee in term 1.
I20261118 09:02:36.897446 21563 raft_consensus.cc:2826] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20261118 09:02:36.897704 21563 raft_consensus.cc:705] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 889fa6912d12497fbfa839d47058a1ee, State: Running, Role: LEADER
I20261118 09:02:36.898063 21563 consensus_queue.cc:238] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:36.901105 21567 consensus_queue.cc:1049] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 09:02:36.901214 20959 catalog_manager.cc:5840] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 889fa6912d12497fbfa839d47058a1ee (127.18.135.132). New cstate: current_term: 1 leader_uuid: "889fa6912d12497fbfa839d47058a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } health_report { overall_health: UNKNOWN } } }
I20261118 09:02:36.901443 21569 consensus_queue.cc:1049] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 09:02:36.909667 18974 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 09:02:36.911388 18974 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 933f864f1da74c77b1e325d5161d6f5e to finish bootstrapping
I20261118 09:02:36.916038 18974 ts_itest-base.cc:246] Waiting for 1 tablets on tserver ad750d7390ff42dfb74d5642b848a63a to finish bootstrapping
I20261118 09:02:36.920428 18974 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 889fa6912d12497fbfa839d47058a1ee to finish bootstrapping
I20261118 09:02:36.924975 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 21412
I20261118 09:02:36.931289 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.132:38147
--local_ip_for_outbound_sockets=127.18.135.132
--tserver_master_addrs=127.18.135.190:37883
--webserver_port=38069
--webserver_interface=127.18.135.132
--builtin_ntp_servers=127.18.135.148:36927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000
--tablet_bootstrap_inject_latency_ms=4000 with env {}
W20261118 09:02:37.030524 21576 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:37.030788 21576 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:37.030853 21576 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:37.030962 21576 flags.cc:432] Enabled unsafe flag: --tablet_bootstrap_inject_latency_ms=4000
W20261118 09:02:37.031013 21576 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:37.034421 21576 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:37.034493 21576 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:37.034566 21576 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:37.034698 21576 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:37.034765 21576 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.132
I20261118 09:02:37.038810 21576 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:36927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.132:38147
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.18.135.132
--webserver_port=38069
--tserver_master_addrs=127.18.135.190:37883
--tablet_bootstrap_inject_latency_ms=4000
--never_fsync=true
--heap_profile_path=/tmp/kudu.21576
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:37.039597 21576 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:37.040292 21576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:37.045753 21581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:37.045868 21582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:37.045846 21584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:37.045948 21576 server_base.cc:1061] running on GCE node
I20261118 09:02:37.046454 21576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:37.046999 21576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:37.048166 21576 hybrid_clock.cc:648] HybridClock initialized: now 1794992557048138 us; error 39 us; skew 500 ppm
I20261118 09:02:37.049816 21576 webserver.cc:577] Webserver started at http://127.18.135.132:38069/ using document root <none> and password file <none>
I20261118 09:02:37.050436 21576 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:37.050525 21576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:37.053650 21576 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 09:02:37.055692 21590 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:37.056667 21576 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20261118 09:02:37.056819 21576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "889fa6912d12497fbfa839d47058a1ee"
format_stamp: "Formatted at 2026-11-18 09:02:36 on dist-test-slave-q6bx"
I20261118 09:02:37.057178 21576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:37.079872 21576 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:37.080317 21576 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:37.080485 21576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:37.080972 21576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:37.082141 21597 ts_tablet_manager.cc:588] Loading tablet metadata (0/1 complete)
I20261118 09:02:37.085460 21576 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261118 09:02:37.085529 21576 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20261118 09:02:37.085613 21576 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261118 09:02:37.087086 21576 ts_tablet_manager.cc:662] Registered 1 tablets
W20261118 09:02:37.087133 21597 ts_tablet_manager.cc:1428] Injecting 4000ms delay in tablet bootstrapping
I20261118 09:02:37.087152 21576 ts_tablet_manager.cc:641] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20261118 09:02:37.095664 21576 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.132:38147
I20261118 09:02:37.095697 21704 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.132:38147 every 8 connection(s)
I20261118 09:02:37.096614 21576 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20261118 09:02:37.103529 21705 heartbeater.cc:345] Connected to a master server at 127.18.135.190:37883
I20261118 09:02:37.103734 21705 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:37.104175 21705 heartbeater.cc:508] Master 127.18.135.190:37883 requested a full tablet report, sending...
I20261118 09:02:37.105535 20956 ts_manager.cc:210] Re-registered known tserver with Master: 889fa6912d12497fbfa839d47058a1ee (127.18.135.132:38147)
I20261118 09:02:37.106321 20956 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.132:44535
I20261118 09:02:37.106711 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 21576
I20261118 09:02:37.607985 21409 heartbeater.cc:500] Master 127.18.135.190:37883 was elected leader, sending a full tablet report...
I20261118 09:02:38.108001 21705 heartbeater.cc:500] Master 127.18.135.190:37883 was elected leader, sending a full tablet report...
I20261118 09:02:38.407780 21708 raft_consensus.cc:499] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 889fa6912d12497fbfa839d47058a1ee)
I20261118 09:02:38.407915 21708 raft_consensus.cc:521] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:38.409011 21708 leader_election.cc:290] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 889fa6912d12497fbfa839d47058a1ee (127.18.135.132:38147), 933f864f1da74c77b1e325d5161d6f5e (127.18.135.129:42329)
I20261118 09:02:38.409128 21709 raft_consensus.cc:499] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 889fa6912d12497fbfa839d47058a1ee)
I20261118 09:02:38.409258 21709 raft_consensus.cc:521] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:38.411504 21709 leader_election.cc:290] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 889fa6912d12497fbfa839d47058a1ee (127.18.135.132:38147), ad750d7390ff42dfb74d5642b848a63a (127.18.135.130:33937)
I20261118 09:02:38.414075 21101 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d9ea49f3cb5848509b857bc5ddb86e62" candidate_uuid: "ad750d7390ff42dfb74d5642b848a63a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "933f864f1da74c77b1e325d5161d6f5e" is_pre_election: true
I20261118 09:02:38.414204 21101 raft_consensus.cc:2490] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad750d7390ff42dfb74d5642b848a63a in term 1.
I20261118 09:02:38.414628 21168 leader_election.cc:304] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 933f864f1da74c77b1e325d5161d6f5e, ad750d7390ff42dfb74d5642b848a63a; no voters: 
I20261118 09:02:38.414921 21708 raft_consensus.cc:2826] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261118 09:02:38.415017 21708 raft_consensus.cc:499] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 889fa6912d12497fbfa839d47058a1ee)
I20261118 09:02:38.415086 21708 raft_consensus.cc:3096] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 1 FOLLOWER]: Advancing to term 2
I20261118 09:02:38.414851 21659 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d9ea49f3cb5848509b857bc5ddb86e62" candidate_uuid: "ad750d7390ff42dfb74d5642b848a63a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "889fa6912d12497fbfa839d47058a1ee" is_pre_election: true
I20261118 09:02:38.416095 21232 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d9ea49f3cb5848509b857bc5ddb86e62" candidate_uuid: "933f864f1da74c77b1e325d5161d6f5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad750d7390ff42dfb74d5642b848a63a" is_pre_election: true
I20261118 09:02:38.416162 21708 raft_consensus.cc:521] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:38.416507 21232 raft_consensus.cc:2415] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 933f864f1da74c77b1e325d5161d6f5e in current term 2: Already voted for candidate ad750d7390ff42dfb74d5642b848a63a in this term.
I20261118 09:02:38.416565 21708 leader_election.cc:290] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [CANDIDATE]: Term 2 election: Requested vote from peers 889fa6912d12497fbfa839d47058a1ee (127.18.135.132:38147), 933f864f1da74c77b1e325d5161d6f5e (127.18.135.129:42329)
I20261118 09:02:38.416553 21659 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d9ea49f3cb5848509b857bc5ddb86e62" candidate_uuid: "933f864f1da74c77b1e325d5161d6f5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "889fa6912d12497fbfa839d47058a1ee" is_pre_election: true
W20261118 09:02:38.416827 21165 leader_election.cc:343] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 889fa6912d12497fbfa839d47058a1ee (127.18.135.132:38147): Illegal state: must be running to vote when last-logged opid is not known
I20261118 09:02:38.416965 21101 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d9ea49f3cb5848509b857bc5ddb86e62" candidate_uuid: "ad750d7390ff42dfb74d5642b848a63a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "933f864f1da74c77b1e325d5161d6f5e"
I20261118 09:02:38.417078 21101 raft_consensus.cc:3096] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [term 1 FOLLOWER]: Advancing to term 2
W20261118 09:02:38.417337 21034 leader_election.cc:343] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 889fa6912d12497fbfa839d47058a1ee (127.18.135.132:38147): Illegal state: must be running to vote when last-logged opid is not known
I20261118 09:02:38.417434 21034 leader_election.cc:304] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 933f864f1da74c77b1e325d5161d6f5e; no voters: 889fa6912d12497fbfa839d47058a1ee, ad750d7390ff42dfb74d5642b848a63a
I20261118 09:02:38.417412 21659 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d9ea49f3cb5848509b857bc5ddb86e62" candidate_uuid: "ad750d7390ff42dfb74d5642b848a63a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "889fa6912d12497fbfa839d47058a1ee"
W20261118 09:02:38.417893 21165 leader_election.cc:343] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 889fa6912d12497fbfa839d47058a1ee (127.18.135.132:38147): Illegal state: must be running to vote when last-logged opid is not known
I20261118 09:02:38.418092 21101 raft_consensus.cc:2490] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad750d7390ff42dfb74d5642b848a63a in term 2.
I20261118 09:02:38.418174 21709 raft_consensus.cc:2771] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261118 09:02:38.418352 21168 leader_election.cc:304] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 933f864f1da74c77b1e325d5161d6f5e, ad750d7390ff42dfb74d5642b848a63a; no voters: 889fa6912d12497fbfa839d47058a1ee
I20261118 09:02:38.418509 21708 raft_consensus.cc:2826] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 2 FOLLOWER]: Leader election won for term 2
I20261118 09:02:38.418701 21708 raft_consensus.cc:705] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [term 2 LEADER]: Becoming Leader. State: Replica: ad750d7390ff42dfb74d5642b848a63a, State: Running, Role: LEADER
I20261118 09:02:38.418988 21708 consensus_queue.cc:238] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:38.420738 21101 raft_consensus.cc:1285] T d9ea49f3cb5848509b857bc5ddb86e62 P 933f864f1da74c77b1e325d5161d6f5e [term 2 FOLLOWER]: Refusing update from remote peer ad750d7390ff42dfb74d5642b848a63a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20261118 09:02:38.421330 21165 consensus_peers.cc:597] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a -> Peer 889fa6912d12497fbfa839d47058a1ee (127.18.135.132:38147): Couldn't send request to peer 889fa6912d12497fbfa839d47058a1ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20261118 09:02:38.421319 21720 consensus_queue.cc:1049] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20261118 09:02:38.421826 20957 catalog_manager.cc:5840] T d9ea49f3cb5848509b857bc5ddb86e62 P ad750d7390ff42dfb74d5642b848a63a reported cstate change: term changed from 1 to 2, leader changed from 889fa6912d12497fbfa839d47058a1ee (127.18.135.132) to ad750d7390ff42dfb74d5642b848a63a (127.18.135.130). New cstate: current_term: 2 leader_uuid: "ad750d7390ff42dfb74d5642b848a63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } health_report { overall_health: HEALTHY } } }
I20261118 09:02:41.087666 21597 tablet_bootstrap.cc:492] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee: Bootstrap starting.
I20261118 09:02:41.094331 21597 log.cc:826] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:41.096668 21597 tablet_bootstrap.cc:492] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261118 09:02:41.097010 21597 tablet_bootstrap.cc:492] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee: Bootstrap complete.
I20261118 09:02:41.097433 21597 ts_tablet_manager.cc:1449] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee: Time spent bootstrapping tablet: real 0.010s	user 0.007s	sys 0.000s
I20261118 09:02:41.099611 21597 raft_consensus.cc:360] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:41.099968 21597 raft_consensus.cc:748] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 889fa6912d12497fbfa839d47058a1ee, State: Initialized, Role: FOLLOWER
I20261118 09:02:41.100409 21597 consensus_queue.cc:261] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "889fa6912d12497fbfa839d47058a1ee" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 38147 } } peers { permanent_uuid: "933f864f1da74c77b1e325d5161d6f5e" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 42329 } } peers { permanent_uuid: "ad750d7390ff42dfb74d5642b848a63a" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 33937 } }
I20261118 09:02:41.101142 21597 ts_tablet_manager.cc:1480] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20261118 09:02:41.127718 21659 raft_consensus.cc:3096] T d9ea49f3cb5848509b857bc5ddb86e62 P 889fa6912d12497fbfa839d47058a1ee [term 1 FOLLOWER]: Advancing to term 2
I20261118 09:02:44.119279 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 21019
I20261118 09:02:44.125535 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 21150
I20261118 09:02:44.131299 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 21281
I20261118 09:02:44.136456 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 21576
I20261118 09:02:44.141865 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 20928
2026-11-18T09:02:44Z chronyd exiting
[       OK ] SlowTabletBootstrapTest.TestSlowBootstrap (8299 ms)
[ RUN      ] SlowTabletBootstrapTest.TestFallBehind
I20261118 09:02:44.164587 18974 ts_itest-base.cc:115] Starting cluster with:
I20261118 09:02:44.164642 18974 ts_itest-base.cc:116] --------------
I20261118 09:02:44.164664 18974 ts_itest-base.cc:117] 4 tablet servers
I20261118 09:02:44.164693 18974 ts_itest-base.cc:118] 3 replicas per TS
I20261118 09:02:44.164717 18974 ts_itest-base.cc:119] --------------
2026-11-18T09:02:44Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-18T09:02:44Z Disabled control of system clock
I20261118 09:02:44.172394 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.135.190:36423
--webserver_interface=127.18.135.190
--webserver_port=0
--builtin_ntp_servers=127.18.135.148:41175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.135.190:36423 with env {}
W20261118 09:02:44.273428 21744 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:44.273635 21744 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:44.273738 21744 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:44.277081 21744 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261118 09:02:44.277166 21744 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:44.277207 21744 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261118 09:02:44.277252 21744 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261118 09:02:44.281224 21744 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:41175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.135.190:36423
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.135.190:36423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.18.135.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.21744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:44.282091 21744 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:44.282801 21744 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:44.288065 21749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:44.288129 21744 server_base.cc:1061] running on GCE node
W20261118 09:02:44.288168 21752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:44.288043 21750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:44.288650 21744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:44.289395 21744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:44.290570 21744 hybrid_clock.cc:648] HybridClock initialized: now 1794992564290545 us; error 48 us; skew 500 ppm
I20261118 09:02:44.292218 21744 webserver.cc:577] Webserver started at http://127.18.135.190:39653/ using document root <none> and password file <none>
I20261118 09:02:44.292783 21744 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:44.292856 21744 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:44.293104 21744 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:44.294449 21744 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "47347608aefd4d8b8e808c2aaaab3445"
format_stamp: "Formatted at 2026-11-18 09:02:44 on dist-test-slave-q6bx"
I20261118 09:02:44.294884 21744 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "47347608aefd4d8b8e808c2aaaab3445"
format_stamp: "Formatted at 2026-11-18 09:02:44 on dist-test-slave-q6bx"
I20261118 09:02:44.298050 21744 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20261118 09:02:44.300192 21758 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:44.301155 21744 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 09:02:44.301306 21744 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
uuid: "47347608aefd4d8b8e808c2aaaab3445"
format_stamp: "Formatted at 2026-11-18 09:02:44 on dist-test-slave-q6bx"
I20261118 09:02:44.301403 21744 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:44.317169 21744 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:44.317644 21744 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:44.317837 21744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:44.324653 21744 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.190:36423
I20261118 09:02:44.324651 21810 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.190:36423 every 8 connection(s)
I20261118 09:02:44.325668 21744 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20261118 09:02:44.326985 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 21744
I20261118 09:02:44.327101 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal/instance
I20261118 09:02:44.330067 21811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:44.335786 21811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445: Bootstrap starting.
I20261118 09:02:44.337898 21811 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:44.338655 21811 log.cc:826] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:44.339968 21811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445: No bootstrap required, opened a new log
I20261118 09:02:44.342425 21811 raft_consensus.cc:360] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47347608aefd4d8b8e808c2aaaab3445" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 36423 } }
I20261118 09:02:44.342617 21811 raft_consensus.cc:386] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:44.342697 21811 raft_consensus.cc:748] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47347608aefd4d8b8e808c2aaaab3445, State: Initialized, Role: FOLLOWER
I20261118 09:02:44.343078 21811 consensus_queue.cc:261] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47347608aefd4d8b8e808c2aaaab3445" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 36423 } }
I20261118 09:02:44.343225 21811 raft_consensus.cc:400] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261118 09:02:44.343307 21811 raft_consensus.cc:499] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261118 09:02:44.343420 21811 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:44.344156 21811 raft_consensus.cc:521] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47347608aefd4d8b8e808c2aaaab3445" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 36423 } }
I20261118 09:02:44.344501 21811 leader_election.cc:304] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47347608aefd4d8b8e808c2aaaab3445; no voters: 
I20261118 09:02:44.344782 21811 leader_election.cc:290] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261118 09:02:44.344910 21816 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [term 1 FOLLOWER]: Leader election won for term 1
I20261118 09:02:44.345148 21816 raft_consensus.cc:705] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [term 1 LEADER]: Becoming Leader. State: Replica: 47347608aefd4d8b8e808c2aaaab3445, State: Running, Role: LEADER
I20261118 09:02:44.345525 21816 consensus_queue.cc:238] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47347608aefd4d8b8e808c2aaaab3445" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 36423 } }
I20261118 09:02:44.345930 21811 sys_catalog.cc:565] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [sys.catalog]: configured and running, proceeding with master startup.
I20261118 09:02:44.347177 21817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47347608aefd4d8b8e808c2aaaab3445" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47347608aefd4d8b8e808c2aaaab3445" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 36423 } } }
I20261118 09:02:44.347308 21817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [sys.catalog]: This master's current role is: LEADER
I20261118 09:02:44.347563 21818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47347608aefd4d8b8e808c2aaaab3445. Latest consensus state: current_term: 1 leader_uuid: "47347608aefd4d8b8e808c2aaaab3445" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47347608aefd4d8b8e808c2aaaab3445" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 36423 } } }
I20261118 09:02:44.347667 21818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445 [sys.catalog]: This master's current role is: LEADER
I20261118 09:02:44.347695 21825 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261118 09:02:44.350792 21825 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261118 09:02:44.355885 21825 catalog_manager.cc:1398] Generated new cluster ID: d23ea90dcf82469880c9e73b767f6037
I20261118 09:02:44.355952 21825 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261118 09:02:44.364574 21825 catalog_manager.cc:1421] Generated new certificate authority record
I20261118 09:02:44.365378 21825 catalog_manager.cc:1555] Loading token signing keys...
I20261118 09:02:44.371868 21825 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 47347608aefd4d8b8e808c2aaaab3445: Generated new TSK 0
I20261118 09:02:44.372380 21825 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261118 09:02:44.378876 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.129:0
--local_ip_for_outbound_sockets=127.18.135.129
--webserver_interface=127.18.135.129
--webserver_port=0
--tserver_master_addrs=127.18.135.190:36423
--builtin_ntp_servers=127.18.135.148:41175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
W20261118 09:02:44.494588 21835 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:44.494846 21835 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:44.494912 21835 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:44.495002 21835 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:44.498389 21835 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:44.498466 21835 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:44.498533 21835 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:44.498652 21835 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:44.498719 21835 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.129
I20261118 09:02:44.502681 21835 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:41175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.18.135.129
--webserver_port=0
--tserver_master_addrs=127.18.135.190:36423
--never_fsync=true
--heap_profile_path=/tmp/kudu.21835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:44.503434 21835 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:44.504144 21835 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:44.509703 21841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:44.509855 21843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:44.509939 21835 server_base.cc:1061] running on GCE node
W20261118 09:02:44.509699 21840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:44.510393 21835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:44.511035 21835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:44.512219 21835 hybrid_clock.cc:648] HybridClock initialized: now 1794992564512196 us; error 42 us; skew 500 ppm
I20261118 09:02:44.514091 21835 webserver.cc:577] Webserver started at http://127.18.135.129:36387/ using document root <none> and password file <none>
I20261118 09:02:44.514715 21835 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:44.514770 21835 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:44.514976 21835 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:44.516515 21835 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "2826158df8a24f77b07af76884fb7096"
format_stamp: "Formatted at 2026-11-18 09:02:44 on dist-test-slave-q6bx"
I20261118 09:02:44.516974 21835 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "2826158df8a24f77b07af76884fb7096"
format_stamp: "Formatted at 2026-11-18 09:02:44 on dist-test-slave-q6bx"
I20261118 09:02:44.520697 21835 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20261118 09:02:44.523460 21849 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:44.524566 21835 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261118 09:02:44.524673 21835 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "2826158df8a24f77b07af76884fb7096"
format_stamp: "Formatted at 2026-11-18 09:02:44 on dist-test-slave-q6bx"
I20261118 09:02:44.524760 21835 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:44.547780 21835 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:44.548240 21835 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:44.548385 21835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:44.548950 21835 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:44.550041 21835 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:44.550088 21835 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:44.550130 21835 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:44.550145 21835 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:44.558588 21835 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.129:35857
I20261118 09:02:44.558636 21962 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.129:35857 every 8 connection(s)
I20261118 09:02:44.559535 21835 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20261118 09:02:44.564869 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 21835
I20261118 09:02:44.564998 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20261118 09:02:44.567610 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.130:0
--local_ip_for_outbound_sockets=127.18.135.130
--webserver_interface=127.18.135.130
--webserver_port=0
--tserver_master_addrs=127.18.135.190:36423
--builtin_ntp_servers=127.18.135.148:41175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 09:02:44.569401 21963 heartbeater.cc:345] Connected to a master server at 127.18.135.190:36423
I20261118 09:02:44.569639 21963 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:44.570114 21963 heartbeater.cc:508] Master 127.18.135.190:36423 requested a full tablet report, sending...
I20261118 09:02:44.571571 21775 ts_manager.cc:210] Registered new tserver with Master: 2826158df8a24f77b07af76884fb7096 (127.18.135.129:35857)
I20261118 09:02:44.572788 21775 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.129:56379
W20261118 09:02:44.670039 21966 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:44.670290 21966 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:44.670352 21966 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:44.670454 21966 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:44.673920 21966 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:44.673991 21966 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:44.674057 21966 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:44.674177 21966 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:44.674244 21966 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.130
I20261118 09:02:44.678146 21966 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:41175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.18.135.130
--webserver_port=0
--tserver_master_addrs=127.18.135.190:36423
--never_fsync=true
--heap_profile_path=/tmp/kudu.21966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:44.678890 21966 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:44.679579 21966 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:44.684788 21971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:44.684894 21972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:44.685029 21966 server_base.cc:1061] running on GCE node
W20261118 09:02:44.684798 21974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:44.685443 21966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:44.686044 21966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:44.687219 21966 hybrid_clock.cc:648] HybridClock initialized: now 1794992564687204 us; error 30 us; skew 500 ppm
I20261118 09:02:44.688781 21966 webserver.cc:577] Webserver started at http://127.18.135.130:40071/ using document root <none> and password file <none>
I20261118 09:02:44.689337 21966 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:44.689419 21966 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:44.689656 21966 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:44.690999 21966 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "b27299b04ae9456c9714aec834e7bf27"
format_stamp: "Formatted at 2026-11-18 09:02:44 on dist-test-slave-q6bx"
I20261118 09:02:44.691448 21966 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "b27299b04ae9456c9714aec834e7bf27"
format_stamp: "Formatted at 2026-11-18 09:02:44 on dist-test-slave-q6bx"
I20261118 09:02:44.694571 21966 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20261118 09:02:44.696796 21980 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:44.697745 21966 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 09:02:44.697873 21966 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "b27299b04ae9456c9714aec834e7bf27"
format_stamp: "Formatted at 2026-11-18 09:02:44 on dist-test-slave-q6bx"
I20261118 09:02:44.697968 21966 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:44.728535 21966 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:44.729099 21966 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:44.729269 21966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:44.729842 21966 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:44.730815 21966 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:44.730890 21966 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:44.730968 21966 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:44.731011 21966 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:44.739619 21966 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.130:42543
I20261118 09:02:44.739669 22093 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.130:42543 every 8 connection(s)
I20261118 09:02:44.740676 21966 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20261118 09:02:44.743414 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 21966
I20261118 09:02:44.743537 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20261118 09:02:44.745564 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.131:0
--local_ip_for_outbound_sockets=127.18.135.131
--webserver_interface=127.18.135.131
--webserver_port=0
--tserver_master_addrs=127.18.135.190:36423
--builtin_ntp_servers=127.18.135.148:41175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 09:02:44.748582 22094 heartbeater.cc:345] Connected to a master server at 127.18.135.190:36423
I20261118 09:02:44.748813 22094 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:44.749272 22094 heartbeater.cc:508] Master 127.18.135.190:36423 requested a full tablet report, sending...
I20261118 09:02:44.750415 21775 ts_manager.cc:210] Registered new tserver with Master: b27299b04ae9456c9714aec834e7bf27 (127.18.135.130:42543)
I20261118 09:02:44.751232 21775 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.130:57487
W20261118 09:02:44.846563 22097 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:44.846794 22097 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:44.846912 22097 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:44.846995 22097 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:44.850596 22097 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:44.850641 22097 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:44.850696 22097 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:44.850821 22097 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:44.850854 22097 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.131
I20261118 09:02:44.854709 22097 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:41175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.18.135.131
--webserver_port=0
--tserver_master_addrs=127.18.135.190:36423
--never_fsync=true
--heap_profile_path=/tmp/kudu.22097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:44.855405 22097 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:44.856081 22097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:44.861635 22102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:44.861699 22103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:44.861786 22105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:44.861917 22097 server_base.cc:1061] running on GCE node
I20261118 09:02:44.862197 22097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:44.862732 22097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:44.863881 22097 hybrid_clock.cc:648] HybridClock initialized: now 1794992564863865 us; error 28 us; skew 500 ppm
I20261118 09:02:44.865617 22097 webserver.cc:577] Webserver started at http://127.18.135.131:44479/ using document root <none> and password file <none>
I20261118 09:02:44.866186 22097 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:44.866237 22097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:44.866466 22097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:44.867702 22097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "585f2007071444bf8b0cb2a62d348dcd"
format_stamp: "Formatted at 2026-11-18 09:02:44 on dist-test-slave-q6bx"
I20261118 09:02:44.868146 22097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "585f2007071444bf8b0cb2a62d348dcd"
format_stamp: "Formatted at 2026-11-18 09:02:44 on dist-test-slave-q6bx"
I20261118 09:02:44.871326 22097 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 09:02:44.873656 22111 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:44.874658 22097 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 09:02:44.874788 22097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "585f2007071444bf8b0cb2a62d348dcd"
format_stamp: "Formatted at 2026-11-18 09:02:44 on dist-test-slave-q6bx"
I20261118 09:02:44.874889 22097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:44.901463 22097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:44.902149 22097 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:44.902323 22097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:44.902978 22097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:44.904198 22097 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:44.904279 22097 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:44.904340 22097 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:44.904378 22097 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:44.916605 22097 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.131:38341
I20261118 09:02:44.916652 22224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.131:38341 every 8 connection(s)
I20261118 09:02:44.917649 22097 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20261118 09:02:44.921660 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 22097
I20261118 09:02:44.921794 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20261118 09:02:44.924225 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.132:0
--local_ip_for_outbound_sockets=127.18.135.132
--webserver_interface=127.18.135.132
--webserver_port=0
--tserver_master_addrs=127.18.135.190:36423
--builtin_ntp_servers=127.18.135.148:41175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 09:02:44.926359 22225 heartbeater.cc:345] Connected to a master server at 127.18.135.190:36423
I20261118 09:02:44.926599 22225 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:44.927228 22225 heartbeater.cc:508] Master 127.18.135.190:36423 requested a full tablet report, sending...
I20261118 09:02:44.928542 21775 ts_manager.cc:210] Registered new tserver with Master: 585f2007071444bf8b0cb2a62d348dcd (127.18.135.131:38341)
I20261118 09:02:44.929399 21775 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.131:37951
W20261118 09:02:45.024454 22228 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:45.024700 22228 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:45.024762 22228 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:45.024857 22228 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:45.028265 22228 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:45.028343 22228 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:45.028430 22228 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:45.028554 22228 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:45.028620 22228 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.132
I20261118 09:02:45.032644 22228 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:41175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.18.135.132
--webserver_port=0
--tserver_master_addrs=127.18.135.190:36423
--never_fsync=true
--heap_profile_path=/tmp/kudu.22228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:45.033414 22228 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:45.034225 22228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:45.039616 22234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:45.039649 22233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:45.039652 22236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:45.039798 22228 server_base.cc:1061] running on GCE node
I20261118 09:02:45.040213 22228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:45.040799 22228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:45.041931 22228 hybrid_clock.cc:648] HybridClock initialized: now 1794992565041905 us; error 38 us; skew 500 ppm
I20261118 09:02:45.043566 22228 webserver.cc:577] Webserver started at http://127.18.135.132:35209/ using document root <none> and password file <none>
I20261118 09:02:45.044126 22228 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:45.044174 22228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:45.044425 22228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:45.045763 22228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "b09598dac802400188ef28007061480e"
format_stamp: "Formatted at 2026-11-18 09:02:45 on dist-test-slave-q6bx"
I20261118 09:02:45.046223 22228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "b09598dac802400188ef28007061480e"
format_stamp: "Formatted at 2026-11-18 09:02:45 on dist-test-slave-q6bx"
I20261118 09:02:45.049356 22228 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20261118 09:02:45.051640 22242 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:45.052596 22228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 09:02:45.052742 22228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "b09598dac802400188ef28007061480e"
format_stamp: "Formatted at 2026-11-18 09:02:45 on dist-test-slave-q6bx"
I20261118 09:02:45.052851 22228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:45.087919 22228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:45.088382 22228 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:45.088553 22228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:45.089088 22228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:45.090145 22228 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:45.090216 22228 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:45.090306 22228 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:45.090351 22228 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:45.098915 22228 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.132:43873
I20261118 09:02:45.098958 22355 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.132:43873 every 8 connection(s)
I20261118 09:02:45.101131 22228 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20261118 09:02:45.108764 22356 heartbeater.cc:345] Connected to a master server at 127.18.135.190:36423
I20261118 09:02:45.108963 22356 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:45.109426 22356 heartbeater.cc:508] Master 127.18.135.190:36423 requested a full tablet report, sending...
I20261118 09:02:45.110428 21775 ts_manager.cc:210] Registered new tserver with Master: b09598dac802400188ef28007061480e (127.18.135.132:43873)
I20261118 09:02:45.110932 21775 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.132:37055
I20261118 09:02:45.111451 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 22228
I20261118 09:02:45.111569 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20261118 09:02:45.113945 18974 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 09:02:45.122602 21775 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59516:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
I20261118 09:02:45.140419 22028 tablet_service.cc:1500] Processing CreateTablet for tablet c3428185bc404f338471fb539f4d6fef (DEFAULT_TABLE table=TestTable [id=d70abb69d6ce4a78b967b569af1ee5b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:45.140419 22290 tablet_service.cc:1500] Processing CreateTablet for tablet c3428185bc404f338471fb539f4d6fef (DEFAULT_TABLE table=TestTable [id=d70abb69d6ce4a78b967b569af1ee5b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:45.140630 21897 tablet_service.cc:1500] Processing CreateTablet for tablet c3428185bc404f338471fb539f4d6fef (DEFAULT_TABLE table=TestTable [id=d70abb69d6ce4a78b967b569af1ee5b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:45.141405 22028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3428185bc404f338471fb539f4d6fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:45.141413 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3428185bc404f338471fb539f4d6fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:45.141405 22290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3428185bc404f338471fb539f4d6fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:45.146761 22373 tablet_bootstrap.cc:492] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096: Bootstrap starting.
I20261118 09:02:45.147020 22374 tablet_bootstrap.cc:492] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27: Bootstrap starting.
I20261118 09:02:45.147507 22375 tablet_bootstrap.cc:492] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e: Bootstrap starting.
I20261118 09:02:45.149773 22373 tablet_bootstrap.cc:654] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:45.149773 22375 tablet_bootstrap.cc:654] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:45.150702 22375 log.cc:826] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:45.150702 22373 log.cc:826] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:45.152138 22374 tablet_bootstrap.cc:654] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:45.152254 22373 tablet_bootstrap.cc:492] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096: No bootstrap required, opened a new log
I20261118 09:02:45.152254 22375 tablet_bootstrap.cc:492] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e: No bootstrap required, opened a new log
I20261118 09:02:45.152456 22373 ts_tablet_manager.cc:1449] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096: Time spent bootstrapping tablet: real 0.006s	user 0.000s	sys 0.004s
I20261118 09:02:45.152456 22375 ts_tablet_manager.cc:1449] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.004s
I20261118 09:02:45.152925 22374 log.cc:826] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:45.154210 22374 tablet_bootstrap.cc:492] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27: No bootstrap required, opened a new log
I20261118 09:02:45.154433 22374 ts_tablet_manager.cc:1449] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27: Time spent bootstrapping tablet: real 0.008s	user 0.004s	sys 0.000s
I20261118 09:02:45.155613 22373 raft_consensus.cc:360] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "2826158df8a24f77b07af76884fb7096" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 35857 } }
I20261118 09:02:45.155613 22375 raft_consensus.cc:360] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "2826158df8a24f77b07af76884fb7096" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 35857 } }
I20261118 09:02:45.155820 22375 raft_consensus.cc:386] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:45.155820 22373 raft_consensus.cc:386] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:45.155880 22373 raft_consensus.cc:748] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2826158df8a24f77b07af76884fb7096, State: Initialized, Role: FOLLOWER
I20261118 09:02:45.155910 22375 raft_consensus.cc:748] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b09598dac802400188ef28007061480e, State: Initialized, Role: FOLLOWER
I20261118 09:02:45.156378 22373 consensus_queue.cc:261] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "2826158df8a24f77b07af76884fb7096" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 35857 } }
I20261118 09:02:45.156380 22375 consensus_queue.cc:261] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "2826158df8a24f77b07af76884fb7096" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 35857 } }
I20261118 09:02:45.157070 22374 raft_consensus.cc:360] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "2826158df8a24f77b07af76884fb7096" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 35857 } }
I20261118 09:02:45.157202 22375 ts_tablet_manager.cc:1480] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20261118 09:02:45.157202 22373 ts_tablet_manager.cc:1480] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20261118 09:02:45.157336 22374 raft_consensus.cc:386] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:45.157514 22356 heartbeater.cc:500] Master 127.18.135.190:36423 was elected leader, sending a full tablet report...
I20261118 09:02:45.157589 21963 heartbeater.cc:500] Master 127.18.135.190:36423 was elected leader, sending a full tablet report...
I20261118 09:02:45.158438 22374 raft_consensus.cc:748] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b27299b04ae9456c9714aec834e7bf27, State: Initialized, Role: FOLLOWER
I20261118 09:02:45.158881 22374 consensus_queue.cc:261] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "2826158df8a24f77b07af76884fb7096" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 35857 } }
I20261118 09:02:45.159504 22094 heartbeater.cc:500] Master 127.18.135.190:36423 was elected leader, sending a full tablet report...
I20261118 09:02:45.159643 22374 ts_tablet_manager.cc:1480] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
W20261118 09:02:45.161275 21964 tablet.cc:2441] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 09:02:45.202064 22357 tablet.cc:2441] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 09:02:45.242277 22095 tablet.cc:2441] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261118 09:02:45.290395 22380 raft_consensus.cc:499] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261118 09:02:45.290596 22380 raft_consensus.cc:521] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "2826158df8a24f77b07af76884fb7096" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 35857 } }
I20261118 09:02:45.291847 22380 leader_election.cc:290] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b27299b04ae9456c9714aec834e7bf27 (127.18.135.130:42543), 2826158df8a24f77b07af76884fb7096 (127.18.135.129:35857)
I20261118 09:02:45.295503 22048 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "c3428185bc404f338471fb539f4d6fef" candidate_uuid: "b09598dac802400188ef28007061480e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b27299b04ae9456c9714aec834e7bf27" is_pre_election: true
I20261118 09:02:45.295540 21917 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "c3428185bc404f338471fb539f4d6fef" candidate_uuid: "b09598dac802400188ef28007061480e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2826158df8a24f77b07af76884fb7096" is_pre_election: true
I20261118 09:02:45.295774 22048 raft_consensus.cc:2490] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b09598dac802400188ef28007061480e in term 0.
I20261118 09:02:45.295792 21917 raft_consensus.cc:2490] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b09598dac802400188ef28007061480e in term 0.
I20261118 09:02:45.296229 22243 leader_election.cc:304] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2826158df8a24f77b07af76884fb7096, b09598dac802400188ef28007061480e; no voters: 
I20261118 09:02:45.296490 22380 raft_consensus.cc:2826] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261118 09:02:45.296564 22380 raft_consensus.cc:499] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261118 09:02:45.296605 22380 raft_consensus.cc:3096] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:45.297451 22380 raft_consensus.cc:521] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "2826158df8a24f77b07af76884fb7096" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 35857 } }
I20261118 09:02:45.297822 22380 leader_election.cc:290] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [CANDIDATE]: Term 1 election: Requested vote from peers b27299b04ae9456c9714aec834e7bf27 (127.18.135.130:42543), 2826158df8a24f77b07af76884fb7096 (127.18.135.129:35857)
I20261118 09:02:45.298085 22048 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "c3428185bc404f338471fb539f4d6fef" candidate_uuid: "b09598dac802400188ef28007061480e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b27299b04ae9456c9714aec834e7bf27"
I20261118 09:02:45.298205 22048 raft_consensus.cc:3096] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:45.298161 21917 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "c3428185bc404f338471fb539f4d6fef" candidate_uuid: "b09598dac802400188ef28007061480e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2826158df8a24f77b07af76884fb7096"
I20261118 09:02:45.298301 21917 raft_consensus.cc:3096] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:45.299398 22048 raft_consensus.cc:2490] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b09598dac802400188ef28007061480e in term 1.
I20261118 09:02:45.299526 21917 raft_consensus.cc:2490] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b09598dac802400188ef28007061480e in term 1.
I20261118 09:02:45.299695 22245 leader_election.cc:304] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b09598dac802400188ef28007061480e, b27299b04ae9456c9714aec834e7bf27; no voters: 
I20261118 09:02:45.299892 22380 raft_consensus.cc:2826] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [term 1 FOLLOWER]: Leader election won for term 1
I20261118 09:02:45.300113 22380 raft_consensus.cc:705] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [term 1 LEADER]: Becoming Leader. State: Replica: b09598dac802400188ef28007061480e, State: Running, Role: LEADER
I20261118 09:02:45.300489 22380 consensus_queue.cc:238] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "2826158df8a24f77b07af76884fb7096" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 35857 } }
I20261118 09:02:45.303881 22385 consensus_queue.cc:1049] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2826158df8a24f77b07af76884fb7096" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 35857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 09:02:45.304064 22380 consensus_queue.cc:1049] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 09:02:45.303964 21775 catalog_manager.cc:5840] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e reported cstate change: term changed from 0 to 1, leader changed from <none> to b09598dac802400188ef28007061480e (127.18.135.132). New cstate: current_term: 1 leader_uuid: "b09598dac802400188ef28007061480e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2826158df8a24f77b07af76884fb7096" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 35857 } health_report { overall_health: UNKNOWN } } }
I20261118 09:02:45.323695 18974 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 09:02:45.325213 18974 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 2826158df8a24f77b07af76884fb7096 to finish bootstrapping
I20261118 09:02:45.330612 18974 ts_itest-base.cc:246] Waiting for 1 tablets on tserver b27299b04ae9456c9714aec834e7bf27 to finish bootstrapping
I20261118 09:02:45.335492 18974 ts_itest-base.cc:246] Waiting for 1 tablets on tserver b09598dac802400188ef28007061480e to finish bootstrapping
I20261118 09:02:45.340266 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 21835
I20261118 09:02:45.359691 18974 test_workload.cc:405] TestWorkload: Skipping table creation because table TestTable already exists
I20261118 09:02:45.359993 18974 raft_consensus-itest-base.cc:268] Waiting until we've written at least 4MB...
W20261118 09:02:45.372498 22243 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.135.129:35857: connect: Connection refused (error 111)
W20261118 09:02:45.373365 22243 consensus_peers.cc:597] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e -> Peer 2826158df8a24f77b07af76884fb7096 (127.18.135.129:35857): Couldn't send request to peer 2826158df8a24f77b07af76884fb7096. Status: Network error: Client connection negotiation failed: client connection to 127.18.135.129:35857: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261118 09:02:45.403898 22357 maintenance_manager.cc:419] P b09598dac802400188ef28007061480e: Scheduling FlushMRSOp(c3428185bc404f338471fb539f4d6fef): 1840834 bytes log retention, and flush 2998537 bytes memory
I20261118 09:02:45.443831 22095 maintenance_manager.cc:419] P b27299b04ae9456c9714aec834e7bf27: Scheduling FlushMRSOp(c3428185bc404f338471fb539f4d6fef): 3550207 bytes log retention, and flush 5079305 bytes memory
I20261118 09:02:45.454384 22247 maintenance_manager.cc:643] P b09598dac802400188ef28007061480e: FlushMRSOp(c3428185bc404f338471fb539f4d6fef) complete. Timing: real 0.050s	user 0.036s	sys 0.000s Metrics: {"bytes_written":135803,"cfile_init":1,"compiler_manager_pool.queue_time_us":514,"dirs.queue_time_us":113,"dirs.run_cpu_time_us":179,"dirs.run_wall_time_us":826,"drs_written":1,"lbm_read_time_us":126,"lbm_reads_lt_1ms":4,"lbm_write_time_us":701,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":14,"thread_start_us":114,"threads_started":1}
I20261118 09:02:45.455426 22357 maintenance_manager.cc:419] P b09598dac802400188ef28007061480e: Scheduling LogGCOp(c3428185bc404f338471fb539f4d6fef): free 1840834 bytes of WAL
I20261118 09:02:45.455650 22247 log_reader.cc:385] T c3428185bc404f338471fb539f4d6fef: removed 2 log segments from log reader
I20261118 09:02:45.455718 22247 log.cc:1079] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/wals/c3428185bc404f338471fb539f4d6fef/wal-000000001 (ops 1-8)
I20261118 09:02:45.455854 22247 log.cc:1079] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/wals/c3428185bc404f338471fb539f4d6fef/wal-000000002 (ops 9-15)
I20261118 09:02:45.456640 22247 maintenance_manager.cc:643] P b09598dac802400188ef28007061480e: LogGCOp(c3428185bc404f338471fb539f4d6fef) complete. Timing: real 0.001s	user 0.001s	sys 0.000s Metrics: {}
I20261118 09:02:45.456961 22357 maintenance_manager.cc:419] P b09598dac802400188ef28007061480e: Scheduling FlushMRSOp(c3428185bc404f338471fb539f4d6fef): 1840950 bytes log retention, and flush 2998537 bytes memory
I20261118 09:02:45.465821 18974 raft_consensus-itest-base.cc:274] Waiting for log GC on b09598dac802400188ef28007061480e
I20261118 09:02:45.466065 18974 raft_consensus-itest-base.cc:279] Log GC complete on b09598dac802400188ef28007061480e
I20261118 09:02:45.484726 22247 maintenance_manager.cc:643] P b09598dac802400188ef28007061480e: FlushMRSOp(c3428185bc404f338471fb539f4d6fef) complete. Timing: real 0.028s	user 0.023s	sys 0.000s Metrics: {"bytes_written":135869,"cfile_init":1,"dirs.queue_time_us":39,"dirs.run_cpu_time_us":146,"dirs.run_wall_time_us":1117,"drs_written":1,"lbm_read_time_us":45,"lbm_reads_lt_1ms":4,"lbm_write_time_us":583,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":17}
I20261118 09:02:45.485971 22357 maintenance_manager.cc:419] P b09598dac802400188ef28007061480e: Scheduling LogGCOp(c3428185bc404f338471fb539f4d6fef): free 920532 bytes of WAL
I20261118 09:02:45.486187 22247 log_reader.cc:385] T c3428185bc404f338471fb539f4d6fef: removed 1 log segments from log reader
I20261118 09:02:45.486269 22247 log.cc:1079] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/wals/c3428185bc404f338471fb539f4d6fef/wal-000000003 (ops 16-22)
I20261118 09:02:45.486673 22247 maintenance_manager.cc:643] P b09598dac802400188ef28007061480e: LogGCOp(c3428185bc404f338471fb539f4d6fef) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
I20261118 09:02:45.486974 22357 maintenance_manager.cc:419] P b09598dac802400188ef28007061480e: Scheduling CompactRowSetsOp(c3428185bc404f338471fb539f4d6fef): perf score=1.001541
I20261118 09:02:45.510030 21985 maintenance_manager.cc:643] P b27299b04ae9456c9714aec834e7bf27: FlushMRSOp(c3428185bc404f338471fb539f4d6fef) complete. Timing: real 0.066s	user 0.051s	sys 0.000s Metrics: {"bytes_written":135937,"cfile_init":1,"compiler_manager_pool.queue_time_us":15256,"drs_written":1,"lbm_read_time_us":60,"lbm_reads_lt_1ms":4,"lbm_write_time_us":591,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":27,"spinlock_wait_cycles":226560,"thread_start_us":250,"threads_started":2}
I20261118 09:02:45.510958 22095 maintenance_manager.cc:419] P b27299b04ae9456c9714aec834e7bf27: Scheduling LogGCOp(c3428185bc404f338471fb539f4d6fef): free 2761254 bytes of WAL
I20261118 09:02:45.511209 21985 log_reader.cc:385] T c3428185bc404f338471fb539f4d6fef: removed 3 log segments from log reader
I20261118 09:02:45.511278 21985 log.cc:1079] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/wals/c3428185bc404f338471fb539f4d6fef/wal-000000001 (ops 1-8)
I20261118 09:02:45.511351 21985 log.cc:1079] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/wals/c3428185bc404f338471fb539f4d6fef/wal-000000002 (ops 9-15)
I20261118 09:02:45.511412 21985 log.cc:1079] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/wals/c3428185bc404f338471fb539f4d6fef/wal-000000003 (ops 16-22)
I20261118 09:02:45.512311 21985 maintenance_manager.cc:643] P b27299b04ae9456c9714aec834e7bf27: LogGCOp(c3428185bc404f338471fb539f4d6fef) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
I20261118 09:02:45.512611 22095 maintenance_manager.cc:419] P b27299b04ae9456c9714aec834e7bf27: Scheduling UndoDeltaBlockGCOp(c3428185bc404f338471fb539f4d6fef): 435 bytes on disk
I20261118 09:02:45.513084 21985 maintenance_manager.cc:643] P b27299b04ae9456c9714aec834e7bf27: UndoDeltaBlockGCOp(c3428185bc404f338471fb539f4d6fef) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4}
I20261118 09:02:45.528126 22247 maintenance_manager.cc:643] P b09598dac802400188ef28007061480e: CompactRowSetsOp(c3428185bc404f338471fb539f4d6fef) complete. Timing: real 0.041s	user 0.041s	sys 0.000s Metrics: {"bytes_written":135937,"cfile_cache_hit":10,"cfile_cache_hit_bytes":262392,"cfile_cache_miss":26,"cfile_cache_miss_bytes":264188,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":1015,"dirs.run_cpu_time_us":134,"dirs.run_wall_time_us":1154,"drs_written":1,"lbm_read_time_us":617,"lbm_reads_lt_1ms":54,"lbm_write_time_us":452,"lbm_writes_lt_1ms":23,"mutex_wait_us":46,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":31,"spinlock_wait_cycles":9216,"thread_start_us":380,"threads_started":5}
I20261118 09:02:45.528698 22357 maintenance_manager.cc:419] P b09598dac802400188ef28007061480e: Scheduling UndoDeltaBlockGCOp(c3428185bc404f338471fb539f4d6fef): 480 bytes on disk
I20261118 09:02:45.529145 22247 maintenance_manager.cc:643] P b09598dac802400188ef28007061480e: UndoDeltaBlockGCOp(c3428185bc404f338471fb539f4d6fef) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":40,"lbm_reads_lt_1ms":4}
I20261118 09:02:45.931396 22225 heartbeater.cc:500] Master 127.18.135.190:36423 was elected leader, sending a full tablet report...
I20261118 09:02:45.948771 22380 consensus_queue.cc:754] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [LEADER]: The logs necessary to catch up peer 2826158df8a24f77b07af76884fb7096 have been garbage collected. The follower will never be able to catch up (Not found: failed to read ops 3..31: Segment 1 which contained index 3 has been GCed)
I20261118 09:02:45.948866 22380 consensus_queue.cc:580] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [LEADER]: The logs necessary to catch up peer 2826158df8a24f77b07af76884fb7096 have been garbage collected. The replica will never be able to catch up
I20261118 09:02:45.951836 22310 consensus_queue.cc:238] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 37, Committed index: 37, Last appended: 1.37, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } }
I20261118 09:02:45.953016 22047 raft_consensus.cc:1285] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27 [term 1 FOLLOWER]: Refusing update from remote peer b09598dac802400188ef28007061480e: Log matching property violated. Preceding OpId in replica: term: 1 index: 37. Preceding OpId from leader: term: 1 index: 38. (index mismatch)
I20261118 09:02:45.953433 22380 consensus_queue.cc:1049] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 38, Last known committed idx: 37, Time since last communication: 0.000s
I20261118 09:02:45.955078 22385 raft_consensus.cc:2983] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [term 1 LEADER]: Committing config change with OpId 1.38: config changed from index -1 to 38, VOTER 2826158df8a24f77b07af76884fb7096 (127.18.135.129) evicted. New config: { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } }
I20261118 09:02:45.955551 22047 raft_consensus.cc:2983] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27 [term 1 FOLLOWER]: Committing config change with OpId 1.38: config changed from index -1 to 38, VOTER 2826158df8a24f77b07af76884fb7096 (127.18.135.129) evicted. New config: { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } }
I20261118 09:02:45.956879 21759 catalog_manager.cc:5247] ChangeConfig:REMOVE_PEER RPC for tablet c3428185bc404f338471fb539f4d6fef with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20261118 09:02:45.957854 21772 catalog_manager.cc:5840] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e reported cstate change: config changed from index -1 to 38, VOTER 2826158df8a24f77b07af76884fb7096 (127.18.135.129) evicted. New cstate: current_term: 1 leader_uuid: "b09598dac802400188ef28007061480e" committed_config { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } health_report { overall_health: HEALTHY } } }
W20261118 09:02:45.960773 21759 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.135.129:35857: connect: Connection refused (error 111)
W20261118 09:02:45.961580 21759 catalog_manager.cc:4792] TS 2826158df8a24f77b07af76884fb7096 (127.18.135.129:35857): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c3428185bc404f338471fb539f4d6fef: Network error: Client connection negotiation failed: client connection to 127.18.135.129:35857: connect: Connection refused (error 111)
I20261118 09:02:45.961818 22310 consensus_queue.cc:238] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 38, Committed index: 38, Last appended: 1.38, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "585f2007071444bf8b0cb2a62d348dcd" member_type: NON_VOTER last_known_addr { host: "127.18.135.131" port: 38341 } attrs { promote: true } }
I20261118 09:02:45.963078 22047 raft_consensus.cc:1285] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27 [term 1 FOLLOWER]: Refusing update from remote peer b09598dac802400188ef28007061480e: Log matching property violated. Preceding OpId in replica: term: 1 index: 38. Preceding OpId from leader: term: 1 index: 39. (index mismatch)
I20261118 09:02:45.963485 22380 consensus_queue.cc:1049] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 39, Last known committed idx: 38, Time since last communication: 0.000s
I20261118 09:02:45.964953 22385 raft_consensus.cc:2983] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [term 1 LEADER]: Committing config change with OpId 1.39: config changed from index 38 to 39, NON_VOTER 585f2007071444bf8b0cb2a62d348dcd (127.18.135.131) added. New config: { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "585f2007071444bf8b0cb2a62d348dcd" member_type: NON_VOTER last_known_addr { host: "127.18.135.131" port: 38341 } attrs { promote: true } } }
I20261118 09:02:45.965420 22047 raft_consensus.cc:2983] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27 [term 1 FOLLOWER]: Committing config change with OpId 1.39: config changed from index 38 to 39, NON_VOTER 585f2007071444bf8b0cb2a62d348dcd (127.18.135.131) added. New config: { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "585f2007071444bf8b0cb2a62d348dcd" member_type: NON_VOTER last_known_addr { host: "127.18.135.131" port: 38341 } attrs { promote: true } } }
I20261118 09:02:45.966463 21759 catalog_manager.cc:5247] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet c3428185bc404f338471fb539f4d6fef with cas_config_opid_index 38: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20261118 09:02:45.967605 21772 catalog_manager.cc:5840] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e reported cstate change: config changed from index 38 to 39, NON_VOTER 585f2007071444bf8b0cb2a62d348dcd (127.18.135.131) added. New cstate: current_term: 1 leader_uuid: "b09598dac802400188ef28007061480e" committed_config { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "585f2007071444bf8b0cb2a62d348dcd" member_type: NON_VOTER last_known_addr { host: "127.18.135.131" port: 38341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20261118 09:02:45.969393 22244 consensus_peers.cc:597] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e -> Peer 585f2007071444bf8b0cb2a62d348dcd (127.18.135.131:38341): Couldn't send request to peer 585f2007071444bf8b0cb2a62d348dcd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3428185bc404f338471fb539f4d6fef. This is attempt 1: this message will repeat every 5th retry.
I20261118 09:02:46.385254 22427 ts_tablet_manager.cc:979] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd: Initiating tablet copy from peer b09598dac802400188ef28007061480e (127.18.135.132:43873)
I20261118 09:02:46.385921 22427 tablet_copy_client.cc:323] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd: tablet copy: Beginning tablet copy session from remote peer at address 127.18.135.132:43873
I20261118 09:02:46.389652 22330 tablet_copy_service.cc:140] P b09598dac802400188ef28007061480e: Received BeginTabletCopySession request for tablet c3428185bc404f338471fb539f4d6fef from peer 585f2007071444bf8b0cb2a62d348dcd ({username='slave'} at 127.18.135.131:36863)
I20261118 09:02:46.389864 22330 tablet_copy_service.cc:161] P b09598dac802400188ef28007061480e: Beginning new tablet copy session on tablet c3428185bc404f338471fb539f4d6fef from peer 585f2007071444bf8b0cb2a62d348dcd at {username='slave'} at 127.18.135.131:36863: session id = 585f2007071444bf8b0cb2a62d348dcd-c3428185bc404f338471fb539f4d6fef
I20261118 09:02:46.391378 22330 tablet_copy_source_session.cc:215] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e: Tablet Copy: opened 5 blocks and 3 log segments
I20261118 09:02:46.395254 22427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3428185bc404f338471fb539f4d6fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:46.399817 22427 tablet_copy_client.cc:806] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd: tablet copy: Starting download of 5 data blocks...
I20261118 09:02:46.406685 22427 tablet_copy_client.cc:670] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd: tablet copy: Starting download of 3 WAL segments...
I20261118 09:02:46.414654 22427 tablet_copy_client.cc:538] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261118 09:02:46.416884 22427 tablet_bootstrap.cc:492] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd: Bootstrap starting.
I20261118 09:02:46.424070 22427 log.cc:826] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:46.430299 22427 tablet_bootstrap.cc:492] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd: Bootstrap replayed 1/3 log segments. Stats: ops{read=7 overwritten=0 applied=5 ignored=5} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 2 replicates
I20261118 09:02:46.435402 22427 tablet_bootstrap.cc:492] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd: Bootstrap replayed 2/3 log segments. Stats: ops{read=14 overwritten=0 applied=11 ignored=10} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 3 replicates
I20261118 09:02:46.438308 22427 tablet_bootstrap.cc:492] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd: Bootstrap replayed 3/3 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=10} inserts{seen=5 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 0 replicates
I20261118 09:02:46.438643 22427 tablet_bootstrap.cc:492] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd: Bootstrap complete.
I20261118 09:02:46.439281 22427 ts_tablet_manager.cc:1449] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd: Time spent bootstrapping tablet: real 0.023s	user 0.023s	sys 0.000s
I20261118 09:02:46.441035 22427 raft_consensus.cc:360] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "585f2007071444bf8b0cb2a62d348dcd" member_type: NON_VOTER last_known_addr { host: "127.18.135.131" port: 38341 } attrs { promote: true } }
I20261118 09:02:46.441252 22427 raft_consensus.cc:748] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 585f2007071444bf8b0cb2a62d348dcd, State: Initialized, Role: LEARNER
I20261118 09:02:46.441592 22427 consensus_queue.cc:261] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 39, Last appended: 1.39, Last appended by leader: 39, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "585f2007071444bf8b0cb2a62d348dcd" member_type: NON_VOTER last_known_addr { host: "127.18.135.131" port: 38341 } attrs { promote: true } }
I20261118 09:02:46.442341 22427 ts_tablet_manager.cc:1480] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd: Time spent starting tablet: real 0.003s	user 0.004s	sys 0.000s
I20261118 09:02:46.443142 22329 tablet_copy_service.cc:342] P b09598dac802400188ef28007061480e: Request end of tablet copy session 585f2007071444bf8b0cb2a62d348dcd-c3428185bc404f338471fb539f4d6fef received from {username='slave'} at 127.18.135.131:36863
I20261118 09:02:46.443256 22329 tablet_copy_service.cc:434] P b09598dac802400188ef28007061480e: ending tablet copy session 585f2007071444bf8b0cb2a62d348dcd-c3428185bc404f338471fb539f4d6fef on tablet c3428185bc404f338471fb539f4d6fef with peer 585f2007071444bf8b0cb2a62d348dcd
I20261118 09:02:46.522106 22226 maintenance_manager.cc:419] P 585f2007071444bf8b0cb2a62d348dcd: Scheduling UndoDeltaBlockGCOp(c3428185bc404f338471fb539f4d6fef): 480 bytes on disk
I20261118 09:02:46.522979 22116 maintenance_manager.cc:643] P 585f2007071444bf8b0cb2a62d348dcd: UndoDeltaBlockGCOp(c3428185bc404f338471fb539f4d6fef) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4}
I20261118 09:02:46.886358 22179 raft_consensus.cc:1227] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.38->[1.39-1.39]   Dedup: 1.39->[]
I20261118 09:02:46.934753 22357 maintenance_manager.cc:419] P b09598dac802400188ef28007061480e: Scheduling LogGCOp(c3428185bc404f338471fb539f4d6fef): free 920418 bytes of WAL
I20261118 09:02:46.935123 22247 log_reader.cc:385] T c3428185bc404f338471fb539f4d6fef: removed 1 log segments from log reader
I20261118 09:02:46.935204 22247 log.cc:1079] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/wals/c3428185bc404f338471fb539f4d6fef/wal-000000004 (ops 23-29)
I20261118 09:02:46.935554 22247 maintenance_manager.cc:643] P b09598dac802400188ef28007061480e: LogGCOp(c3428185bc404f338471fb539f4d6fef) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20261118 09:02:47.019273 22095 maintenance_manager.cc:419] P b27299b04ae9456c9714aec834e7bf27: Scheduling LogGCOp(c3428185bc404f338471fb539f4d6fef): free 788953 bytes of WAL
I20261118 09:02:47.019593 21985 log_reader.cc:385] T c3428185bc404f338471fb539f4d6fef: removed 1 log segments from log reader
I20261118 09:02:47.019675 21985 log.cc:1079] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/wals/c3428185bc404f338471fb539f4d6fef/wal-000000004 (ops 23-28)
I20261118 09:02:47.020048 21985 maintenance_manager.cc:643] P b27299b04ae9456c9714aec834e7bf27: LogGCOp(c3428185bc404f338471fb539f4d6fef) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
W20261118 09:02:47.171599 21759 catalog_manager.cc:4792] TS 2826158df8a24f77b07af76884fb7096 (127.18.135.129:35857): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c3428185bc404f338471fb539f4d6fef: Network error: Client connection negotiation failed: client connection to 127.18.135.129:35857: connect: Connection refused (error 111)
I20261118 09:02:47.437463 22440 raft_consensus.cc:1074] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e: attempting to promote NON_VOTER 585f2007071444bf8b0cb2a62d348dcd to VOTER
I20261118 09:02:47.437974 22440 consensus_queue.cc:238] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 39, Committed index: 39, Last appended: 1.39, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "585f2007071444bf8b0cb2a62d348dcd" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 38341 } attrs { promote: false } }
I20261118 09:02:47.439229 22047 raft_consensus.cc:1285] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27 [term 1 FOLLOWER]: Refusing update from remote peer b09598dac802400188ef28007061480e: Log matching property violated. Preceding OpId in replica: term: 1 index: 39. Preceding OpId from leader: term: 1 index: 40. (index mismatch)
I20261118 09:02:47.439317 22179 raft_consensus.cc:1285] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd [term 1 LEARNER]: Refusing update from remote peer b09598dac802400188ef28007061480e: Log matching property violated. Preceding OpId in replica: term: 1 index: 39. Preceding OpId from leader: term: 1 index: 40. (index mismatch)
I20261118 09:02:47.439703 22439 consensus_queue.cc:1049] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20261118 09:02:47.439901 22442 consensus_queue.cc:1049] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [LEADER]: Connected to new peer: Peer: permanent_uuid: "585f2007071444bf8b0cb2a62d348dcd" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 38341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20261118 09:02:47.441586 22439 raft_consensus.cc:2983] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e [term 1 LEADER]: Committing config change with OpId 1.40: config changed from index 39 to 40, 585f2007071444bf8b0cb2a62d348dcd (127.18.135.131) changed from NON_VOTER to VOTER. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "585f2007071444bf8b0cb2a62d348dcd" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 38341 } attrs { promote: false } } }
I20261118 09:02:47.442159 22047 raft_consensus.cc:2983] T c3428185bc404f338471fb539f4d6fef P b27299b04ae9456c9714aec834e7bf27 [term 1 FOLLOWER]: Committing config change with OpId 1.40: config changed from index 39 to 40, 585f2007071444bf8b0cb2a62d348dcd (127.18.135.131) changed from NON_VOTER to VOTER. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "585f2007071444bf8b0cb2a62d348dcd" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 38341 } attrs { promote: false } } }
I20261118 09:02:47.443500 22179 raft_consensus.cc:2983] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd [term 1 FOLLOWER]: Committing config change with OpId 1.40: config changed from index 39 to 40, 585f2007071444bf8b0cb2a62d348dcd (127.18.135.131) changed from NON_VOTER to VOTER. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "585f2007071444bf8b0cb2a62d348dcd" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 38341 } attrs { promote: false } } }
I20261118 09:02:47.444268 21773 catalog_manager.cc:5840] T c3428185bc404f338471fb539f4d6fef P b09598dac802400188ef28007061480e reported cstate change: config changed from index 39 to 40, 585f2007071444bf8b0cb2a62d348dcd (127.18.135.131) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b09598dac802400188ef28007061480e" committed_config { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "585f2007071444bf8b0cb2a62d348dcd" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 38341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20261118 09:02:47.467155 18974 raft_consensus-itest-base.cc:295] Servers converged with original term 1
I20261118 09:02:47.467211 18974 raft_consensus-itest-base.cc:303] Restarting 2826158df8a24f77b07af76884fb7096
I20261118 09:02:47.467551 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.129:35857
--local_ip_for_outbound_sockets=127.18.135.129
--tserver_master_addrs=127.18.135.190:36423
--webserver_port=36387
--webserver_interface=127.18.135.129
--builtin_ntp_servers=127.18.135.148:41175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 09:02:47.526947 22226 maintenance_manager.cc:419] P 585f2007071444bf8b0cb2a62d348dcd: Scheduling LogGCOp(c3428185bc404f338471fb539f4d6fef): free 920390 bytes of WAL
I20261118 09:02:47.527289 22116 log_reader.cc:385] T c3428185bc404f338471fb539f4d6fef: removed 1 log segments from log reader
I20261118 09:02:47.527343 22116 log.cc:1079] T c3428185bc404f338471fb539f4d6fef P 585f2007071444bf8b0cb2a62d348dcd: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal/wals/c3428185bc404f338471fb539f4d6fef/wal-000000001 (ops 23-29)
I20261118 09:02:47.527779 22116 maintenance_manager.cc:643] P 585f2007071444bf8b0cb2a62d348dcd: LogGCOp(c3428185bc404f338471fb539f4d6fef) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
W20261118 09:02:47.568740 22451 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:47.569005 22451 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:47.569073 22451 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:47.569181 22451 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:47.572533 22451 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:47.572618 22451 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:47.572700 22451 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:47.572846 22451 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:47.572916 22451 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.129
I20261118 09:02:47.576764 22451 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:41175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.129:35857
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.18.135.129
--webserver_port=36387
--tserver_master_addrs=127.18.135.190:36423
--never_fsync=true
--heap_profile_path=/tmp/kudu.22451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:47.577533 22451 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:47.578364 22451 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:47.583890 22459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:47.584049 22451 server_base.cc:1061] running on GCE node
W20261118 09:02:47.583890 22457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:47.583917 22456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:47.584497 22451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:47.585026 22451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:47.586166 22451 hybrid_clock.cc:648] HybridClock initialized: now 1794992567586157 us; error 23 us; skew 500 ppm
I20261118 09:02:47.587773 22451 webserver.cc:577] Webserver started at http://127.18.135.129:36387/ using document root <none> and password file <none>
I20261118 09:02:47.588332 22451 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:47.588395 22451 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:47.591840 22451 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 09:02:47.594028 22465 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:47.594965 22451 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 09:02:47.595055 22451 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "2826158df8a24f77b07af76884fb7096"
format_stamp: "Formatted at 2026-11-18 09:02:44 on dist-test-slave-q6bx"
I20261118 09:02:47.595433 22451 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:47.623406 22451 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:47.623944 22451 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:47.624068 22451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:47.624529 22451 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:47.625653 22472 ts_tablet_manager.cc:588] Loading tablet metadata (0/1 complete)
I20261118 09:02:47.629184 22451 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261118 09:02:47.629240 22451 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20261118 09:02:47.629323 22451 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261118 09:02:47.630853 22451 ts_tablet_manager.cc:662] Registered 1 tablets
I20261118 09:02:47.630894 22451 ts_tablet_manager.cc:641] Time spent register tablets: real 0.002s	user 0.001s	sys 0.000s
I20261118 09:02:47.631237 22472 tablet_bootstrap.cc:492] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096: Bootstrap starting.
I20261118 09:02:47.638746 22472 log.cc:826] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:47.640975 22472 tablet_bootstrap.cc:492] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261118 09:02:47.641392 22451 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.129:35857
I20261118 09:02:47.641392 22472 tablet_bootstrap.cc:492] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096: Bootstrap complete.
I20261118 09:02:47.641479 22580 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.129:35857 every 8 connection(s)
I20261118 09:02:47.642011 22472 ts_tablet_manager.cc:1449] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.002s
I20261118 09:02:47.642467 22451 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20261118 09:02:47.643363 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 22451
I20261118 09:02:47.646039 22472 raft_consensus.cc:360] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "2826158df8a24f77b07af76884fb7096" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 35857 } }
I20261118 09:02:47.646430 22472 raft_consensus.cc:748] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2826158df8a24f77b07af76884fb7096, State: Initialized, Role: FOLLOWER
I20261118 09:02:47.646944 22472 consensus_queue.cc:261] T c3428185bc404f338471fb539f4d6fef P 2826158df8a24f77b07af76884fb7096 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27299b04ae9456c9714aec834e7bf27" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 42543 } } peers { permanent_uuid: "b09598dac802400188ef28007061480e" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 43873 } } peers { permanent_uuid: "2826158df8a24f77b07af76884fb7096" member_type: VOTER last_known_addr { host: "127.18.135.129" port: 35857 } }
I20261118 09:02:47.647462 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 22451
I20261118 09:02:47.653505 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 21966
W20261118 09:02:47.653342 22583 negotiation.cc:336] Failed RPC negotiation. Trace:
1118 09:02:47.644027 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.18.135.129:44691 (local address 127.18.135.190:36423)
1118 09:02:47.645535 (+  1508us) server_negotiation.cc:207] Beginning negotiation
1118 09:02:47.645540 (+     5us) server_negotiation.cc:400] Waiting for connection header
1118 09:02:47.645556 (+    16us) server_negotiation.cc:408] Connection header received
1118 09:02:47.645880 (+   324us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1118 09:02:47.645884 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1118 09:02:47.645931 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1118 09:02:47.646023 (+    92us) server_negotiation.cc:227] Negotiated authn=SASL
1118 09:02:47.647184 (+  1161us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1118 09:02:47.648716 (+  1532us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1118 09:02:47.653329 (+  4613us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.135.129:44691: BlockingRecv error: recv error from unknown peer: Connection reset by peer (error 104)
Metrics: {"server-negotiator.queue_time_us":1421,"thread_start_us":94,"threads_started":1}
I20261118 09:02:47.660857 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 22097
I20261118 09:02:47.667485 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 22228
I20261118 09:02:47.674482 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 21744
2026-11-18T09:02:47Z chronyd exiting
[       OK ] SlowTabletBootstrapTest.TestFallBehind (3535 ms)
[ RUN      ] SlowTabletBootstrapTest.TestFallBehindSlowBootstrap
I20261118 09:02:47.700114 18974 ts_itest-base.cc:115] Starting cluster with:
I20261118 09:02:47.700158 18974 ts_itest-base.cc:116] --------------
I20261118 09:02:47.700170 18974 ts_itest-base.cc:117] 4 tablet servers
I20261118 09:02:47.700182 18974 ts_itest-base.cc:118] 3 replicas per TS
I20261118 09:02:47.700192 18974 ts_itest-base.cc:119] --------------
2026-11-18T09:02:47Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-18T09:02:47Z Disabled control of system clock
I20261118 09:02:47.708315 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.135.190:37589
--webserver_interface=127.18.135.190
--webserver_port=0
--builtin_ntp_servers=127.18.135.148:38985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.135.190:37589 with env {}
W20261118 09:02:47.806743 22593 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:47.806975 22593 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:47.807092 22593 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:47.810452 22593 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261118 09:02:47.810542 22593 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:47.810587 22593 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261118 09:02:47.810654 22593 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261118 09:02:47.814654 22593 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:38985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.135.190:37589
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.135.190:37589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.18.135.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.22593
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:47.815443 22593 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:47.816159 22593 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:47.821003 22601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:47.821003 22598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:47.821065 22599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:47.821132 22593 server_base.cc:1061] running on GCE node
I20261118 09:02:47.821558 22593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:47.822371 22593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:47.823534 22593 hybrid_clock.cc:648] HybridClock initialized: now 1794992567823517 us; error 27 us; skew 500 ppm
I20261118 09:02:47.825014 22593 webserver.cc:577] Webserver started at http://127.18.135.190:46117/ using document root <none> and password file <none>
I20261118 09:02:47.825579 22593 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:47.825640 22593 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:47.825901 22593 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:47.827116 22593 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "9773568631304fbf872d6adeaf6d2da8"
format_stamp: "Formatted at 2026-11-18 09:02:47 on dist-test-slave-q6bx"
I20261118 09:02:47.827512 22593 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "9773568631304fbf872d6adeaf6d2da8"
format_stamp: "Formatted at 2026-11-18 09:02:47 on dist-test-slave-q6bx"
I20261118 09:02:47.830650 22593 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.003s
I20261118 09:02:47.832901 22607 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:47.834025 22593 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20261118 09:02:47.834133 22593 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
uuid: "9773568631304fbf872d6adeaf6d2da8"
format_stamp: "Formatted at 2026-11-18 09:02:47 on dist-test-slave-q6bx"
I20261118 09:02:47.834208 22593 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:47.864167 22593 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:47.864646 22593 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:47.864773 22593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:47.871801 22593 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.190:37589
I20261118 09:02:47.871801 22659 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.190:37589 every 8 connection(s)
I20261118 09:02:47.872915 22593 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20261118 09:02:47.873092 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 22593
I20261118 09:02:47.873203 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/master-0/wal/instance
I20261118 09:02:47.876785 22660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:47.882323 22660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8: Bootstrap starting.
I20261118 09:02:47.884348 22660 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:47.885219 22660 log.cc:826] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:47.886607 22660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8: No bootstrap required, opened a new log
I20261118 09:02:47.888901 22660 raft_consensus.cc:360] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9773568631304fbf872d6adeaf6d2da8" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 37589 } }
I20261118 09:02:47.889060 22660 raft_consensus.cc:386] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:47.889122 22660 raft_consensus.cc:748] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9773568631304fbf872d6adeaf6d2da8, State: Initialized, Role: FOLLOWER
I20261118 09:02:47.889534 22660 consensus_queue.cc:261] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9773568631304fbf872d6adeaf6d2da8" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 37589 } }
I20261118 09:02:47.889675 22660 raft_consensus.cc:400] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261118 09:02:47.889753 22660 raft_consensus.cc:499] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261118 09:02:47.889883 22660 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:47.890604 22660 raft_consensus.cc:521] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9773568631304fbf872d6adeaf6d2da8" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 37589 } }
I20261118 09:02:47.890949 22660 leader_election.cc:304] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9773568631304fbf872d6adeaf6d2da8; no voters: 
I20261118 09:02:47.891275 22660 leader_election.cc:290] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261118 09:02:47.891350 22665 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [term 1 FOLLOWER]: Leader election won for term 1
I20261118 09:02:47.891546 22665 raft_consensus.cc:705] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [term 1 LEADER]: Becoming Leader. State: Replica: 9773568631304fbf872d6adeaf6d2da8, State: Running, Role: LEADER
I20261118 09:02:47.891880 22665 consensus_queue.cc:238] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9773568631304fbf872d6adeaf6d2da8" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 37589 } }
I20261118 09:02:47.892385 22660 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [sys.catalog]: configured and running, proceeding with master startup.
I20261118 09:02:47.893534 22667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9773568631304fbf872d6adeaf6d2da8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9773568631304fbf872d6adeaf6d2da8" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 37589 } } }
I20261118 09:02:47.893671 22667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [sys.catalog]: This master's current role is: LEADER
I20261118 09:02:47.894150 22666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9773568631304fbf872d6adeaf6d2da8. Latest consensus state: current_term: 1 leader_uuid: "9773568631304fbf872d6adeaf6d2da8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9773568631304fbf872d6adeaf6d2da8" member_type: VOTER last_known_addr { host: "127.18.135.190" port: 37589 } } }
I20261118 09:02:47.894237 22666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8 [sys.catalog]: This master's current role is: LEADER
I20261118 09:02:47.894665 22674 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261118 09:02:47.897888 22674 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261118 09:02:47.903510 22674 catalog_manager.cc:1398] Generated new cluster ID: 9b3425801f654a969233b0a3d6ff352a
I20261118 09:02:47.903574 22674 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261118 09:02:47.911427 22674 catalog_manager.cc:1421] Generated new certificate authority record
I20261118 09:02:47.912268 22674 catalog_manager.cc:1555] Loading token signing keys...
I20261118 09:02:47.918620 22674 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 9773568631304fbf872d6adeaf6d2da8: Generated new TSK 0
I20261118 09:02:47.919272 22674 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261118 09:02:47.929937 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.129:0
--local_ip_for_outbound_sockets=127.18.135.129
--webserver_interface=127.18.135.129
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37589
--builtin_ntp_servers=127.18.135.148:38985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
W20261118 09:02:48.029322 22684 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:48.029501 22684 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:48.029551 22684 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:48.029639 22684 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:48.032954 22684 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:48.033002 22684 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:48.033035 22684 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:48.033185 22684 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:48.033218 22684 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.129
I20261118 09:02:48.037133 22684 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:38985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.18.135.129
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37589
--never_fsync=true
--heap_profile_path=/tmp/kudu.22684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:48.037925 22684 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:48.038615 22684 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:48.044003 22690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:48.044034 22692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:48.044034 22689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:48.044454 22684 server_base.cc:1061] running on GCE node
I20261118 09:02:48.044809 22684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:48.045408 22684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:48.046624 22684 hybrid_clock.cc:648] HybridClock initialized: now 1794992568046600 us; error 38 us; skew 500 ppm
I20261118 09:02:48.048302 22684 webserver.cc:577] Webserver started at http://127.18.135.129:33939/ using document root <none> and password file <none>
I20261118 09:02:48.048866 22684 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:48.048916 22684 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:48.049135 22684 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:48.050465 22684 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "5920eea588fe4db9a6c7fad82a7da660"
format_stamp: "Formatted at 2026-11-18 09:02:48 on dist-test-slave-q6bx"
I20261118 09:02:48.050897 22684 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "5920eea588fe4db9a6c7fad82a7da660"
format_stamp: "Formatted at 2026-11-18 09:02:48 on dist-test-slave-q6bx"
I20261118 09:02:48.054044 22684 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20261118 09:02:48.056268 22698 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:48.057236 22684 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 09:02:48.057325 22684 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "5920eea588fe4db9a6c7fad82a7da660"
format_stamp: "Formatted at 2026-11-18 09:02:48 on dist-test-slave-q6bx"
I20261118 09:02:48.057435 22684 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:48.069657 22684 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:48.070112 22684 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:48.070266 22684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:48.070708 22684 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:48.071566 22684 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:48.071612 22684 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:48.071651 22684 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:48.071666 22684 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:48.080595 22684 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.129:37171
I20261118 09:02:48.080626 22811 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.129:37171 every 8 connection(s)
I20261118 09:02:48.081490 22684 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20261118 09:02:48.085302 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 22684
I20261118 09:02:48.085417 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20261118 09:02:48.087586 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.130:0
--local_ip_for_outbound_sockets=127.18.135.130
--webserver_interface=127.18.135.130
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37589
--builtin_ntp_servers=127.18.135.148:38985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 09:02:48.089090 22812 heartbeater.cc:345] Connected to a master server at 127.18.135.190:37589
I20261118 09:02:48.089315 22812 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:48.089847 22812 heartbeater.cc:508] Master 127.18.135.190:37589 requested a full tablet report, sending...
I20261118 09:02:48.091424 22624 ts_manager.cc:210] Registered new tserver with Master: 5920eea588fe4db9a6c7fad82a7da660 (127.18.135.129:37171)
I20261118 09:02:48.092618 22624 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.129:52281
W20261118 09:02:48.185883 22815 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:48.186060 22815 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:48.186082 22815 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:48.186172 22815 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:48.189441 22815 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:48.189491 22815 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:48.189566 22815 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:48.189721 22815 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:48.189774 22815 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.130
I20261118 09:02:48.193637 22815 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:38985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.18.135.130
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37589
--never_fsync=true
--heap_profile_path=/tmp/kudu.22815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:48.194399 22815 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:48.195091 22815 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:48.200513 22823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:48.200491 22820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:48.200515 22821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:48.200780 22815 server_base.cc:1061] running on GCE node
I20261118 09:02:48.201191 22815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:48.201794 22815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:48.202960 22815 hybrid_clock.cc:648] HybridClock initialized: now 1794992568202952 us; error 42 us; skew 500 ppm
I20261118 09:02:48.204491 22815 webserver.cc:577] Webserver started at http://127.18.135.130:34293/ using document root <none> and password file <none>
I20261118 09:02:48.205052 22815 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:48.205127 22815 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:48.205348 22815 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:48.206640 22815 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "a2e1fc3f49b54dfdb70548e221015055"
format_stamp: "Formatted at 2026-11-18 09:02:48 on dist-test-slave-q6bx"
I20261118 09:02:48.207072 22815 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "a2e1fc3f49b54dfdb70548e221015055"
format_stamp: "Formatted at 2026-11-18 09:02:48 on dist-test-slave-q6bx"
I20261118 09:02:48.210162 22815 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20261118 09:02:48.212509 22829 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:48.213487 22815 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 09:02:48.213617 22815 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "a2e1fc3f49b54dfdb70548e221015055"
format_stamp: "Formatted at 2026-11-18 09:02:48 on dist-test-slave-q6bx"
I20261118 09:02:48.213714 22815 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:48.224507 22815 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:48.224941 22815 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:48.225100 22815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:48.225577 22815 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:48.226521 22815 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:48.226593 22815 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:48.226675 22815 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:48.226719 22815 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:48.235102 22815 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.130:43495
I20261118 09:02:48.235126 22942 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.130:43495 every 8 connection(s)
I20261118 09:02:48.236045 22815 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20261118 09:02:48.243417 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 22815
I20261118 09:02:48.243510 22943 heartbeater.cc:345] Connected to a master server at 127.18.135.190:37589
I20261118 09:02:48.243566 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20261118 09:02:48.243727 22943 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:48.244258 22943 heartbeater.cc:508] Master 127.18.135.190:37589 requested a full tablet report, sending...
I20261118 09:02:48.245405 22624 ts_manager.cc:210] Registered new tserver with Master: a2e1fc3f49b54dfdb70548e221015055 (127.18.135.130:43495)
I20261118 09:02:48.245922 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.131:0
--local_ip_for_outbound_sockets=127.18.135.131
--webserver_interface=127.18.135.131
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37589
--builtin_ntp_servers=127.18.135.148:38985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 09:02:48.246053 22624 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.130:36071
W20261118 09:02:48.346733 22946 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:48.346982 22946 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:48.347045 22946 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:48.347131 22946 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:48.350453 22946 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:48.350536 22946 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:48.350615 22946 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:48.350749 22946 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:48.350822 22946 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.131
I20261118 09:02:48.354650 22946 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:38985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.18.135.131
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37589
--never_fsync=true
--heap_profile_path=/tmp/kudu.22946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:48.355403 22946 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:48.356086 22946 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:48.361527 22952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:48.361538 22951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:48.361538 22954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:48.361963 22946 server_base.cc:1061] running on GCE node
I20261118 09:02:48.362317 22946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:48.362886 22946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:48.364068 22946 hybrid_clock.cc:648] HybridClock initialized: now 1794992568364048 us; error 34 us; skew 500 ppm
I20261118 09:02:48.365767 22946 webserver.cc:577] Webserver started at http://127.18.135.131:35241/ using document root <none> and password file <none>
I20261118 09:02:48.366371 22946 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:48.366456 22946 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:48.366700 22946 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:48.367923 22946 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "9806924f51314f71ac4a8b5ced2c5bf8"
format_stamp: "Formatted at 2026-11-18 09:02:48 on dist-test-slave-q6bx"
I20261118 09:02:48.368316 22946 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "9806924f51314f71ac4a8b5ced2c5bf8"
format_stamp: "Formatted at 2026-11-18 09:02:48 on dist-test-slave-q6bx"
I20261118 09:02:48.371469 22946 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 09:02:48.373689 22960 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:48.374693 22946 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 09:02:48.374826 22946 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "9806924f51314f71ac4a8b5ced2c5bf8"
format_stamp: "Formatted at 2026-11-18 09:02:48 on dist-test-slave-q6bx"
I20261118 09:02:48.374923 22946 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:48.386054 22946 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:48.386451 22946 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:48.386617 22946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:48.387082 22946 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:48.388141 22946 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:48.388199 22946 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:48.388252 22946 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:48.388324 22946 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20261118 09:02:48.398785 22946 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.131:46085
I20261118 09:02:48.398960 23073 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.131:46085 every 8 connection(s)
I20261118 09:02:48.399730 22946 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20261118 09:02:48.401201 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 22946
I20261118 09:02:48.401362 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20261118 09:02:48.403697 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.132:0
--local_ip_for_outbound_sockets=127.18.135.132
--webserver_interface=127.18.135.132
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37589
--builtin_ntp_servers=127.18.135.148:38985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 09:02:48.408354 23074 heartbeater.cc:345] Connected to a master server at 127.18.135.190:37589
I20261118 09:02:48.408610 23074 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:48.409112 23074 heartbeater.cc:508] Master 127.18.135.190:37589 requested a full tablet report, sending...
I20261118 09:02:48.410318 22624 ts_manager.cc:210] Registered new tserver with Master: 9806924f51314f71ac4a8b5ced2c5bf8 (127.18.135.131:46085)
I20261118 09:02:48.411190 22624 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.131:36969
W20261118 09:02:48.506646 23077 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:48.506826 23077 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:48.506848 23077 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:48.506886 23077 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:48.510218 23077 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:48.510267 23077 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:48.510300 23077 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:48.510365 23077 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:48.510394 23077 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.132
I20261118 09:02:48.514222 23077 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:38985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.18.135.132
--webserver_port=0
--tserver_master_addrs=127.18.135.190:37589
--never_fsync=true
--heap_profile_path=/tmp/kudu.23077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:48.514895 23077 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:48.515533 23077 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:48.521247 23085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:48.521333 23083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:48.521247 23082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:48.521448 23077 server_base.cc:1061] running on GCE node
I20261118 09:02:48.521835 23077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:48.522357 23077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:48.523521 23077 hybrid_clock.cc:648] HybridClock initialized: now 1794992568523506 us; error 35 us; skew 500 ppm
I20261118 09:02:48.525481 23077 webserver.cc:577] Webserver started at http://127.18.135.132:35429/ using document root <none> and password file <none>
I20261118 09:02:48.526177 23077 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:48.526228 23077 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:48.526459 23077 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 09:02:48.527799 23077 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "067b6d1229734ede96d13fba86419a96"
format_stamp: "Formatted at 2026-11-18 09:02:48 on dist-test-slave-q6bx"
I20261118 09:02:48.528229 23077 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "067b6d1229734ede96d13fba86419a96"
format_stamp: "Formatted at 2026-11-18 09:02:48 on dist-test-slave-q6bx"
I20261118 09:02:48.531418 23077 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 09:02:48.533596 23091 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:48.534564 23077 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 09:02:48.534693 23077 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "067b6d1229734ede96d13fba86419a96"
format_stamp: "Formatted at 2026-11-18 09:02:48 on dist-test-slave-q6bx"
I20261118 09:02:48.534786 23077 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:48.549161 23077 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:48.549577 23077 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:48.549810 23077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:48.550297 23077 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:48.551192 23077 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 09:02:48.551265 23077 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:48.551371 23077 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 09:02:48.551419 23077 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:48.559803 23077 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.132:40733
I20261118 09:02:48.559835 23204 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.132:40733 every 8 connection(s)
I20261118 09:02:48.560786 23077 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20261118 09:02:48.568194 23205 heartbeater.cc:345] Connected to a master server at 127.18.135.190:37589
I20261118 09:02:48.568426 23205 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:48.568859 23205 heartbeater.cc:508] Master 127.18.135.190:37589 requested a full tablet report, sending...
I20261118 09:02:48.569939 22624 ts_manager.cc:210] Registered new tserver with Master: 067b6d1229734ede96d13fba86419a96 (127.18.135.132:40733)
I20261118 09:02:48.569969 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 23077
I20261118 09:02:48.570103 18974 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20261118 09:02:48.570523 22624 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.132:56895
I20261118 09:02:48.572487 18974 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 09:02:48.580977 22624 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59956:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
I20261118 09:02:48.599951 23005 tablet_service.cc:1500] Processing CreateTablet for tablet e9f29e09218c43bcb42a301753db999d (DEFAULT_TABLE table=TestTable [id=59031b91870241b48c259d907e9a89ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:48.601158 23005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f29e09218c43bcb42a301753db999d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:48.603169 23139 tablet_service.cc:1500] Processing CreateTablet for tablet e9f29e09218c43bcb42a301753db999d (DEFAULT_TABLE table=TestTable [id=59031b91870241b48c259d907e9a89ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:48.603838 23139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f29e09218c43bcb42a301753db999d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:48.606516 23222 tablet_bootstrap.cc:492] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8: Bootstrap starting.
I20261118 09:02:48.607282 22877 tablet_service.cc:1500] Processing CreateTablet for tablet e9f29e09218c43bcb42a301753db999d (DEFAULT_TABLE table=TestTable [id=59031b91870241b48c259d907e9a89ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 09:02:48.608150 22877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f29e09218c43bcb42a301753db999d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 09:02:48.608735 23222 tablet_bootstrap.cc:654] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:48.608785 23223 tablet_bootstrap.cc:492] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Bootstrap starting.
I20261118 09:02:48.609674 23222 log.cc:826] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:48.611241 23223 tablet_bootstrap.cc:654] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:48.611311 23222 tablet_bootstrap.cc:492] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8: No bootstrap required, opened a new log
I20261118 09:02:48.611505 23222 ts_tablet_manager.cc:1449] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 09:02:48.612103 23223 log.cc:826] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:48.613372 23226 tablet_bootstrap.cc:492] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055: Bootstrap starting.
I20261118 09:02:48.613518 23223 tablet_bootstrap.cc:492] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: No bootstrap required, opened a new log
I20261118 09:02:48.613803 23223 ts_tablet_manager.cc:1449] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Time spent bootstrapping tablet: real 0.005s	user 0.001s	sys 0.004s
I20261118 09:02:48.614647 23222 raft_consensus.cc:360] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:48.614979 23222 raft_consensus.cc:386] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:48.615078 23222 raft_consensus.cc:748] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9806924f51314f71ac4a8b5ced2c5bf8, State: Initialized, Role: FOLLOWER
I20261118 09:02:48.615562 23226 tablet_bootstrap.cc:654] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055: Neither blocks nor log segments found. Creating new log.
I20261118 09:02:48.615585 23222 consensus_queue.cc:261] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:48.616252 23074 heartbeater.cc:500] Master 127.18.135.190:37589 was elected leader, sending a full tablet report...
I20261118 09:02:48.616398 23222 ts_tablet_manager.cc:1480] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20261118 09:02:48.616468 23226 log.cc:826] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:48.617547 23223 raft_consensus.cc:360] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:48.617762 23223 raft_consensus.cc:386] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:48.617877 23223 raft_consensus.cc:748] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 067b6d1229734ede96d13fba86419a96, State: Initialized, Role: FOLLOWER
I20261118 09:02:48.618263 23223 consensus_queue.cc:261] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:48.618671 23226 tablet_bootstrap.cc:492] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055: No bootstrap required, opened a new log
I20261118 09:02:48.618878 23205 heartbeater.cc:500] Master 127.18.135.190:37589 was elected leader, sending a full tablet report...
I20261118 09:02:48.618920 23226 ts_tablet_manager.cc:1449] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20261118 09:02:48.619086 23223 ts_tablet_manager.cc:1480] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20261118 09:02:48.621894 23226 raft_consensus.cc:360] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:48.622128 23226 raft_consensus.cc:386] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 09:02:48.622189 23226 raft_consensus.cc:748] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e1fc3f49b54dfdb70548e221015055, State: Initialized, Role: FOLLOWER
I20261118 09:02:48.622551 23226 consensus_queue.cc:261] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:48.623153 22943 heartbeater.cc:500] Master 127.18.135.190:37589 was elected leader, sending a full tablet report...
I20261118 09:02:48.623183 23226 ts_tablet_manager.cc:1480] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
W20261118 09:02:48.637339 22944 tablet.cc:2441] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 09:02:48.661577 23206 tablet.cc:2441] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261118 09:02:48.690832 23229 raft_consensus.cc:499] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261118 09:02:48.691057 23229 raft_consensus.cc:521] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:48.692305 23229 leader_election.cc:290] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9806924f51314f71ac4a8b5ced2c5bf8 (127.18.135.131:46085), a2e1fc3f49b54dfdb70548e221015055 (127.18.135.130:43495)
I20261118 09:02:48.696342 23014 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "067b6d1229734ede96d13fba86419a96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" is_pre_election: true
I20261118 09:02:48.696615 22897 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "067b6d1229734ede96d13fba86419a96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e1fc3f49b54dfdb70548e221015055" is_pre_election: true
I20261118 09:02:48.696851 22897 raft_consensus.cc:2490] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 067b6d1229734ede96d13fba86419a96 in term 0.
I20261118 09:02:48.696621 23014 raft_consensus.cc:2490] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 067b6d1229734ede96d13fba86419a96 in term 0.
I20261118 09:02:48.697353 23092 leader_election.cc:304] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 067b6d1229734ede96d13fba86419a96, a2e1fc3f49b54dfdb70548e221015055; no voters: 
I20261118 09:02:48.697600 23229 raft_consensus.cc:2826] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261118 09:02:48.697685 23229 raft_consensus.cc:499] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261118 09:02:48.697769 23229 raft_consensus.cc:3096] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:48.698632 23229 raft_consensus.cc:521] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:48.699023 23229 leader_election.cc:290] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [CANDIDATE]: Term 1 election: Requested vote from peers 9806924f51314f71ac4a8b5ced2c5bf8 (127.18.135.131:46085), a2e1fc3f49b54dfdb70548e221015055 (127.18.135.130:43495)
I20261118 09:02:48.699275 23014 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "067b6d1229734ede96d13fba86419a96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9806924f51314f71ac4a8b5ced2c5bf8"
I20261118 09:02:48.699364 22897 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "067b6d1229734ede96d13fba86419a96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2e1fc3f49b54dfdb70548e221015055"
I20261118 09:02:48.699424 23014 raft_consensus.cc:3096] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:48.699501 22897 raft_consensus.cc:3096] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 0 FOLLOWER]: Advancing to term 1
I20261118 09:02:48.700318 23014 raft_consensus.cc:2490] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 067b6d1229734ede96d13fba86419a96 in term 1.
I20261118 09:02:48.700438 22897 raft_consensus.cc:2490] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 067b6d1229734ede96d13fba86419a96 in term 1.
I20261118 09:02:48.700595 23095 leader_election.cc:304] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 067b6d1229734ede96d13fba86419a96, 9806924f51314f71ac4a8b5ced2c5bf8; no voters: 
I20261118 09:02:48.700802 23229 raft_consensus.cc:2826] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 1 FOLLOWER]: Leader election won for term 1
I20261118 09:02:48.701023 23229 raft_consensus.cc:705] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 1 LEADER]: Becoming Leader. State: Replica: 067b6d1229734ede96d13fba86419a96, State: Running, Role: LEADER
I20261118 09:02:48.701360 23229 consensus_queue.cc:238] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:48.704540 22623 catalog_manager.cc:5840] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 067b6d1229734ede96d13fba86419a96 (127.18.135.132). New cstate: current_term: 1 leader_uuid: "067b6d1229734ede96d13fba86419a96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } health_report { overall_health: HEALTHY } } }
I20261118 09:02:48.704823 23234 consensus_queue.cc:1049] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 09:02:48.704953 23229 consensus_queue.cc:1049] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20261118 09:02:48.706367 23075 tablet.cc:2441] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261118 09:02:48.715121 18974 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 09:02:48.716576 18974 ts_itest-base.cc:246] Waiting for 1 tablets on tserver a2e1fc3f49b54dfdb70548e221015055 to finish bootstrapping
I20261118 09:02:48.721920 18974 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 9806924f51314f71ac4a8b5ced2c5bf8 to finish bootstrapping
I20261118 09:02:48.726490 18974 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 067b6d1229734ede96d13fba86419a96 to finish bootstrapping
I20261118 09:02:48.731211 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 23077
I20261118 09:02:48.738513 18974 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
/tmp/dist-test-taskIHNTqP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.135.132:40733
--local_ip_for_outbound_sockets=127.18.135.132
--tserver_master_addrs=127.18.135.190:37589
--webserver_port=35429
--webserver_interface=127.18.135.132
--builtin_ntp_servers=127.18.135.148:38985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000
--tablet_bootstrap_inject_latency_ms=3000 with env {}
W20261118 09:02:48.840653 23241 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 09:02:48.840834 23241 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 09:02:48.840855 23241 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 09:02:48.840894 23241 flags.cc:432] Enabled unsafe flag: --tablet_bootstrap_inject_latency_ms=3000
W20261118 09:02:48.840910 23241 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 09:02:48.844381 23241 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 09:02:48.844430 23241 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 09:02:48.844465 23241 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 09:02:48.844528 23241 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 09:02:48.844558 23241 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.135.132
I20261118 09:02:48.848407 23241 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.135.148:38985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.135.132:40733
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.18.135.132
--webserver_port=35429
--tserver_master_addrs=127.18.135.190:37589
--tablet_bootstrap_inject_latency_ms=3000
--never_fsync=true
--heap_profile_path=/tmp/kudu.23241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.135.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 08:43:15 UTC on bdcb31816ec0
build id 14839
I20261118 09:02:48.849073 23241 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 09:02:48.849823 23241 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 09:02:48.855379 23246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:48.855412 23247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 09:02:48.855417 23249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 09:02:48.855634 23241 server_base.cc:1061] running on GCE node
I20261118 09:02:48.855994 23241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 09:02:48.856613 23241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 09:02:48.857796 23241 hybrid_clock.cc:648] HybridClock initialized: now 1794992568857770 us; error 39 us; skew 500 ppm
I20261118 09:02:48.859475 23241 webserver.cc:577] Webserver started at http://127.18.135.132:35429/ using document root <none> and password file <none>
I20261118 09:02:48.860041 23241 fs_manager.cc:362] Metadata directory not provided
I20261118 09:02:48.860133 23241 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 09:02:48.863435 23241 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.000s	sys 0.003s
I20261118 09:02:48.865504 23255 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 09:02:48.866586 23241 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20261118 09:02:48.866721 23241 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "067b6d1229734ede96d13fba86419a96"
format_stamp: "Formatted at 2026-11-18 09:02:48 on dist-test-slave-q6bx"
I20261118 09:02:48.867076 23241 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 09:02:48.878708 23241 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 09:02:48.879083 23241 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 09:02:48.879245 23241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 09:02:48.879717 23241 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 09:02:48.880784 23262 ts_tablet_manager.cc:588] Loading tablet metadata (0/1 complete)
I20261118 09:02:48.884891 23241 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261118 09:02:48.884963 23241 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20261118 09:02:48.885046 23241 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261118 09:02:48.886504 23241 ts_tablet_manager.cc:662] Registered 1 tablets
W20261118 09:02:48.886559 23262 ts_tablet_manager.cc:1428] Injecting 3000ms delay in tablet bootstrapping
I20261118 09:02:48.886582 23241 ts_tablet_manager.cc:641] Time spent register tablets: real 0.002s	user 0.001s	sys 0.000s
I20261118 09:02:48.895370 23241 rpc_server.cc:307] RPC server started. Bound to: 127.18.135.132:40733
I20261118 09:02:48.895395 23369 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.135.132:40733 every 8 connection(s)
I20261118 09:02:48.896379 23241 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20261118 09:02:48.903949 18974 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu as pid 23241
I20261118 09:02:48.904162 23370 heartbeater.cc:345] Connected to a master server at 127.18.135.190:37589
I20261118 09:02:48.904440 23370 heartbeater.cc:462] Registering TS with master...
I20261118 09:02:48.904942 23370 heartbeater.cc:508] Master 127.18.135.190:37589 requested a full tablet report, sending...
I20261118 09:02:48.906630 22623 ts_manager.cc:210] Re-registered known tserver with Master: 067b6d1229734ede96d13fba86419a96 (127.18.135.132:40733)
I20261118 09:02:48.907598 22623 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.18.135.132:39791
I20261118 09:02:49.095095 22812 heartbeater.cc:500] Master 127.18.135.190:37589 was elected leader, sending a full tablet report...
I20261118 09:02:49.909632 23370 heartbeater.cc:500] Master 127.18.135.190:37589 was elected leader, sending a full tablet report...
I20261118 09:02:50.210691 23375 raft_consensus.cc:499] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 067b6d1229734ede96d13fba86419a96)
I20261118 09:02:50.210762 23376 raft_consensus.cc:499] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 067b6d1229734ede96d13fba86419a96)
I20261118 09:02:50.210863 23375 raft_consensus.cc:521] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:50.210911 23376 raft_consensus.cc:521] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:50.212028 23375 leader_election.cc:290] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2e1fc3f49b54dfdb70548e221015055 (127.18.135.130:43495), 067b6d1229734ede96d13fba86419a96 (127.18.135.132:40733)
I20261118 09:02:50.212242 23376 leader_election.cc:290] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9806924f51314f71ac4a8b5ced2c5bf8 (127.18.135.131:46085), 067b6d1229734ede96d13fba86419a96 (127.18.135.132:40733)
I20261118 09:02:50.216985 23014 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "a2e1fc3f49b54dfdb70548e221015055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" is_pre_election: true
I20261118 09:02:50.217144 23014 raft_consensus.cc:2490] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e1fc3f49b54dfdb70548e221015055 in term 1.
I20261118 09:02:50.217262 22897 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2e1fc3f49b54dfdb70548e221015055" is_pre_election: true
I20261118 09:02:50.217374 22897 raft_consensus.cc:2490] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9806924f51314f71ac4a8b5ced2c5bf8 in term 1.
I20261118 09:02:50.217813 22961 leader_election.cc:304] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9806924f51314f71ac4a8b5ced2c5bf8, a2e1fc3f49b54dfdb70548e221015055; no voters: 
I20261118 09:02:50.217814 22833 leader_election.cc:304] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9806924f51314f71ac4a8b5ced2c5bf8, a2e1fc3f49b54dfdb70548e221015055; no voters: 
I20261118 09:02:50.218032 23375 raft_consensus.cc:2826] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261118 09:02:50.218043 23376 raft_consensus.cc:2826] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261118 09:02:50.218094 23376 raft_consensus.cc:499] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 067b6d1229734ede96d13fba86419a96)
I20261118 09:02:50.218130 23376 raft_consensus.cc:3096] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 1 FOLLOWER]: Advancing to term 2
I20261118 09:02:50.218118 23375 raft_consensus.cc:499] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 067b6d1229734ede96d13fba86419a96)
I20261118 09:02:50.218171 23375 raft_consensus.cc:3096] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 1 FOLLOWER]: Advancing to term 2
I20261118 09:02:50.217535 23323 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "067b6d1229734ede96d13fba86419a96" is_pre_election: true
I20261118 09:02:50.217571 23324 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "a2e1fc3f49b54dfdb70548e221015055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "067b6d1229734ede96d13fba86419a96" is_pre_election: true
W20261118 09:02:50.219300 22963 leader_election.cc:343] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 067b6d1229734ede96d13fba86419a96 (127.18.135.132:40733): Illegal state: must be running to vote when last-logged opid is not known
W20261118 09:02:50.219341 22832 leader_election.cc:343] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 067b6d1229734ede96d13fba86419a96 (127.18.135.132:40733): Illegal state: must be running to vote when last-logged opid is not known
I20261118 09:02:50.220798 23375 raft_consensus.cc:521] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:50.220816 23376 raft_consensus.cc:521] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:50.221210 23376 leader_election.cc:290] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [CANDIDATE]: Term 2 election: Requested vote from peers 9806924f51314f71ac4a8b5ced2c5bf8 (127.18.135.131:46085), 067b6d1229734ede96d13fba86419a96 (127.18.135.132:40733)
I20261118 09:02:50.221213 23375 leader_election.cc:290] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [CANDIDATE]: Term 2 election: Requested vote from peers a2e1fc3f49b54dfdb70548e221015055 (127.18.135.130:43495), 067b6d1229734ede96d13fba86419a96 (127.18.135.132:40733)
I20261118 09:02:50.221606 23014 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "a2e1fc3f49b54dfdb70548e221015055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9806924f51314f71ac4a8b5ced2c5bf8"
I20261118 09:02:50.221668 22897 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2e1fc3f49b54dfdb70548e221015055"
I20261118 09:02:50.221635 23324 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "067b6d1229734ede96d13fba86419a96"
I20261118 09:02:50.221792 23014 raft_consensus.cc:2415] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a2e1fc3f49b54dfdb70548e221015055 in current term 2: Already voted for candidate 9806924f51314f71ac4a8b5ced2c5bf8 in this term.
I20261118 09:02:50.221827 22897 raft_consensus.cc:2415] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9806924f51314f71ac4a8b5ced2c5bf8 in current term 2: Already voted for candidate a2e1fc3f49b54dfdb70548e221015055 in this term.
I20261118 09:02:50.221635 23323 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "a2e1fc3f49b54dfdb70548e221015055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "067b6d1229734ede96d13fba86419a96"
W20261118 09:02:50.222033 22963 leader_election.cc:343] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 067b6d1229734ede96d13fba86419a96 (127.18.135.132:40733): Illegal state: must be running to vote when last-logged opid is not known
I20261118 09:02:50.222126 22961 leader_election.cc:304] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9806924f51314f71ac4a8b5ced2c5bf8; no voters: 067b6d1229734ede96d13fba86419a96, a2e1fc3f49b54dfdb70548e221015055
W20261118 09:02:50.222188 22832 leader_election.cc:343] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 067b6d1229734ede96d13fba86419a96 (127.18.135.132:40733): Illegal state: must be running to vote when last-logged opid is not known
I20261118 09:02:50.222237 22832 leader_election.cc:304] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2e1fc3f49b54dfdb70548e221015055; no voters: 067b6d1229734ede96d13fba86419a96, 9806924f51314f71ac4a8b5ced2c5bf8
I20261118 09:02:50.222276 23375 raft_consensus.cc:2771] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20261118 09:02:50.222368 23376 raft_consensus.cc:2771] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20261118 09:02:51.887041 23262 tablet_bootstrap.cc:492] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Bootstrap starting.
I20261118 09:02:51.893893 23262 log.cc:826] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Log is configured to *not* fsync() on all Append() calls
I20261118 09:02:51.896224 23262 tablet_bootstrap.cc:492] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261118 09:02:51.896574 23262 tablet_bootstrap.cc:492] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Bootstrap complete.
I20261118 09:02:51.896994 23262 ts_tablet_manager.cc:1449] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Time spent bootstrapping tablet: real 0.010s	user 0.004s	sys 0.004s
I20261118 09:02:51.899199 23262 raft_consensus.cc:360] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:51.899576 23262 raft_consensus.cc:748] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 067b6d1229734ede96d13fba86419a96, State: Initialized, Role: FOLLOWER
I20261118 09:02:51.900038 23262 consensus_queue.cc:261] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:51.900787 23262 ts_tablet_manager.cc:1480] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20261118 09:02:51.924801 23387 raft_consensus.cc:499] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261118 09:02:51.924917 23387 raft_consensus.cc:521] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:51.925443 23387 leader_election.cc:290] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9806924f51314f71ac4a8b5ced2c5bf8 (127.18.135.131:46085), 067b6d1229734ede96d13fba86419a96 (127.18.135.132:40733)
I20261118 09:02:51.925848 23014 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "a2e1fc3f49b54dfdb70548e221015055" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" is_pre_election: true
I20261118 09:02:51.925881 23323 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "a2e1fc3f49b54dfdb70548e221015055" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "067b6d1229734ede96d13fba86419a96" is_pre_election: true
I20261118 09:02:51.926011 23014 raft_consensus.cc:2490] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e1fc3f49b54dfdb70548e221015055 in term 2.
I20261118 09:02:51.926163 23323 raft_consensus.cc:2490] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e1fc3f49b54dfdb70548e221015055 in term 1.
I20261118 09:02:51.926381 22833 leader_election.cc:304] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9806924f51314f71ac4a8b5ced2c5bf8, a2e1fc3f49b54dfdb70548e221015055; no voters: 
I20261118 09:02:51.926582 23387 raft_consensus.cc:2826] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20261118 09:02:51.926654 23387 raft_consensus.cc:499] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261118 09:02:51.926703 23387 raft_consensus.cc:3096] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 2 FOLLOWER]: Advancing to term 3
I20261118 09:02:51.927479 23387 raft_consensus.cc:521] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:51.927783 23387 leader_election.cc:290] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [CANDIDATE]: Term 3 election: Requested vote from peers 9806924f51314f71ac4a8b5ced2c5bf8 (127.18.135.131:46085), 067b6d1229734ede96d13fba86419a96 (127.18.135.132:40733)
I20261118 09:02:51.928059 23014 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "a2e1fc3f49b54dfdb70548e221015055" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9806924f51314f71ac4a8b5ced2c5bf8"
I20261118 09:02:51.928103 23323 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "e9f29e09218c43bcb42a301753db999d" candidate_uuid: "a2e1fc3f49b54dfdb70548e221015055" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "067b6d1229734ede96d13fba86419a96"
I20261118 09:02:51.928169 23014 raft_consensus.cc:3096] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 2 FOLLOWER]: Advancing to term 3
I20261118 09:02:51.928236 23323 raft_consensus.cc:3096] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 1 FOLLOWER]: Advancing to term 3
I20261118 09:02:51.929157 23014 raft_consensus.cc:2490] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e1fc3f49b54dfdb70548e221015055 in term 3.
I20261118 09:02:51.929441 22833 leader_election.cc:304] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9806924f51314f71ac4a8b5ced2c5bf8, a2e1fc3f49b54dfdb70548e221015055; no voters: 
I20261118 09:02:51.929615 23387 raft_consensus.cc:2826] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 3 FOLLOWER]: Leader election won for term 3
I20261118 09:02:51.929828 23387 raft_consensus.cc:705] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [term 3 LEADER]: Becoming Leader. State: Replica: a2e1fc3f49b54dfdb70548e221015055, State: Running, Role: LEADER
I20261118 09:02:51.930146 23323 raft_consensus.cc:2490] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e1fc3f49b54dfdb70548e221015055 in term 3.
I20261118 09:02:51.930159 23387 consensus_queue.cc:238] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } }
I20261118 09:02:51.932446 23323 raft_consensus.cc:1285] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96 [term 3 FOLLOWER]: Refusing update from remote peer a2e1fc3f49b54dfdb70548e221015055: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20261118 09:02:51.932605 22623 catalog_manager.cc:5840] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 reported cstate change: term changed from 1 to 3, leader changed from 067b6d1229734ede96d13fba86419a96 (127.18.135.132) to a2e1fc3f49b54dfdb70548e221015055 (127.18.135.130). New cstate: current_term: 3 leader_uuid: "a2e1fc3f49b54dfdb70548e221015055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e1fc3f49b54dfdb70548e221015055" member_type: VOTER last_known_addr { host: "127.18.135.130" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 } health_report { overall_health: UNKNOWN } } }
I20261118 09:02:51.933036 23387 consensus_queue.cc:1049] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "067b6d1229734ede96d13fba86419a96" member_type: VOTER last_known_addr { host: "127.18.135.132" port: 40733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20261118 09:02:51.933547 23014 raft_consensus.cc:1285] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8 [term 3 FOLLOWER]: Refusing update from remote peer a2e1fc3f49b54dfdb70548e221015055: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20261118 09:02:51.933993 23387 consensus_queue.cc:1049] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9806924f51314f71ac4a8b5ced2c5bf8" member_type: VOTER last_known_addr { host: "127.18.135.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20261118 09:02:52.574386 18974 test_workload.cc:405] TestWorkload: Skipping table creation because table TestTable already exists
I20261118 09:02:52.574714 18974 raft_config_change-itest.cc:610] Waiting until we've written at least 4MB...
I20261118 09:02:52.651232 22944 maintenance_manager.cc:419] P a2e1fc3f49b54dfdb70548e221015055: Scheduling FlushMRSOp(e9f29e09218c43bcb42a301753db999d): 2761400 bytes log retention, and flush 4038921 bytes memory
I20261118 09:02:52.698629 18974 raft_config_change-itest.cc:616] Waiting for log GC on a2e1fc3f49b54dfdb70548e221015055
I20261118 09:02:52.705832 23371 maintenance_manager.cc:419] P 067b6d1229734ede96d13fba86419a96: Scheduling FlushMRSOp(e9f29e09218c43bcb42a301753db999d): 4339222 bytes log retention, and flush 6119689 bytes memory
I20261118 09:02:52.719604 23075 maintenance_manager.cc:419] P 9806924f51314f71ac4a8b5ced2c5bf8: Scheduling FlushMRSOp(e9f29e09218c43bcb42a301753db999d): 4733730 bytes log retention, and flush 6119689 bytes memory
I20261118 09:02:52.719521 22834 maintenance_manager.cc:643] P a2e1fc3f49b54dfdb70548e221015055: FlushMRSOp(e9f29e09218c43bcb42a301753db999d) complete. Timing: real 0.068s	user 0.041s	sys 0.000s Metrics: {"bytes_written":135869,"cfile_init":1,"compiler_manager_pool.queue_time_us":24915,"drs_written":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4,"lbm_write_time_us":623,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":22,"thread_start_us":234,"threads_started":2}
I20261118 09:02:52.720351 22944 maintenance_manager.cc:419] P a2e1fc3f49b54dfdb70548e221015055: Scheduling LogGCOp(e9f29e09218c43bcb42a301753db999d): free 2761400 bytes of WAL
I20261118 09:02:52.720623 22834 log_reader.cc:385] T e9f29e09218c43bcb42a301753db999d: removed 3 log segments from log reader
I20261118 09:02:52.720741 22834 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000001 (ops 1-9)
I20261118 09:02:52.720865 22834 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000002 (ops 10-16)
I20261118 09:02:52.720952 22834 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000003 (ops 17-23)
I20261118 09:02:52.721972 22834 maintenance_manager.cc:643] P a2e1fc3f49b54dfdb70548e221015055: LogGCOp(e9f29e09218c43bcb42a301753db999d) complete. Timing: real 0.001s	user 0.000s	sys 0.001s Metrics: {}
I20261118 09:02:52.722287 22944 maintenance_manager.cc:419] P a2e1fc3f49b54dfdb70548e221015055: Scheduling FlushMRSOp(e9f29e09218c43bcb42a301753db999d): 1840912 bytes log retention, and flush 2998537 bytes memory
I20261118 09:02:52.729461 18974 raft_config_change-itest.cc:620] Log GC complete on a2e1fc3f49b54dfdb70548e221015055
I20261118 09:02:52.748620 22834 maintenance_manager.cc:643] P a2e1fc3f49b54dfdb70548e221015055: FlushMRSOp(e9f29e09218c43bcb42a301753db999d) complete. Timing: real 0.026s	user 0.022s	sys 0.003s Metrics: {"bytes_written":135869,"cfile_init":1,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":142,"dirs.run_wall_time_us":1284,"drs_written":1,"lbm_read_time_us":42,"lbm_reads_lt_1ms":4,"lbm_write_time_us":642,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":18}
I20261118 09:02:52.749595 22944 maintenance_manager.cc:419] P a2e1fc3f49b54dfdb70548e221015055: Scheduling LogGCOp(e9f29e09218c43bcb42a301753db999d): free 1840912 bytes of WAL
I20261118 09:02:52.749835 22834 log_reader.cc:385] T e9f29e09218c43bcb42a301753db999d: removed 2 log segments from log reader
I20261118 09:02:52.749919 22834 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000004 (ops 24-30)
I20261118 09:02:52.750005 22834 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P a2e1fc3f49b54dfdb70548e221015055: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-1/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000005 (ops 31-37)
I20261118 09:02:52.750655 22834 maintenance_manager.cc:643] P a2e1fc3f49b54dfdb70548e221015055: LogGCOp(e9f29e09218c43bcb42a301753db999d) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
I20261118 09:02:52.750890 22944 maintenance_manager.cc:419] P a2e1fc3f49b54dfdb70548e221015055: Scheduling UndoDeltaBlockGCOp(e9f29e09218c43bcb42a301753db999d): 715 bytes on disk
I20261118 09:02:52.751536 22834 maintenance_manager.cc:643] P a2e1fc3f49b54dfdb70548e221015055: UndoDeltaBlockGCOp(e9f29e09218c43bcb42a301753db999d) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":103,"lbm_reads_lt_1ms":8}
I20261118 09:02:52.751938 22944 maintenance_manager.cc:419] P a2e1fc3f49b54dfdb70548e221015055: Scheduling CompactRowSetsOp(e9f29e09218c43bcb42a301753db999d): perf score=0.993135
I20261118 09:02:52.774298 23260 maintenance_manager.cc:643] P 067b6d1229734ede96d13fba86419a96: FlushMRSOp(e9f29e09218c43bcb42a301753db999d) complete. Timing: real 0.068s	user 0.066s	sys 0.000s Metrics: {"bytes_written":136001,"cfile_init":1,"compiler_manager_pool.queue_time_us":199,"drs_written":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4,"lbm_write_time_us":614,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":40,"thread_start_us":237,"threads_started":2}
I20261118 09:02:52.775126 23371 maintenance_manager.cc:419] P 067b6d1229734ede96d13fba86419a96: Scheduling LogGCOp(e9f29e09218c43bcb42a301753db999d): free 4339222 bytes of WAL
I20261118 09:02:52.775395 23260 log_reader.cc:385] T e9f29e09218c43bcb42a301753db999d: removed 5 log segments from log reader
I20261118 09:02:52.775488 23260 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000001 (ops 1-9)
I20261118 09:02:52.775609 23260 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000002 (ops 10-16)
I20261118 09:02:52.775681 23260 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000003 (ops 17-21)
I20261118 09:02:52.775750 23260 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000004 (ops 22-28)
I20261118 09:02:52.775820 23260 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P 067b6d1229734ede96d13fba86419a96: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-3/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000005 (ops 29-35)
I20261118 09:02:52.777197 23260 maintenance_manager.cc:643] P 067b6d1229734ede96d13fba86419a96: LogGCOp(e9f29e09218c43bcb42a301753db999d) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {}
I20261118 09:02:52.777647 23371 maintenance_manager.cc:419] P 067b6d1229734ede96d13fba86419a96: Scheduling UndoDeltaBlockGCOp(e9f29e09218c43bcb42a301753db999d): 578 bytes on disk
I20261118 09:02:52.778330 23260 maintenance_manager.cc:643] P 067b6d1229734ede96d13fba86419a96: UndoDeltaBlockGCOp(e9f29e09218c43bcb42a301753db999d) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":166,"lbm_reads_lt_1ms":4}
I20261118 09:02:52.829185 22834 maintenance_manager.cc:643] P a2e1fc3f49b54dfdb70548e221015055: CompactRowSetsOp(e9f29e09218c43bcb42a301753db999d) complete. Timing: real 0.077s	user 0.058s	sys 0.000s Metrics: {"bytes_written":136001,"cfile_cache_hit":10,"cfile_cache_hit_bytes":262392,"cfile_cache_miss":26,"cfile_cache_miss_bytes":264498,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":87,"dirs.run_cpu_time_us":198,"dirs.run_wall_time_us":1350,"drs_written":1,"lbm_read_time_us":666,"lbm_reads_lt_1ms":46,"lbm_write_time_us":589,"lbm_writes_lt_1ms":23,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":40,"thread_start_us":318,"threads_started":5}
I20261118 09:02:52.829685 22944 maintenance_manager.cc:419] P a2e1fc3f49b54dfdb70548e221015055: Scheduling UndoDeltaBlockGCOp(e9f29e09218c43bcb42a301753db999d): 578 bytes on disk
I20261118 09:02:52.830049 22834 maintenance_manager.cc:643] P a2e1fc3f49b54dfdb70548e221015055: UndoDeltaBlockGCOp(e9f29e09218c43bcb42a301753db999d) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4}
I20261118 09:02:52.845742 22965 maintenance_manager.cc:643] P 9806924f51314f71ac4a8b5ced2c5bf8: FlushMRSOp(e9f29e09218c43bcb42a301753db999d) complete. Timing: real 0.126s	user 0.062s	sys 0.000s Metrics: {"bytes_written":136001,"cfile_init":1,"compiler_manager_pool.queue_time_us":38142,"drs_written":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4,"lbm_write_time_us":628,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":40,"thread_start_us":234,"threads_started":2}
I20261118 09:02:52.846566 23075 maintenance_manager.cc:419] P 9806924f51314f71ac4a8b5ced2c5bf8: Scheduling LogGCOp(e9f29e09218c43bcb42a301753db999d): free 4733730 bytes of WAL
I20261118 09:02:52.846860 22965 log_reader.cc:385] T e9f29e09218c43bcb42a301753db999d: removed 6 log segments from log reader
I20261118 09:02:52.846954 22965 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000001 (ops 1-8)
I20261118 09:02:52.847038 22965 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000002 (ops 9-14)
I20261118 09:02:52.847095 22965 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000003 (ops 15-21)
I20261118 09:02:52.847149 22965 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000004 (ops 22-28)
I20261118 09:02:52.847204 22965 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000005 (ops 29-34)
I20261118 09:02:52.847258 22965 log.cc:1079] T e9f29e09218c43bcb42a301753db999d P 9806924f51314f71ac4a8b5ced2c5bf8: Deleting log segment in path: /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0/raft_consensus-itest-cluster/ts-2/wal/wals/e9f29e09218c43bcb42a301753db999d/wal-000000006 (ops 35-38)
I20261118 09:02:52.848776 22965 maintenance_manager.cc:643] P 9806924f51314f71ac4a8b5ced2c5bf8: LogGCOp(e9f29e09218c43bcb42a301753db999d) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {}
I20261118 09:02:52.849088 23075 maintenance_manager.cc:419] P 9806924f51314f71ac4a8b5ced2c5bf8: Scheduling UndoDeltaBlockGCOp(e9f29e09218c43bcb42a301753db999d): 578 bytes on disk
I20261118 09:02:52.849649 22965 maintenance_manager.cc:643] P 9806924f51314f71ac4a8b5ced2c5bf8: UndoDeltaBlockGCOp(e9f29e09218c43bcb42a301753db999d) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4}
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/integration-tests/raft_config_change-itest.cc:500: Failure
Value of: IsRaftConfigMember(added_replica_uuid, cstate.committed_config())
  Actual: false
Expected: true
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20261118 09:03:22.880757 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 22684
I20261118 09:03:22.886961 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 22815
I20261118 09:03:22.894106 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 22946
I20261118 09:03:22.900820 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 23241
I20261118 09:03:22.907128 18974 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskIHNTqP/build/debug/bin/kudu with pid 22593
2026-11-18T09:03:22Z chronyd exiting
I20261118 09:03:22.924110 18974 test_util.cc:182] -----------------------------------------------
I20261118 09:03:22.924158 18974 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskIHNTqP/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794992541567553-18974-0
[  FAILED  ] SlowTabletBootstrapTest.TestFallBehindSlowBootstrap (35225 ms)
[----------] 3 tests from SlowTabletBootstrapTest (47060 ms total)

[----------] Global test environment tear-down
[==========] 6 tests from 2 test suites ran. (61348 ms total)
[  PASSED  ] 5 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] SlowTabletBootstrapTest.TestFallBehindSlowBootstrap

 1 FAILED TEST